2019-11-28T21:27:47.816 INFO:root:teuthology version: 1.0.0-e749e7b 2019-11-28T21:27:47.817 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.U85ufb.tmp -- --verbose --lock --description rgw:verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} --name mkogan-2019-11-28_17:38:37-rgw:verify-wip-mkogan-testing-distro-basic-smithi --block --owner scheduled_mkogan@teuthology --archive /home/teuthworker/archive/mkogan-2019-11-28_17:38:37-rgw:verify-wip-mkogan-testing-distro-basic-smithi/4550431 2019-11-28T21:27:47.868 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-11-28T21:27:47.927 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mkogan-2019-11-28_17:38:37-rgw:verify-wip-mkogan-testing-distro-basic-smithi/4550431 branch: wip-mkogan-testing description: rgw:verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} email: mkogan@redhat.com first_in_suite: false job_id: '4550431' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: mkogan-2019-11-28_17:38:37-rgw:verify-wip-mkogan-testing-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos overrides: admin_socket: branch: wip-mkogan-testing ceph: conf: client: debug rgw: 20 rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw lc debug interval: 10 global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd shutdown pgref assert: true fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME sha1: 00732956b62306ff37a7f7c81af9db807aae2dc8 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes osd: - --tool=memcheck ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: notcmalloc sha1: 00732956b62306ff37a7f7c81af9db807aae2dc8 rgw: compression type: random ec-data-pool: true frontend: civetweb storage classes: LUKEWARM, FROZEN s3tests: slow_backend: true thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mkogan-testing sha1: 00732956b62306ff37a7f7c81af9db807aae2dc8 owner: scheduled_mkogan@teuthology priority: 90 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 sha1: 00732956b62306ff37a7f7c81af9db807aae2dc8 suite: rgw:verify suite_branch: wip-mkogan-testing suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_wip-mkogan-testing/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 00732956b62306ff37a7f7c81af9db807aae2dc8 tasks: - install: flavor: notcmalloc - ceph: null - openssl_keys: null - rgw: client.0: valgrind: - --tool=memcheck - --max-threads=1024 - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - rgw/test_rgw_gc_log.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - s3tests-java: client.0: force-branch: master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: force-branch: ceph-master rgw_server: client.0 - swift: client.0: rgw_server: client.0 teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.9250 2019-11-28T21:27:47.928 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_wip-mkogan-testing/qa; will attempt to use it 2019-11-28T21:27:47.928 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_wip-mkogan-testing/qa/tasks 2019-11-28T21:27:47.928 INFO:teuthology.run_tasks:Running task internal.check_packages... 2019-11-28T21:27:47.930 INFO:teuthology.task.internal:Checking packages... 2019-11-28T21:27:47.944 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'notcmalloc' and ceph hash '00732956b62306ff37a7f7c81af9db807aae2dc8' 2019-11-28T21:27:47.944 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2019-11-28T21:27:47.944 INFO:teuthology.packaging:ref: None 2019-11-28T21:27:47.944 INFO:teuthology.packaging:tag: None 2019-11-28T21:27:47.944 INFO:teuthology.packaging:branch: wip-mkogan-testing 2019-11-28T21:27:47.944 INFO:teuthology.packaging:sha1: 00732956b62306ff37a7f7c81af9db807aae2dc8 2019-11-28T21:27:47.945 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&ref=wip-mkogan-testing 2019-11-28T21:27:48.102 INFO:teuthology.task.internal:Found packages for ceph version 15.0.0-7725.g0073295 2019-11-28T21:27:48.102 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2019-11-28T21:27:48.112 INFO:teuthology.task.internal:no buildpackages task found 2019-11-28T21:27:48.112 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2019-11-28T21:27:48.126 INFO:teuthology.task.internal.lock_machines:Locking machines... 2019-11-28T21:27:48.126 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-11-28T21:27:48.170 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-28T21:27:58.185 DEBUG:teuthology.lock.ops:lock_many request: {'count': 2, 'locked_by': 'scheduled_mkogan@teuthology', 'description': '/home/teuthworker/archive/mkogan-2019-11-28_17:38:37-rgw:verify-wip-mkogan-testing-distro-basic-smithi/4550431', 'machine_type': 'smithi'} 2019-11-28T21:27:58.203 DEBUG:teuthology.lock.ops:locked ubuntu@smithi141.front.sepia.ceph.com, ubuntu@smithi074.front.sepia.ceph.com 2019-11-28T21:27:58.346 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2019-11-28T21:27:58.576 INFO:teuthology.provision.fog.smithi141:Scheduling deploy of centos 7.6 2019-11-28T21:27:58.595 INFO:teuthology.provision.fog.smithi074:Scheduling deploy of centos 7.6 2019-11-28T21:27:59.005 INFO:teuthology.orchestra.console:Power off smithi074 2019-11-28T21:27:59.005 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi074.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-11-28T21:27:59.047 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi074.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T21:27:59.141 INFO:teuthology.orchestra.console:Power off smithi141 2019-11-28T21:27:59.142 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-11-28T21:27:59.183 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T21:28:03.172 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi074.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T21:28:03.224 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T21:28:07.318 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi074.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T21:28:07.359 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T21:28:11.452 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi074.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T21:28:11.492 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T21:28:11.680 INFO:teuthology.orchestra.console:Power off for smithi074 completed 2019-11-28T21:28:11.728 INFO:teuthology.orchestra.console:Power off for smithi141 completed 2019-11-28T21:28:11.782 INFO:teuthology.orchestra.console:Power on smithi074 2019-11-28T21:28:11.782 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi074.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-11-28T21:28:11.826 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi074.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T21:28:11.855 INFO:teuthology.orchestra.console:Power on smithi141 2019-11-28T21:28:11.855 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-11-28T21:28:11.903 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T21:28:15.884 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi074.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T21:28:15.958 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T21:28:20.028 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi074.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T21:28:20.087 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-28T21:28:20.259 INFO:teuthology.orchestra.console:Power on for smithi074 completed 2019-11-28T21:28:20.320 INFO:teuthology.orchestra.console:Power on for smithi141 completed 2019-11-28T21:28:20.361 INFO:teuthology.provision.fog.smithi074:Waiting for deploy to finish 2019-11-28T21:28:20.422 INFO:teuthology.provision.fog.smithi141:Waiting for deploy to finish 2019-11-28T21:30:51.407 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi074.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:30:51.418 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi141.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:31:00.500 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi074.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:31:00.501 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi141.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:31:09.589 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi074.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:31:09.590 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi141.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:31:18.669 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi074.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:31:18.672 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi141.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:31:27.726 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi074.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:31:27.753 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi141.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:31:36.782 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi074.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:31:36.810 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi141.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:31:45.838 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi074.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:31:45.865 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi141.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:32:23.469 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi141.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:32:23.639 INFO:teuthology.orchestra.run.smithi141:> hostname 2019-11-28T21:32:24.138 INFO:teuthology.orchestra.run.smithi141.stdout:smithi068 2019-11-28T21:32:24.139 INFO:teuthology.orchestra.run.smithi141:> grep smithi068 /etc/hosts 2019-11-28T21:32:24.182 INFO:teuthology.orchestra.run.smithi141.stdout:172.21.15.68 smithi068.front.sepia.ceph.com smithi068 2019-11-28T21:32:24.183 INFO:teuthology.orchestra.run.smithi141:> sudo hostname smithi141 2019-11-28T21:32:24.346 INFO:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/smithi068/smithi141/g' /etc/hosts 2019-11-28T21:32:24.402 INFO:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/172.21.15.68/172.21.15.141/g' /etc/hosts 2019-11-28T21:32:24.470 INFO:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/smithi068/smithi141/g' /etc/hostname 2019-11-28T21:32:24.540 INFO:teuthology.orchestra.run.smithi141:> sudo hostname smithi141 2019-11-28T21:32:24.592 INFO:teuthology.provision.fog.smithi141:Deploy complete! 2019-11-28T21:32:24.594 DEBUG:teuthology.parallel:result is None 2019-11-28T21:32:51.862 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi074.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:32:52.054 INFO:teuthology.orchestra.run.smithi074:> hostname 2019-11-28T21:32:52.623 INFO:teuthology.orchestra.run.smithi074.stdout:smithi074 2019-11-28T21:32:52.624 INFO:teuthology.orchestra.run.smithi074:> grep smithi074 /etc/hosts 2019-11-28T21:32:52.703 INFO:teuthology.orchestra.run.smithi074.stdout:172.21.15.74 smithi074.front.sepia.ceph.com smithi074 2019-11-28T21:32:52.703 INFO:teuthology.orchestra.run.smithi074:> sudo hostname smithi074 2019-11-28T21:32:52.851 INFO:teuthology.orchestra.run.smithi074:> sudo sed -i -e 's/smithi074/smithi074/g' /etc/hosts 2019-11-28T21:32:52.963 INFO:teuthology.orchestra.run.smithi074:> sudo sed -i -e 's/172.21.15.74/172.21.15.74/g' /etc/hosts 2019-11-28T21:32:53.073 INFO:teuthology.orchestra.run.smithi074:> sudo sed -i -e 's/smithi074/smithi074/g' /etc/hostname 2019-11-28T21:32:53.180 INFO:teuthology.orchestra.run.smithi074:> sudo hostname smithi074 2019-11-28T21:32:53.282 INFO:teuthology.provision.fog.smithi074:Deploy complete! 2019-11-28T21:32:53.284 DEBUG:teuthology.parallel:result is None 2019-11-28T21:32:53.481 INFO:teuthology.lock.ops:Checking smithi074.front.sepia.ceph.com 2019-11-28T21:32:53.481 INFO:teuthology.lock.ops:New key found. Updating... 2019-11-28T21:32:53.515 INFO:teuthology.lock.ops:Checking smithi141.front.sepia.ceph.com 2019-11-28T21:32:53.515 INFO:teuthology.lock.ops:New key found. Updating... 2019-11-28T21:32:53.536 INFO:teuthology.lock.ops:Updating [smithi074.front.sepia.ceph.com]: set os type and version on server 2019-11-28T21:32:53.536 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T21:32:53.537 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi074.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:32:53.638 INFO:teuthology.orchestra.run.smithi074:> true 2019-11-28T21:32:54.032 INFO:teuthology.orchestra.run.smithi074:> uname -m 2019-11-28T21:32:54.100 INFO:teuthology.orchestra.run.smithi074.stdout:x86_64 2019-11-28T21:32:54.101 INFO:teuthology.orchestra.run.smithi074:> cat /etc/os-release 2019-11-28T21:32:54.166 INFO:teuthology.orchestra.run.smithi074.stdout:NAME="CentOS Linux" 2019-11-28T21:32:54.166 INFO:teuthology.orchestra.run.smithi074.stdout:VERSION="7 (Core)" 2019-11-28T21:32:54.166 INFO:teuthology.orchestra.run.smithi074.stdout:ID="centos" 2019-11-28T21:32:54.166 INFO:teuthology.orchestra.run.smithi074.stdout:ID_LIKE="rhel fedora" 2019-11-28T21:32:54.167 INFO:teuthology.orchestra.run.smithi074.stdout:VERSION_ID="7" 2019-11-28T21:32:54.167 INFO:teuthology.orchestra.run.smithi074.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-11-28T21:32:54.167 INFO:teuthology.orchestra.run.smithi074.stdout:ANSI_COLOR="0;31" 2019-11-28T21:32:54.167 INFO:teuthology.orchestra.run.smithi074.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-11-28T21:32:54.167 INFO:teuthology.orchestra.run.smithi074.stdout:HOME_URL="https://www.centos.org/" 2019-11-28T21:32:54.167 INFO:teuthology.orchestra.run.smithi074.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-11-28T21:32:54.167 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:32:54.168 INFO:teuthology.orchestra.run.smithi074.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-11-28T21:32:54.168 INFO:teuthology.orchestra.run.smithi074.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-11-28T21:32:54.168 INFO:teuthology.orchestra.run.smithi074.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-11-28T21:32:54.168 INFO:teuthology.orchestra.run.smithi074.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-11-28T21:32:54.168 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:32:54.169 INFO:teuthology.lock.ops:Updating smithi074.front.sepia.ceph.com on lock server 2019-11-28T21:32:54.186 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: set os type and version on server 2019-11-28T21:32:54.186 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T21:32:54.186 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi141.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:32:54.287 INFO:teuthology.orchestra.run.smithi141:> true 2019-11-28T21:32:54.690 INFO:teuthology.orchestra.run.smithi141:> uname -m 2019-11-28T21:32:54.752 INFO:teuthology.orchestra.run.smithi141.stdout:x86_64 2019-11-28T21:32:54.752 INFO:teuthology.orchestra.run.smithi141:> cat /etc/os-release 2019-11-28T21:32:54.806 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="CentOS Linux" 2019-11-28T21:32:54.806 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="7 (Core)" 2019-11-28T21:32:54.806 INFO:teuthology.orchestra.run.smithi141.stdout:ID="centos" 2019-11-28T21:32:54.806 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE="rhel fedora" 2019-11-28T21:32:54.806 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="7" 2019-11-28T21:32:54.807 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-11-28T21:32:54.807 INFO:teuthology.orchestra.run.smithi141.stdout:ANSI_COLOR="0;31" 2019-11-28T21:32:54.807 INFO:teuthology.orchestra.run.smithi141.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-11-28T21:32:54.807 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://www.centos.org/" 2019-11-28T21:32:54.807 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-11-28T21:32:54.807 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:32:54.807 INFO:teuthology.orchestra.run.smithi141.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-11-28T21:32:54.808 INFO:teuthology.orchestra.run.smithi141.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-11-28T21:32:54.808 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-11-28T21:32:54.808 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-11-28T21:32:54.808 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:32:54.815 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server 2019-11-28T21:32:54.828 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2019-11-28T21:32:54.858 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi074.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1WSZn/Y1eHFUHumqGDZdQthu+ATZh5fYN/ifDTtwoAHZAjmBkBfyl5lzV06QpXbMLYpEMRh2dj9Aor2nCBvJreXeyQSK9LGixONLe+BTMplNmLZ0+vFXgnoLWFyxn64/wy3NJkK7/6SWc48VUlfKYzJh7p3oVBo58AdI6W73E/pB7ThV8jNNt4WtVZZh0Ca0fHHRKRreXBYeZNV1tQ2NzyfQ/FoGJHNJ8YYiQj52zghQc1zZr0q4feAIOPRDgJTctAz1tq+Xftj1xDw4FujifZ0wEIiNN72jp3KiX3QT0x/xMN/GEAH/TamfKWFWr5845jtHroGJBIa7MrWsTGQEN smithi141.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD7plSsfAHElH2clej6mYVxUt6yu55nJ1sT5UdnIPATLleew5xxKNW/uxeAJaYhzo9QeNlWERp513knnVesSDHvX0pMP7n5BJ3aU3CfIaX2RF7vkE3DmDYtNWW/0DwbBKp9B8yjhiyfgsxAOFqhD6dZ4jqwtPX3K3P5H6HKNXIs07geJf1xU4ZKpnqpmprwtP6xEQIt//I9AYaDpA2dG+HwWP8EGJ21MKeIDQThnbdoVuVAcoYLGpeCgWkm7+tTD2c4tfMXr6Vf2opIMtKCEVyiVd4mKVLJx07U3Vrwrcv9EsLKmoRsCS3eQrEe30KleVJRHQiP0r19nJlz0Wbuf2xb 2019-11-28T21:32:54.859 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-11-28T21:32:54.898 INFO:teuthology.run_tasks:Running task internal.save_config... 2019-11-28T21:32:55.348 INFO:teuthology.task.internal:Saving configuration 2019-11-28T21:32:55.376 INFO:teuthology.run_tasks:Running task internal.check_lock... 2019-11-28T21:32:55.542 INFO:teuthology.task.internal.check_lock:Checking locks... 2019-11-28T21:32:55.556 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-11-28 21:27:58.194352', u'locked_by': u'scheduled_mkogan@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi074.front.sepia.ceph.com', u'os_version': u'7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDTrHQsSVZ4G0De9hCBYm5nUGFyKPWN3+Z3/nYJb1UqGnIAB5xv7E29KMrRFDCkNPG68aYX0Jx6ELEuQ+mnK9vA=', u'description': u'/home/teuthworker/archive/mkogan-2019-11-28_17:38:37-rgw:verify-wip-mkogan-testing-distro-basic-smithi/4550431'} 2019-11-28T21:32:55.571 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-11-28 21:27:58.194371', u'locked_by': u'scheduled_mkogan@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi141.front.sepia.ceph.com', u'os_version': u'7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCKgdtDdFveBeQDOxvA39DAvRSqO3nChC04UmKGPL9dkkCLi3DEnagAnjzBPjlZ//wTWjquIZJsLW/uXBb+dnzg=', u'description': u'/home/teuthworker/archive/mkogan-2019-11-28_17:38:37-rgw:verify-wip-mkogan-testing-distro-basic-smithi/4550431'} 2019-11-28T21:32:55.572 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2019-11-28T21:32:55.590 INFO:teuthology.task.internal:roles: ubuntu@smithi074.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2019-11-28T21:32:55.591 INFO:teuthology.task.internal:roles: ubuntu@smithi141.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2019-11-28T21:32:55.591 INFO:teuthology.run_tasks:Running task console_log... 2019-11-28T21:32:55.892 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2019-11-28T21:32:55.892 INFO:teuthology.run_tasks:Running task internal.connect... 2019-11-28T21:32:55.944 INFO:teuthology.task.internal:Opening connections... 2019-11-28T21:32:55.944 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi074.front.sepia.ceph.com 2019-11-28T21:32:55.945 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi074.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:32:56.054 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi141.front.sepia.ceph.com 2019-11-28T21:32:56.054 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi141.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:32:56.161 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2019-11-28T21:32:56.221 INFO:teuthology.orchestra.run.smithi074:> uname -m 2019-11-28T21:32:56.401 INFO:teuthology.orchestra.run.smithi074.stdout:x86_64 2019-11-28T21:32:56.402 INFO:teuthology.orchestra.run.smithi074:> cat /etc/os-release 2019-11-28T21:32:56.469 INFO:teuthology.orchestra.run.smithi074.stdout:NAME="CentOS Linux" 2019-11-28T21:32:56.470 INFO:teuthology.orchestra.run.smithi074.stdout:VERSION="7 (Core)" 2019-11-28T21:32:56.470 INFO:teuthology.orchestra.run.smithi074.stdout:ID="centos" 2019-11-28T21:32:56.470 INFO:teuthology.orchestra.run.smithi074.stdout:ID_LIKE="rhel fedora" 2019-11-28T21:32:56.471 INFO:teuthology.orchestra.run.smithi074.stdout:VERSION_ID="7" 2019-11-28T21:32:56.471 INFO:teuthology.orchestra.run.smithi074.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-11-28T21:32:56.471 INFO:teuthology.orchestra.run.smithi074.stdout:ANSI_COLOR="0;31" 2019-11-28T21:32:56.471 INFO:teuthology.orchestra.run.smithi074.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-11-28T21:32:56.471 INFO:teuthology.orchestra.run.smithi074.stdout:HOME_URL="https://www.centos.org/" 2019-11-28T21:32:56.472 INFO:teuthology.orchestra.run.smithi074.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-11-28T21:32:56.472 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:32:56.473 INFO:teuthology.orchestra.run.smithi074.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-11-28T21:32:56.473 INFO:teuthology.orchestra.run.smithi074.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-11-28T21:32:56.474 INFO:teuthology.orchestra.run.smithi074.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-11-28T21:32:56.474 INFO:teuthology.orchestra.run.smithi074.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-11-28T21:32:56.474 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:32:56.474 INFO:teuthology.lock.ops:Updating smithi074.front.sepia.ceph.com on lock server 2019-11-28T21:32:56.491 INFO:teuthology.orchestra.run.smithi141:> uname -m 2019-11-28T21:32:56.607 INFO:teuthology.orchestra.run.smithi141.stdout:x86_64 2019-11-28T21:32:56.607 INFO:teuthology.orchestra.run.smithi141:> cat /etc/os-release 2019-11-28T21:32:56.680 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="CentOS Linux" 2019-11-28T21:32:56.680 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="7 (Core)" 2019-11-28T21:32:56.680 INFO:teuthology.orchestra.run.smithi141.stdout:ID="centos" 2019-11-28T21:32:56.681 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE="rhel fedora" 2019-11-28T21:32:56.681 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="7" 2019-11-28T21:32:56.681 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-11-28T21:32:56.681 INFO:teuthology.orchestra.run.smithi141.stdout:ANSI_COLOR="0;31" 2019-11-28T21:32:56.681 INFO:teuthology.orchestra.run.smithi141.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-11-28T21:32:56.681 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://www.centos.org/" 2019-11-28T21:32:56.682 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-11-28T21:32:56.682 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:32:56.682 INFO:teuthology.orchestra.run.smithi141.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-11-28T21:32:56.682 INFO:teuthology.orchestra.run.smithi141.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-11-28T21:32:56.682 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-11-28T21:32:56.682 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-11-28T21:32:56.682 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:32:56.683 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server 2019-11-28T21:32:56.694 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2019-11-28T21:32:56.751 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2019-11-28T21:32:56.759 INFO:teuthology.task.internal:Checking for old test directory... 2019-11-28T21:32:56.760 INFO:teuthology.orchestra.run.smithi074:> test '!' -e /home/ubuntu/cephtest 2019-11-28T21:32:56.769 INFO:teuthology.orchestra.run.smithi141:> test '!' -e /home/ubuntu/cephtest 2019-11-28T21:32:56.854 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2019-11-28T21:32:56.866 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2019-11-28T21:32:56.867 INFO:teuthology.orchestra.run.smithi074:> test -z $(ls -A /var/lib/ceph) 2019-11-28T21:32:56.871 INFO:teuthology.orchestra.run.smithi141:> test -z $(ls -A /var/lib/ceph) 2019-11-28T21:32:56.974 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2019-11-28T21:32:57.086 INFO:teuthology.run_tasks:Running task kernel... 2019-11-28T21:32:57.225 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.c': {'sha1': 'distro', 'kdb': True}, 'client.0': {'sha1': 'distro', 'kdb': True}, 'osd.1': {'sha1': 'distro', 'kdb': True}, 'osd.0': {'sha1': 'distro', 'kdb': True}, 'osd.3': {'sha1': 'distro', 'kdb': True}, 'osd.2': {'sha1': 'distro', 'kdb': True}, 'osd.5': {'sha1': 'distro', 'kdb': True}, 'osd.4': {'sha1': 'distro', 'kdb': True}, 'osd.7': {'sha1': 'distro', 'kdb': True}, 'osd.6': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}, 'mgr.y': {'sha1': 'distro', 'kdb': True}, 'mgr.x': {'sha1': 'distro', 'kdb': True}, 'client.1': {'sha1': 'distro', 'kdb': True}} 2019-11-28T21:32:57.225 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}}, timeout 300 2019-11-28T21:32:57.225 INFO:teuthology.task.kernel:Removing old kernels from ubuntu@smithi074.front.sepia.ceph.com 2019-11-28T21:32:57.226 INFO:teuthology.orchestra.run.smithi074:> sudo package-cleanup -y --oldkernels 2019-11-28T21:32:58.122 INFO:teuthology.orchestra.run.smithi074.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:33:00.759 INFO:teuthology.orchestra.run.smithi074.stdout:No old kernels to remove 2019-11-28T21:33:00.794 INFO:teuthology.task.kernel:Removing old kernels from ubuntu@smithi141.front.sepia.ceph.com 2019-11-28T21:33:00.794 INFO:teuthology.orchestra.run.smithi141:> sudo package-cleanup -y --oldkernels 2019-11-28T21:33:01.725 INFO:teuthology.orchestra.run.smithi141.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:33:04.314 INFO:teuthology.orchestra.run.smithi141.stdout:No old kernels to remove 2019-11-28T21:33:04.334 INFO:teuthology.orchestra.run.smithi074:> uname -r 2019-11-28T21:33:04.431 INFO:teuthology.orchestra.run.smithi074.stdout:3.10.0-1062.4.1.el7.x86_64 2019-11-28T21:33:04.432 INFO:teuthology.task.kernel:Running kernel on smithi074: 3.10.0-1062.4.1.el7.x86_64 2019-11-28T21:33:04.432 INFO:teuthology.orchestra.run.smithi074:> sudo yum install -y kernel 2019-11-28T21:33:04.652 INFO:teuthology.orchestra.run.smithi074.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:33:04.690 INFO:teuthology.orchestra.run.smithi074.stdout:Determining fastest mirrors 2019-11-28T21:33:04.875 INFO:teuthology.orchestra.run.smithi074.stdout: * base: packages.oit.ncsu.edu 2019-11-28T21:33:04.875 INFO:teuthology.orchestra.run.smithi074.stdout: * epel: ftp.linux.ncsu.edu 2019-11-28T21:33:04.875 INFO:teuthology.orchestra.run.smithi074.stdout: * extras: mirror.ash.fastserv.com 2019-11-28T21:33:04.876 INFO:teuthology.orchestra.run.smithi074.stdout: * updates: mirror.jaleco.com 2019-11-28T21:33:06.960 INFO:teuthology.orchestra.run.smithi074.stdout:Resolving Dependencies 2019-11-28T21:33:06.960 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:33:06.961 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package kernel.x86_64 0:3.10.0-1062.4.3.el7 will be installed 2019-11-28T21:33:08.343 INFO:teuthology.orchestra.run.smithi074.stdout:--> Finished Dependency Resolution 2019-11-28T21:33:09.170 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:33:09.170 INFO:teuthology.orchestra.run.smithi074.stdout:Dependencies Resolved 2019-11-28T21:33:09.172 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:33:09.172 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:33:09.172 INFO:teuthology.orchestra.run.smithi074.stdout: Package Arch Version Repository Size 2019-11-28T21:33:09.172 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:33:09.173 INFO:teuthology.orchestra.run.smithi074.stdout:Installing: 2019-11-28T21:33:09.173 INFO:teuthology.orchestra.run.smithi074.stdout: kernel x86_64 3.10.0-1062.4.3.el7 updates 50 M 2019-11-28T21:33:09.173 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:33:09.173 INFO:teuthology.orchestra.run.smithi074.stdout:Transaction Summary 2019-11-28T21:33:09.173 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:33:09.173 INFO:teuthology.orchestra.run.smithi074.stdout:Install 1 Package 2019-11-28T21:33:09.173 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:33:09.174 INFO:teuthology.orchestra.run.smithi074.stdout:Total download size: 50 M 2019-11-28T21:33:09.174 INFO:teuthology.orchestra.run.smithi074.stdout:Installed size: 64 M 2019-11-28T21:33:09.174 INFO:teuthology.orchestra.run.smithi074.stdout:Downloading packages: 2019-11-28T21:33:09.188 INFO:teuthology.orchestra.run.smithi074.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-11-28T21:34:50.674 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction check 2019-11-28T21:34:50.865 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction test 2019-11-28T21:34:51.778 INFO:teuthology.orchestra.run.smithi074.stdout:Transaction test succeeded 2019-11-28T21:34:51.779 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction 2019-11-28T21:35:27.039 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : kernel-3.10.0-1062.4.3.el7.x86_64 1/1 2019-11-28T21:35:27.619 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : kernel-3.10.0-1062.4.3.el7.x86_64 1/1 2019-11-28T21:35:27.619 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:35:27.619 INFO:teuthology.orchestra.run.smithi074.stdout:Installed: 2019-11-28T21:35:27.620 INFO:teuthology.orchestra.run.smithi074.stdout: kernel.x86_64 0:3.10.0-1062.4.3.el7 2019-11-28T21:35:27.620 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:35:27.620 INFO:teuthology.orchestra.run.smithi074.stdout:Complete! 2019-11-28T21:35:27.675 INFO:teuthology.orchestra.run.smithi074:> rpm -q kernel --last | head -n 1 2019-11-28T21:35:28.056 INFO:teuthology.orchestra.run.smithi074.stdout:kernel-3.10.0-1062.4.3.el7.x86_64 Thu 28 Nov 2019 09:34:54 PM UTC 2019-11-28T21:35:28.060 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.4.3.el7.x86_64 2019-11-28T21:35:28.060 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 3.10.0-1062.4.1.el7.x86_64 Expected: 3.10.0-1062.4.3.el7.x86_64 2019-11-28T21:35:28.060 INFO:teuthology.orchestra.run.smithi141:> uname -r 2019-11-28T21:35:28.174 INFO:teuthology.orchestra.run.smithi141.stdout:3.10.0-1062.4.1.el7.x86_64 2019-11-28T21:35:28.174 INFO:teuthology.task.kernel:Running kernel on smithi141: 3.10.0-1062.4.1.el7.x86_64 2019-11-28T21:35:28.175 INFO:teuthology.orchestra.run.smithi141:> sudo yum install -y kernel 2019-11-28T21:35:28.423 INFO:teuthology.orchestra.run.smithi141.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:35:28.463 INFO:teuthology.orchestra.run.smithi141.stdout:Determining fastest mirrors 2019-11-28T21:35:28.658 INFO:teuthology.orchestra.run.smithi141.stdout: * base: packages.oit.ncsu.edu 2019-11-28T21:35:28.659 INFO:teuthology.orchestra.run.smithi141.stdout: * epel: ftp.linux.ncsu.edu 2019-11-28T21:35:28.660 INFO:teuthology.orchestra.run.smithi141.stdout: * extras: mirror.umd.edu 2019-11-28T21:35:28.660 INFO:teuthology.orchestra.run.smithi141.stdout: * updates: mirror.linux.duke.edu 2019-11-28T21:35:30.845 INFO:teuthology.orchestra.run.smithi141.stdout:Resolving Dependencies 2019-11-28T21:35:30.845 INFO:teuthology.orchestra.run.smithi141.stdout:--> Running transaction check 2019-11-28T21:35:30.845 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package kernel.x86_64 0:3.10.0-1062.4.3.el7 will be installed 2019-11-28T21:35:32.209 INFO:teuthology.orchestra.run.smithi141.stdout:--> Finished Dependency Resolution 2019-11-28T21:35:33.085 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:35:33.085 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies Resolved 2019-11-28T21:35:33.095 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:35:33.096 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:35:33.096 INFO:teuthology.orchestra.run.smithi141.stdout: Package Arch Version Repository Size 2019-11-28T21:35:33.096 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:35:33.096 INFO:teuthology.orchestra.run.smithi141.stdout:Installing: 2019-11-28T21:35:33.096 INFO:teuthology.orchestra.run.smithi141.stdout: kernel x86_64 3.10.0-1062.4.3.el7 updates 50 M 2019-11-28T21:35:33.096 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:35:33.097 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction Summary 2019-11-28T21:35:33.097 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:35:33.097 INFO:teuthology.orchestra.run.smithi141.stdout:Install 1 Package 2019-11-28T21:35:33.097 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:35:33.097 INFO:teuthology.orchestra.run.smithi141.stdout:Total download size: 50 M 2019-11-28T21:35:33.097 INFO:teuthology.orchestra.run.smithi141.stdout:Installed size: 64 M 2019-11-28T21:35:33.097 INFO:teuthology.orchestra.run.smithi141.stdout:Downloading packages: 2019-11-28T21:35:33.101 INFO:teuthology.orchestra.run.smithi141.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-11-28T21:35:34.200 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction check 2019-11-28T21:35:34.402 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction test 2019-11-28T21:35:35.328 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction test succeeded 2019-11-28T21:35:35.328 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction 2019-11-28T21:36:10.171 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : kernel-3.10.0-1062.4.3.el7.x86_64 1/1 2019-11-28T21:36:10.664 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : kernel-3.10.0-1062.4.3.el7.x86_64 1/1 2019-11-28T21:36:10.664 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:36:10.664 INFO:teuthology.orchestra.run.smithi141.stdout:Installed: 2019-11-28T21:36:10.665 INFO:teuthology.orchestra.run.smithi141.stdout: kernel.x86_64 0:3.10.0-1062.4.3.el7 2019-11-28T21:36:10.665 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:36:10.665 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2019-11-28T21:36:10.716 INFO:teuthology.orchestra.run.smithi141:> rpm -q kernel --last | head -n 1 2019-11-28T21:36:11.038 INFO:teuthology.orchestra.run.smithi141.stdout:kernel-3.10.0-1062.4.3.el7.x86_64 Thu 28 Nov 2019 09:35:38 PM UTC 2019-11-28T21:36:11.042 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.4.3.el7.x86_64 2019-11-28T21:36:11.042 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 3.10.0-1062.4.1.el7.x86_64 Expected: 3.10.0-1062.4.3.el7.x86_64 2019-11-28T21:36:11.042 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2019-11-28T21:36:11.042 DEBUG:teuthology.task.kernel:src is distro, skipping download 2019-11-28T21:36:11.042 DEBUG:teuthology.task.kernel:src is distro, skipping download 2019-11-28T21:36:11.043 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2019-11-28T21:36:11.043 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi074.front.sepia.ceph.com, path=None, version=distro) 2019-11-28T21:36:11.043 INFO:teuthology.orchestra.run.smithi074:> rpm -q kernel --last | head -n 1 2019-11-28T21:36:11.410 INFO:teuthology.orchestra.run.smithi074.stdout:kernel-3.10.0-1062.4.3.el7.x86_64 Thu 28 Nov 2019 09:34:54 PM UTC 2019-11-28T21:36:11.412 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.4.3.el7.x86_64 2019-11-28T21:36:11.412 INFO:teuthology.orchestra.run.smithi074:> sudo rpm -qi grub2 2019-11-28T21:36:11.546 INFO:teuthology.orchestra.run.smithi074.stdout:Name : grub2 2019-11-28T21:36:11.546 INFO:teuthology.orchestra.run.smithi074.stdout:Epoch : 1 2019-11-28T21:36:11.546 INFO:teuthology.orchestra.run.smithi074.stdout:Version : 2.02 2019-11-28T21:36:11.546 INFO:teuthology.orchestra.run.smithi074.stdout:Release : 0.76.el7.centos 2019-11-28T21:36:11.546 INFO:teuthology.orchestra.run.smithi074.stdout:Architecture: x86_64 2019-11-28T21:36:11.546 INFO:teuthology.orchestra.run.smithi074.stdout:Install Date: Tue 05 Nov 2019 03:41:14 PM UTC 2019-11-28T21:36:11.547 INFO:teuthology.orchestra.run.smithi074.stdout:Group : System Environment/Base 2019-11-28T21:36:11.547 INFO:teuthology.orchestra.run.smithi074.stdout:Size : 0 2019-11-28T21:36:11.547 INFO:teuthology.orchestra.run.smithi074.stdout:License : GPLv3+ 2019-11-28T21:36:11.547 INFO:teuthology.orchestra.run.smithi074.stdout:Signature : RSA/SHA256, Mon 12 Nov 2018 02:28:06 PM UTC, Key ID 24c6a8a7f4a80eb5 2019-11-28T21:36:11.547 INFO:teuthology.orchestra.run.smithi074.stdout:Source RPM : grub2-2.02-0.76.el7.centos.src.rpm 2019-11-28T21:36:11.547 INFO:teuthology.orchestra.run.smithi074.stdout:Build Date : Fri 09 Nov 2018 12:58:43 AM UTC 2019-11-28T21:36:11.548 INFO:teuthology.orchestra.run.smithi074.stdout:Build Host : kbuilder.bsys.centos.org 2019-11-28T21:36:11.548 INFO:teuthology.orchestra.run.smithi074.stdout:Relocations : (not relocatable) 2019-11-28T21:36:11.548 INFO:teuthology.orchestra.run.smithi074.stdout:Packager : CentOS BuildSystem 2019-11-28T21:36:11.548 INFO:teuthology.orchestra.run.smithi074.stdout:Vendor : CentOS 2019-11-28T21:36:11.548 INFO:teuthology.orchestra.run.smithi074.stdout:URL : http://www.gnu.org/software/grub/ 2019-11-28T21:36:11.548 INFO:teuthology.orchestra.run.smithi074.stdout:Summary : Bootloader with support for Linux, Multiboot and more 2019-11-28T21:36:11.548 INFO:teuthology.orchestra.run.smithi074.stdout:Description : 2019-11-28T21:36:11.548 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:36:11.549 INFO:teuthology.orchestra.run.smithi074.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2019-11-28T21:36:11.549 INFO:teuthology.orchestra.run.smithi074.stdout:customizable bootloader with modular architecture. It supports a rich 2019-11-28T21:36:11.549 INFO:teuthology.orchestra.run.smithi074.stdout:variety of kernel formats, file systems, computer architectures and 2019-11-28T21:36:11.549 INFO:teuthology.orchestra.run.smithi074.stdout:hardware devices. 2019-11-28T21:36:11.550 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2019-11-28T21:36:11.550 INFO:teuthology.task.kernel:Updating grub on smithi074 to boot 3.10.0-1062.4.3.el7.x86_64 2019-11-28T21:36:11.550 INFO:teuthology.orchestra.run.smithi074:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2019-11-28T21:36:11.984 INFO:teuthology.orchestra.run.smithi074.stderr:Generating grub configuration file ... 2019-11-28T21:36:12.105 INFO:teuthology.orchestra.run.smithi074.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.3.el7.x86_64 2019-11-28T21:36:12.120 INFO:teuthology.orchestra.run.smithi074.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.3.el7.x86_64.img 2019-11-28T21:36:12.387 INFO:teuthology.orchestra.run.smithi074.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.1.el7.x86_64 2019-11-28T21:36:12.437 INFO:teuthology.orchestra.run.smithi074.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.1.el7.x86_64.img 2019-11-28T21:36:12.490 INFO:teuthology.orchestra.run.smithi074.stderr:Found linux image: /boot/vmlinuz-3.10.0-957.el7.x86_64 2019-11-28T21:36:12.514 INFO:teuthology.orchestra.run.smithi074.stderr:Found initrd image: /boot/initramfs-3.10.0-957.el7.x86_64.img 2019-11-28T21:36:12.552 INFO:teuthology.orchestra.run.smithi074.stderr:Found linux image: /boot/vmlinuz-0-rescue-a1739c9c60b14f0891126d2e603bb003 2019-11-28T21:36:12.564 INFO:teuthology.orchestra.run.smithi074.stderr:Found initrd image: /boot/initramfs-0-rescue-a1739c9c60b14f0891126d2e603bb003.img 2019-11-28T21:36:13.466 INFO:teuthology.orchestra.run.smithi074.stderr:done 2019-11-28T21:36:13.468 INFO:teuthology.orchestra.run.smithi074:> mktemp 2019-11-28T21:36:13.532 INFO:teuthology.orchestra.run.smithi074.stdout:/tmp/tmp.J16Stoetl1 2019-11-28T21:36:13.533 INFO:teuthology.orchestra.run.smithi074:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.J16Stoetl1 2019-11-28T21:36:13.605 INFO:teuthology.orchestra.run.smithi074:> sudo chmod 0666 /tmp/tmp.J16Stoetl1 2019-11-28T21:36:13.794 DEBUG:teuthology.orchestra.remote:smithi074:/tmp/tmp.J16Stoetl1 is 6KB 2019-11-28T21:36:13.880 INFO:teuthology.orchestra.run.smithi074:> rm -fr /tmp/tmp.J16Stoetl1 2019-11-28T21:36:13.964 INFO:teuthology.orchestra.run.smithi074:> sudo grub2-set-default 0 2019-11-28T21:36:14.164 INFO:teuthology.orchestra.run.smithi074:> sudo shutdown -r now 2019-11-28T21:36:14.169 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2019-11-28T21:36:14.169 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi141.front.sepia.ceph.com, path=None, version=distro) 2019-11-28T21:36:14.169 INFO:teuthology.orchestra.run.smithi141:> rpm -q kernel --last | head -n 1 2019-11-28T21:36:14.533 INFO:teuthology.orchestra.run.smithi141.stdout:kernel-3.10.0-1062.4.3.el7.x86_64 Thu 28 Nov 2019 09:35:38 PM UTC 2019-11-28T21:36:14.535 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.4.3.el7.x86_64 2019-11-28T21:36:14.535 INFO:teuthology.orchestra.run.smithi141:> sudo rpm -qi grub2 2019-11-28T21:36:14.653 INFO:teuthology.orchestra.run.smithi141.stdout:Name : grub2 2019-11-28T21:36:14.654 INFO:teuthology.orchestra.run.smithi141.stdout:Epoch : 1 2019-11-28T21:36:14.654 INFO:teuthology.orchestra.run.smithi141.stdout:Version : 2.02 2019-11-28T21:36:14.654 INFO:teuthology.orchestra.run.smithi141.stdout:Release : 0.76.el7.centos 2019-11-28T21:36:14.654 INFO:teuthology.orchestra.run.smithi141.stdout:Architecture: x86_64 2019-11-28T21:36:14.654 INFO:teuthology.orchestra.run.smithi141.stdout:Install Date: Tue 05 Nov 2019 03:41:14 PM UTC 2019-11-28T21:36:14.654 INFO:teuthology.orchestra.run.smithi141.stdout:Group : System Environment/Base 2019-11-28T21:36:14.655 INFO:teuthology.orchestra.run.smithi141.stdout:Size : 0 2019-11-28T21:36:14.655 INFO:teuthology.orchestra.run.smithi141.stdout:License : GPLv3+ 2019-11-28T21:36:14.655 INFO:teuthology.orchestra.run.smithi141.stdout:Signature : RSA/SHA256, Mon 12 Nov 2018 02:28:06 PM UTC, Key ID 24c6a8a7f4a80eb5 2019-11-28T21:36:14.655 INFO:teuthology.orchestra.run.smithi141.stdout:Source RPM : grub2-2.02-0.76.el7.centos.src.rpm 2019-11-28T21:36:14.655 INFO:teuthology.orchestra.run.smithi141.stdout:Build Date : Fri 09 Nov 2018 12:58:43 AM UTC 2019-11-28T21:36:14.655 INFO:teuthology.orchestra.run.smithi141.stdout:Build Host : kbuilder.bsys.centos.org 2019-11-28T21:36:14.656 INFO:teuthology.orchestra.run.smithi141.stdout:Relocations : (not relocatable) 2019-11-28T21:36:14.656 INFO:teuthology.orchestra.run.smithi141.stdout:Packager : CentOS BuildSystem 2019-11-28T21:36:14.656 INFO:teuthology.orchestra.run.smithi141.stdout:Vendor : CentOS 2019-11-28T21:36:14.656 INFO:teuthology.orchestra.run.smithi141.stdout:URL : http://www.gnu.org/software/grub/ 2019-11-28T21:36:14.656 INFO:teuthology.orchestra.run.smithi141.stdout:Summary : Bootloader with support for Linux, Multiboot and more 2019-11-28T21:36:14.656 INFO:teuthology.orchestra.run.smithi141.stdout:Description : 2019-11-28T21:36:14.657 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:36:14.657 INFO:teuthology.orchestra.run.smithi141.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2019-11-28T21:36:14.657 INFO:teuthology.orchestra.run.smithi141.stdout:customizable bootloader with modular architecture. It supports a rich 2019-11-28T21:36:14.657 INFO:teuthology.orchestra.run.smithi141.stdout:variety of kernel formats, file systems, computer architectures and 2019-11-28T21:36:14.657 INFO:teuthology.orchestra.run.smithi141.stdout:hardware devices. 2019-11-28T21:36:14.658 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2019-11-28T21:36:14.658 INFO:teuthology.task.kernel:Updating grub on smithi141 to boot 3.10.0-1062.4.3.el7.x86_64 2019-11-28T21:36:14.659 INFO:teuthology.orchestra.run.smithi141:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2019-11-28T21:36:15.137 INFO:teuthology.orchestra.run.smithi141.stderr:Generating grub configuration file ... 2019-11-28T21:36:15.281 INFO:teuthology.orchestra.run.smithi141.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.3.el7.x86_64 2019-11-28T21:36:15.296 INFO:teuthology.orchestra.run.smithi141.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.3.el7.x86_64.img 2019-11-28T21:36:15.527 INFO:teuthology.orchestra.run.smithi141.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.1.el7.x86_64 2019-11-28T21:36:15.547 INFO:teuthology.orchestra.run.smithi141.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.1.el7.x86_64.img 2019-11-28T21:36:15.578 INFO:teuthology.orchestra.run.smithi141.stderr:Found linux image: /boot/vmlinuz-3.10.0-957.el7.x86_64 2019-11-28T21:36:15.598 INFO:teuthology.orchestra.run.smithi141.stderr:Found initrd image: /boot/initramfs-3.10.0-957.el7.x86_64.img 2019-11-28T21:36:15.623 INFO:teuthology.orchestra.run.smithi141.stderr:Found linux image: /boot/vmlinuz-0-rescue-a1739c9c60b14f0891126d2e603bb003 2019-11-28T21:36:15.632 INFO:teuthology.orchestra.run.smithi141.stderr:Found initrd image: /boot/initramfs-0-rescue-a1739c9c60b14f0891126d2e603bb003.img 2019-11-28T21:36:16.561 INFO:teuthology.orchestra.run.smithi141.stderr:done 2019-11-28T21:36:16.564 INFO:teuthology.orchestra.run.smithi141:> mktemp 2019-11-28T21:36:16.624 INFO:teuthology.orchestra.run.smithi141.stdout:/tmp/tmp.9Fb8vaifk7 2019-11-28T21:36:16.625 INFO:teuthology.orchestra.run.smithi141:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.9Fb8vaifk7 2019-11-28T21:36:16.697 INFO:teuthology.orchestra.run.smithi141:> sudo chmod 0666 /tmp/tmp.9Fb8vaifk7 2019-11-28T21:36:16.817 DEBUG:teuthology.orchestra.remote:smithi141:/tmp/tmp.9Fb8vaifk7 is 6KB 2019-11-28T21:36:16.872 INFO:teuthology.orchestra.run.smithi141:> rm -fr /tmp/tmp.9Fb8vaifk7 2019-11-28T21:36:16.922 INFO:teuthology.orchestra.run.smithi141:> sudo grub2-set-default 0 2019-11-28T21:36:17.171 INFO:teuthology.orchestra.run.smithi141:> sudo shutdown -r now 2019-11-28T21:36:17.176 INFO:teuthology.misc:Re-opening connections... 2019-11-28T21:36:17.176 INFO:teuthology.misc:trying to connect to ubuntu@smithi074.front.sepia.ceph.com 2019-11-28T21:36:17.176 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T21:36:17.176 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi074.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:37:17.177 DEBUG:teuthology.orchestra.remote:timed out 2019-11-28T21:37:17.178 INFO:teuthology.misc:trying to connect to ubuntu@smithi141.front.sepia.ceph.com 2019-11-28T21:37:17.178 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T21:37:17.178 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi141.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:38:17.184 DEBUG:teuthology.orchestra.remote:timed out 2019-11-28T21:38:17.185 DEBUG:teuthology.misc:waited 120.008934021 2019-11-28T21:38:18.185 INFO:teuthology.misc:trying to connect to ubuntu@smithi074.front.sepia.ceph.com 2019-11-28T21:38:18.186 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T21:38:18.186 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi074.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:38:18.288 INFO:teuthology.orchestra.run.smithi074:> true 2019-11-28T21:38:18.757 DEBUG:teuthology.misc:waited 121.581626892 2019-11-28T21:38:19.758 INFO:teuthology.misc:trying to connect to ubuntu@smithi141.front.sepia.ceph.com 2019-11-28T21:38:19.758 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T21:38:19.759 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi141.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:38:19.897 INFO:teuthology.orchestra.run.smithi141:> true 2019-11-28T21:38:20.334 DEBUG:teuthology.misc:waited 123.158246994 2019-11-28T21:38:21.334 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2019-11-28T21:38:21.335 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "3.10.0-1062.4.3.el7.x86_64"... 2019-11-28T21:38:21.335 INFO:teuthology.orchestra.run.smithi074:> uname -r 2019-11-28T21:38:21.438 INFO:teuthology.orchestra.run.smithi074.stdout:3.10.0-1062.4.3.el7.x86_64 2019-11-28T21:38:21.438 DEBUG:teuthology.task.kernel:current kernel version is 3.10.0-1062.4.3.el7.x86_64 2019-11-28T21:38:21.439 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2019-11-28T21:38:21.439 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2019-11-28T21:38:21.439 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "3.10.0-1062.4.3.el7.x86_64"... 2019-11-28T21:38:21.439 INFO:teuthology.orchestra.run.smithi141:> uname -r 2019-11-28T21:38:21.558 INFO:teuthology.orchestra.run.smithi141.stdout:3.10.0-1062.4.3.el7.x86_64 2019-11-28T21:38:21.559 DEBUG:teuthology.task.kernel:current kernel version is 3.10.0-1062.4.3.el7.x86_64 2019-11-28T21:38:21.559 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2019-11-28T21:38:22.560 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2019-11-28T21:38:22.560 INFO:teuthology.orchestra.run.smithi074:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2019-11-28T21:38:22.705 INFO:teuthology.orchestra.run.smithi074.stdout:ttyS1 2019-11-28T21:38:22.722 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2019-11-28T21:38:22.722 INFO:teuthology.orchestra.run.smithi141:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2019-11-28T21:38:22.889 INFO:teuthology.orchestra.run.smithi141.stdout:ttyS1 2019-11-28T21:38:22.900 INFO:teuthology.run_tasks:Running task internal.base... 2019-11-28T21:38:22.915 INFO:teuthology.task.internal:Creating test directory... 2019-11-28T21:38:22.915 INFO:teuthology.orchestra.run.smithi074:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2019-11-28T21:38:22.921 INFO:teuthology.orchestra.run.smithi141:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2019-11-28T21:38:23.008 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2019-11-28T21:38:23.025 INFO:teuthology.run_tasks:Running task internal.archive... 2019-11-28T21:38:23.038 INFO:teuthology.task.internal:Creating archive directory... 2019-11-28T21:38:23.038 INFO:teuthology.orchestra.run.smithi074:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2019-11-28T21:38:23.043 INFO:teuthology.orchestra.run.smithi141:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2019-11-28T21:38:23.142 INFO:teuthology.run_tasks:Running task internal.coredump... 2019-11-28T21:38:23.159 INFO:teuthology.task.internal:Enabling coredump saving... 2019-11-28T21:38:23.159 INFO:teuthology.orchestra.run.smithi074:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-11-28T21:38:23.164 INFO:teuthology.orchestra.run.smithi141:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-11-28T21:38:23.270 INFO:teuthology.orchestra.run.smithi074.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-11-28T21:38:23.285 INFO:teuthology.orchestra.run.smithi141.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-11-28T21:38:23.288 INFO:teuthology.run_tasks:Running task internal.sudo... 2019-11-28T21:38:23.303 INFO:teuthology.task.internal:Configuring sudo... 2019-11-28T21:38:23.303 INFO:teuthology.orchestra.run.smithi074:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2019-11-28T21:38:23.308 INFO:teuthology.orchestra.run.smithi141:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2019-11-28T21:38:23.416 INFO:teuthology.run_tasks:Running task internal.syslog... 2019-11-28T21:38:23.432 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2019-11-28T21:38:23.432 INFO:teuthology.orchestra.run.smithi074:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2019-11-28T21:38:23.437 INFO:teuthology.orchestra.run.smithi141:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2019-11-28T21:38:23.526 INFO:teuthology.orchestra.run.smithi074:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2019-11-28T21:38:23.635 INFO:teuthology.orchestra.run.smithi074:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2019-11-28T21:38:23.751 INFO:teuthology.orchestra.run.smithi074:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2019-11-28T21:38:23.841 INFO:teuthology.orchestra.run.smithi074:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2019-11-28T21:38:23.945 INFO:teuthology.orchestra.run.smithi074:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2019-11-28T21:38:24.052 INFO:teuthology.orchestra.run.smithi141:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2019-11-28T21:38:24.163 INFO:teuthology.orchestra.run.smithi141:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2019-11-28T21:38:24.298 INFO:teuthology.orchestra.run.smithi141:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2019-11-28T21:38:24.397 INFO:teuthology.orchestra.run.smithi141:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2019-11-28T21:38:24.494 INFO:teuthology.orchestra.run.smithi141:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2019-11-28T21:38:24.588 INFO:teuthology.orchestra.run.smithi074:> sudo service rsyslog restart 2019-11-28T21:38:24.593 INFO:teuthology.orchestra.run.smithi141:> sudo service rsyslog restart 2019-11-28T21:38:24.725 INFO:teuthology.orchestra.run.smithi141.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2019-11-28T21:38:24.740 INFO:teuthology.orchestra.run.smithi074.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2019-11-28T21:38:24.815 INFO:teuthology.run_tasks:Running task internal.timer... 2019-11-28T21:38:24.834 INFO:teuthology.task.internal:Starting timer... 2019-11-28T21:38:24.834 INFO:teuthology.run_tasks:Running task pcp... 2019-11-28T21:38:24.867 INFO:teuthology.run_tasks:Running task selinux... 2019-11-28T21:38:24.884 INFO:teuthology.orchestra.run.smithi074:> sudo service auditd rotate 2019-11-28T21:38:25.059 INFO:teuthology.orchestra.run.smithi074.stdout:Rotating logs: [ OK ] 2019-11-28T21:38:25.062 INFO:teuthology.orchestra.run.smithi141:> sudo service auditd rotate 2019-11-28T21:38:25.230 INFO:teuthology.orchestra.run.smithi141.stdout:Rotating logs: [ OK ] 2019-11-28T21:38:25.234 DEBUG:teuthology.task.selinux:Getting current SELinux state 2019-11-28T21:38:25.234 INFO:teuthology.orchestra.run.smithi074:> /usr/sbin/getenforce 2019-11-28T21:38:25.335 INFO:teuthology.orchestra.run.smithi074.stdout:Permissive 2019-11-28T21:38:25.335 INFO:teuthology.orchestra.run.smithi141:> /usr/sbin/getenforce 2019-11-28T21:38:25.434 INFO:teuthology.orchestra.run.smithi141.stdout:Permissive 2019-11-28T21:38:25.434 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi141.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi074.front.sepia.ceph.com': 'permissive'} 2019-11-28T21:38:25.435 INFO:teuthology.orchestra.run.smithi074:> sudo grep 'avc: .*denied' /var/log/audit/audit.log | grep -v '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\)' 2019-11-28T21:38:25.551 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-11-28T21:38:25.551 INFO:teuthology.orchestra.run.smithi141:> sudo grep 'avc: .*denied' /var/log/audit/audit.log | grep -v '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\)' 2019-11-28T21:38:25.672 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-11-28T21:38:25.672 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2019-11-28T21:38:25.672 INFO:teuthology.orchestra.run.smithi074:> sudo /usr/sbin/setenforce permissive 2019-11-28T21:38:25.794 INFO:teuthology.orchestra.run.smithi141:> sudo /usr/sbin/setenforce permissive 2019-11-28T21:38:25.919 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2019-11-28T21:38:25.938 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2019-11-28T21:38:25.966 INFO:teuthology.repo_utils:Fetching master from origin 2019-11-28T21:38:26.052 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2019-11-28T21:38:26.088 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2019-11-28T21:38:26.090 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi074.front.sepia.ceph.com,smithi141.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2019-11-28T21:38:26.491 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2019-11-28T21:38:30.225 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2019-11-28T21:38:30.248 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:38:30 +0000 (0:00:00.064) 0:00:00.064 ***** 2019-11-28T21:38:30.260 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:38:30 +0000 (0:00:00.011) 0:00:00.076 ***** 2019-11-28T21:38:33.481 INFO:teuthology.task.ansible.out: 2019-11-28T21:38:33.483 INFO:teuthology.task.ansible.out:TASK [Gathering Facts] ********************************************************* ok: [smithi141.front.sepia.ceph.com] 2019-11-28T21:38:33.497 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] 2019-11-28T21:38:33.623 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:38:33 +0000 (0:00:03.358) 0:00:03.435 ***** 2019-11-28T21:38:33.652 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:38:33 +0000 (0:00:00.033) 0:00:03.468 ***** 2019-11-28T21:38:34.110 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2019-11-28T21:38:34.111 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-11-28T21:38:34.113 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-11-28T21:38:34.147 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:38:34 +0000 (0:00:00.494) 0:00:03.963 ***** 2019-11-28T21:38:34.179 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:38:34 +0000 (0:00:00.031) 0:00:03.995 ***** 2019-11-28T21:38:34.747 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2019-11-28T21:38:34.749 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2019-11-28T21:38:34.750 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2019-11-28T21:38:34.788 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:38:34 +0000 (0:00:00.609) 0:00:04.604 ***** 2019-11-28T21:38:34.819 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:38:34 +0000 (0:00:00.031) 0:00:04.635 ***** 2019-11-28T21:38:34.823 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2019-11-28T21:38:34.825 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:38:34.871 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:38:34 +0000 (0:00:00.039) 0:00:04.675 ***** skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:38:34.903 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:38:34 +0000 (0:00:00.044) 0:00:04.720 ***** 2019-11-28T21:38:35.260 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2019-11-28T21:38:35.260 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-28T21:38:35.297 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:38:35 +0000 (0:00:00.394) 0:00:05.114 ***** 2019-11-28T21:38:35.325 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-28T21:38:35.362 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:38:35 +0000 (0:00:00.064) 0:00:05.178 ***** 2019-11-28T21:38:36.726 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2019-11-28T21:38:36.726 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574977115.38-279348056257682/source", "state": "file", "uid": 0} 2019-11-28T21:38:36.764 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:38:36 +0000 (0:00:01.401) 0:00:06.580 ***** 2019-11-28T21:38:36.788 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574977115.31-36485373933933/source", "state": "file", "uid": 0} 2019-11-28T21:38:36.816 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:38:36 +0000 (0:00:00.052) 0:00:06.632 ***** 2019-11-28T21:38:37.301 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2019-11-28T21:38:37.303 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-28T21:38:37.335 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-28T21:38:37.627 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-28T21:38:37.638 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-28T21:38:37.918 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-28T21:38:37.983 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-28T21:38:38.255 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-28T21:38:38.348 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-28T21:38:38.568 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-28T21:38:38.672 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-28T21:38:38.919 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-28T21:38:38.982 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-28T21:38:39.189 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-28T21:38:39.282 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-28T21:38:39.385 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2019-11-28T21:38:39.392 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2019-11-28T21:38:39.585 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:38:39 +0000 (0:00:02.769) 0:00:09.402 ***** 2019-11-28T21:38:39.617 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:38:39 +0000 (0:00:00.031) 0:00:09.433 ***** 2019-11-28T21:38:40.466 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi074.front.sepia.ceph.com] 2019-11-28T21:38:40.565 INFO:teuthology.task.ansible.out: [WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. Thursday 28 November 2019 21:38:40 +0000 (0:00:00.943) 0:00:10.377 ***** 2019-11-28T21:38:40.574 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] 2019-11-28T21:38:40.653 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:38:40 +0000 (0:00:00.092) 0:00:10.469 ***** 2019-11-28T21:38:41.090 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2019-11-28T21:38:41.091 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.223288", "end": "2019-11-28 21:38:41.064852", "rc": 0, "start": "2019-11-28 21:38:40.841564", "stderr": "", "stderr_lines": [], "stdout": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "stdout_lines": ["4334b3798f2061758a627b6bdd54d0cd6b822faa"]} 2019-11-28T21:38:41.131 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:38:41 +0000 (0:00:00.478) 0:00:10.947 ***** 2019-11-28T21:38:41.139 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.255258", "end": "2019-11-28 21:38:41.094416", "rc": 0, "start": "2019-11-28 21:38:40.839158", "stderr": "", "stderr_lines": [], "stdout": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "stdout_lines": ["4334b3798f2061758a627b6bdd54d0cd6b822faa"]} 2019-11-28T21:38:41.188 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:38:41 +0000 (0:00:00.056) 0:00:11.004 ***** 2019-11-28T21:38:41.189 INFO:teuthology.task.ansible.out: 2019-11-28T21:38:41.455 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [smithi074.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.013883", "end": "2019-11-28 21:38:41.424883", "failed_when_result": false, "rc": 0, "start": "2019-11-28 21:38:41.411000", "stderr": "", "stderr_lines": [], "stdout": "7b088106a1031364e6869fc2888a0e2542579008", "stdout_lines": ["7b088106a1031364e6869fc2888a0e2542579008"]} 2019-11-28T21:38:41.494 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:38:41 +0000 (0:00:00.306) 0:00:11.310 ***** 2019-11-28T21:38:41.521 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2019-11-28T21:38:41.523 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:38:41.575 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:38:41 +0000 (0:00:00.080) 0:00:11.391 ***** 2019-11-28T21:38:41.581 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2019-11-28T21:38:41.582 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.016624", "end": "2019-11-28 21:38:41.510428", "failed_when_result": false, "rc": 0, "start": "2019-11-28 21:38:41.493804", "stderr": "", "stderr_lines": [], "stdout": "7b088106a1031364e6869fc2888a0e2542579008", "stdout_lines": ["7b088106a1031364e6869fc2888a0e2542579008"]} 2019-11-28T21:38:41.621 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:38:41 +0000 (0:00:00.046) 0:00:11.437 ***** 2019-11-28T21:38:41.627 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2019-11-28T21:38:41.628 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:38:41.670 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:38:41 +0000 (0:00:00.048) 0:00:11.486 ***** 2019-11-28T21:38:41.675 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2019-11-28T21:38:41.677 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:38:41.719 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:38:41 +0000 (0:00:00.049) 0:00:11.536 ***** 2019-11-28T21:38:41.725 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2019-11-28T21:38:41.731 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:38:41.768 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:38:41 +0000 (0:00:00.048) 0:00:11.584 ***** 2019-11-28T21:38:41.773 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2019-11-28T21:38:41.774 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:38:41.813 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:38:41 +0000 (0:00:00.045) 0:00:11.629 ***** 2019-11-28T21:38:41.820 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:38:41.859 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:38:41 +0000 (0:00:00.045) 0:00:11.675 ***** 2019-11-28T21:38:41.865 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2019-11-28T21:38:41.867 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:38:41.902 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:38:41 +0000 (0:00:00.043) 0:00:11.718 ***** 2019-11-28T21:38:41.907 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2019-11-28T21:38:41.907 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:38:41.944 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:38:41 +0000 (0:00:00.041) 0:00:11.760 ***** 2019-11-28T21:38:41.950 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2019-11-28T21:38:41.952 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:38:41.996 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:38:41 +0000 (0:00:00.051) 0:00:11.812 ***** 2019-11-28T21:38:42.026 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:38:42.064 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:38:42 +0000 (0:00:00.068) 0:00:11.880 ***** 2019-11-28T21:38:42.291 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2019-11-28T21:38:42.292 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-28T21:38:42.336 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:38:42 +0000 (0:00:00.267) 0:00:12.148 ***** 2019-11-28T21:38:42.400 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-28T21:38:42.438 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:38:42 +0000 (0:00:00.105) 0:00:12.254 ***** 2019-11-28T21:38:42.704 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2019-11-28T21:38:42.798 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2019-11-28T21:38:43.033 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2019-11-28T21:38:43.160 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2019-11-28T21:38:43.376 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2019-11-28T21:38:43.483 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2019-11-28T21:38:43.674 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/adeza", "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "move_home": false, "name": "adeza", "shell": "/bin/bash", "state": "present", "uid": 1104} 2019-11-28T21:38:43.810 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/adeza", "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "move_home": false, "name": "adeza", "shell": "/bin/bash", "state": "present", "uid": 1104} 2019-11-28T21:38:44.008 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2019-11-28T21:38:44.165 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2019-11-28T21:38:44.364 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2019-11-28T21:38:44.512 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2019-11-28T21:38:44.710 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2019-11-28T21:38:44.836 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2019-11-28T21:38:45.064 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2019-11-28T21:38:45.148 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2019-11-28T21:38:45.427 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2019-11-28T21:38:45.461 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2019-11-28T21:38:45.763 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2019-11-28T21:38:45.807 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2019-11-28T21:38:46.100 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2019-11-28T21:38:46.153 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2019-11-28T21:38:46.430 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2019-11-28T21:38:46.473 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2019-11-28T21:38:46.784 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/sbillah", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "move_home": false, "name": "sbillah", "shell": "/bin/bash", "state": "present", "uid": 1113} 2019-11-28T21:38:46.817 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/sbillah", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "move_home": false, "name": "sbillah", "shell": "/bin/bash", "state": "present", "uid": 1113} 2019-11-28T21:38:47.089 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1114} 2019-11-28T21:38:47.142 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1114} 2019-11-28T21:38:47.426 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1115} 2019-11-28T21:38:47.490 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1115} 2019-11-28T21:38:47.780 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1116} 2019-11-28T21:38:47.823 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1116} 2019-11-28T21:38:48.122 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1117} 2019-11-28T21:38:48.155 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1117} 2019-11-28T21:38:48.441 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1118} 2019-11-28T21:38:48.483 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1118} 2019-11-28T21:38:48.783 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1119} 2019-11-28T21:38:48.817 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1119} 2019-11-28T21:38:49.118 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1120} 2019-11-28T21:38:49.150 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1120} 2019-11-28T21:38:49.433 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1121} 2019-11-28T21:38:49.496 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1121} 2019-11-28T21:38:49.777 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1122} 2019-11-28T21:38:49.841 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1122} 2019-11-28T21:38:50.111 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1123} 2019-11-28T21:38:50.186 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1123} 2019-11-28T21:38:50.406 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1124} 2019-11-28T21:38:50.521 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1124} 2019-11-28T21:38:50.730 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1125} 2019-11-28T21:38:50.856 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1125} 2019-11-28T21:38:51.069 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1126} 2019-11-28T21:38:51.169 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1126} 2019-11-28T21:38:51.399 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1127} 2019-11-28T21:38:51.504 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1127} 2019-11-28T21:38:51.753 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1128} 2019-11-28T21:38:51.828 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1128} 2019-11-28T21:38:52.097 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1129} 2019-11-28T21:38:52.151 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1129} 2019-11-28T21:38:52.380 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1130} 2019-11-28T21:38:52.476 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1130} 2019-11-28T21:38:52.700 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1131} 2019-11-28T21:38:52.822 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1131} 2019-11-28T21:38:53.030 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1132} 2019-11-28T21:38:53.157 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1132} 2019-11-28T21:38:53.366 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1133} 2019-11-28T21:38:53.520 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1133} 2019-11-28T21:38:53.703 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1134} 2019-11-28T21:38:53.843 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1134} 2019-11-28T21:38:53.969 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jj", "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "move_home": false, "name": "jj", "shell": "/bin/bash", "state": "present", "uid": 1135} 2019-11-28T21:38:54.138 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jj", "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "move_home": false, "name": "jj", "shell": "/bin/bash", "state": "present", "uid": 1135} 2019-11-28T21:38:54.307 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1136} 2019-11-28T21:38:54.449 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1136} 2019-11-28T21:38:54.631 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1137} 2019-11-28T21:38:54.780 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1137} 2019-11-28T21:38:54.979 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1138} 2019-11-28T21:38:55.123 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1138} 2019-11-28T21:38:55.338 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1139} 2019-11-28T21:38:55.447 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1139} 2019-11-28T21:38:55.677 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-11-28T21:38:55.796 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-11-28T21:38:56.022 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1141} 2019-11-28T21:38:56.157 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1141} 2019-11-28T21:38:56.351 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-11-28T21:38:56.490 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-11-28T21:38:56.691 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1143} 2019-11-28T21:38:56.828 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1143} 2019-11-28T21:38:57.040 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1144} 2019-11-28T21:38:57.141 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1144} 2019-11-28T21:38:57.321 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhishekvrshny", "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "move_home": false, "name": "abhishekvrshny", "shell": "/bin/bash", "state": "present", "uid": 1145} 2019-11-28T21:38:57.458 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhishekvrshny", "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "move_home": false, "name": "abhishekvrshny", "shell": "/bin/bash", "state": "present", "uid": 1145} 2019-11-28T21:38:57.647 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1146} 2019-11-28T21:38:57.817 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1146} 2019-11-28T21:38:58.018 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1147} 2019-11-28T21:38:58.155 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1147} 2019-11-28T21:38:58.324 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1148} 2019-11-28T21:38:58.483 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1148} 2019-11-28T21:38:58.684 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/shehbazj", "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "move_home": false, "name": "shehbazj", "shell": "/bin/bash", "state": "present", "uid": 1149} 2019-11-28T21:38:58.820 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/shehbazj", "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "move_home": false, "name": "shehbazj", "shell": "/bin/bash", "state": "present", "uid": 1149} 2019-11-28T21:38:58.998 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1150} 2019-11-28T21:38:59.143 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1150} 2019-11-28T21:38:59.342 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/fche", "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "move_home": false, "name": "fche", "shell": "/bin/bash", "state": "present", "uid": 1151} 2019-11-28T21:38:59.490 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/fche", "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "move_home": false, "name": "fche", "shell": "/bin/bash", "state": "present", "uid": 1151} 2019-11-28T21:38:59.680 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/onyb", "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "move_home": false, "name": "onyb", "shell": "/bin/bash", "state": "present", "uid": 1152} 2019-11-28T21:38:59.814 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/onyb", "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "move_home": false, "name": "onyb", "shell": "/bin/bash", "state": "present", "uid": 1152} 2019-11-28T21:39:00.013 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1153} 2019-11-28T21:39:00.139 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1153} 2019-11-28T21:39:00.334 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/oprypin", "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "move_home": false, "name": "oprypin", "shell": "/bin/bash", "state": "present", "uid": 1154} 2019-11-28T21:39:00.460 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/oprypin", "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "move_home": false, "name": "oprypin", "shell": "/bin/bash", "state": "present", "uid": 1154} 2019-11-28T21:39:00.461 INFO:teuthology.task.ansible.out: 2019-11-28T21:39:00.680 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-11-28T21:39:00.777 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-11-28T21:39:00.995 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1156} 2019-11-28T21:39:01.131 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1156} 2019-11-28T21:39:01.339 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1157} 2019-11-28T21:39:01.444 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1157} 2019-11-28T21:39:01.695 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1158} 2019-11-28T21:39:01.791 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1158} 2019-11-28T21:39:02.030 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1159} 2019-11-28T21:39:02.114 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1159} 2019-11-28T21:39:02.374 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/asheplyakov", "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "move_home": false, "name": "asheplyakov", "shell": "/bin/bash", "state": "present", "uid": 1160} 2019-11-28T21:39:02.442 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/asheplyakov", "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "move_home": false, "name": "asheplyakov", "shell": "/bin/bash", "state": "present", "uid": 1160} 2019-11-28T21:39:02.695 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1161} 2019-11-28T21:39:02.780 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1161} 2019-11-28T21:39:03.030 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1162} 2019-11-28T21:39:03.083 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1162} 2019-11-28T21:39:03.374 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1163} 2019-11-28T21:39:03.438 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1163} 2019-11-28T21:39:03.720 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1164} 2019-11-28T21:39:03.783 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1164} 2019-11-28T21:39:04.038 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1165} 2019-11-28T21:39:04.122 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1165} 2019-11-28T21:39:04.371 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/jwilliamson", "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "move_home": false, "name": "jwilliamson", "shell": "/bin/bash", "state": "present", "uid": 1166} 2019-11-28T21:39:04.441 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/jwilliamson", "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "move_home": false, "name": "jwilliamson", "shell": "/bin/bash", "state": "present", "uid": 1166} 2019-11-28T21:39:04.688 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1167} 2019-11-28T21:39:04.762 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1167} 2019-11-28T21:39:05.051 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1168} 2019-11-28T21:39:05.085 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1168} 2019-11-28T21:39:05.389 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1169} 2019-11-28T21:39:05.411 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1169} 2019-11-28T21:39:05.674 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1170} 2019-11-28T21:39:05.738 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1170} 2019-11-28T21:39:06.000 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1171} 2019-11-28T21:39:06.023 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1171} 2019-11-28T21:39:06.294 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1172} 2019-11-28T21:39:06.322 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1172} 2019-11-28T21:39:06.628 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/liupan", "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "move_home": false, "name": "liupan", "shell": "/bin/bash", "state": "present", "uid": 1173} 2019-11-28T21:39:06.652 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/liupan", "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "move_home": false, "name": "liupan", "shell": "/bin/bash", "state": "present", "uid": 1173} 2019-11-28T21:39:06.946 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1174} 2019-11-28T21:39:06.978 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1174} 2019-11-28T21:39:07.273 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/amarangone", "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "move_home": false, "name": "amarangone", "shell": "/bin/bash", "state": "present", "uid": 1175} 2019-11-28T21:39:07.326 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/amarangone", "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "move_home": false, "name": "amarangone", "shell": "/bin/bash", "state": "present", "uid": 1175} 2019-11-28T21:39:07.606 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-11-28T21:39:07.658 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-11-28T21:39:07.950 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/kmroz", "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "move_home": false, "name": "kmroz", "shell": "/bin/bash", "state": "present", "uid": 1176} 2019-11-28T21:39:07.992 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/kmroz", "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "move_home": false, "name": "kmroz", "shell": "/bin/bash", "state": "present", "uid": 1176} 2019-11-28T21:39:08.283 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1177} 2019-11-28T21:39:08.336 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1177} 2019-11-28T21:39:08.640 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1178} 2019-11-28T21:39:08.683 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1178} 2019-11-28T21:39:08.921 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1179} 2019-11-28T21:39:08.985 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1179} 2019-11-28T21:39:09.256 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1180} 2019-11-28T21:39:09.298 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1180} 2019-11-28T21:39:09.593 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1181} 2019-11-28T21:39:09.595 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1181} 2019-11-28T21:39:09.898 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1182} 2019-11-28T21:39:09.930 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1182} 2019-11-28T21:39:10.235 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/adamyanova", "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "move_home": false, "name": "adamyanova", "shell": "/bin/bash", "state": "present", "uid": 1183} 2019-11-28T21:39:10.278 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/adamyanova", "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "move_home": false, "name": "adamyanova", "shell": "/bin/bash", "state": "present", "uid": 1183} 2019-11-28T21:39:10.573 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1184} 2019-11-28T21:39:10.613 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1184} 2019-11-28T21:39:10.874 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1185} 2019-11-28T21:39:10.940 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1185} 2019-11-28T21:39:11.213 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1186} 2019-11-28T21:39:11.276 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1186} 2019-11-28T21:39:11.566 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1187} 2019-11-28T21:39:11.609 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1187} 2019-11-28T21:39:11.869 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1188} 2019-11-28T21:39:11.974 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1188} 2019-11-28T21:39:12.202 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1189} 2019-11-28T21:39:12.287 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1189} 2019-11-28T21:39:12.541 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1190} 2019-11-28T21:39:12.634 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1190} 2019-11-28T21:39:12.874 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1191} 2019-11-28T21:39:12.973 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1191} 2019-11-28T21:39:13.182 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1192} 2019-11-28T21:39:13.300 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1192} 2019-11-28T21:39:13.503 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1193} 2019-11-28T21:39:13.651 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1193} 2019-11-28T21:39:13.799 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1194} 2019-11-28T21:39:13.970 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1194} 2019-11-28T21:39:14.105 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1195} 2019-11-28T21:39:14.314 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1195} 2019-11-28T21:39:14.450 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1196} 2019-11-28T21:39:14.637 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1196} 2019-11-28T21:39:14.794 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1197} 2019-11-28T21:39:14.951 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1197} 2019-11-28T21:39:15.118 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1198} 2019-11-28T21:39:15.274 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1198} 2019-11-28T21:39:15.452 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1199} 2019-11-28T21:39:15.618 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1199} 2019-11-28T21:39:15.765 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1200} 2019-11-28T21:39:15.947 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1200} 2019-11-28T21:39:16.103 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1201} 2019-11-28T21:39:16.302 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1201} 2019-11-28T21:39:16.447 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1202} 2019-11-28T21:39:16.661 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1202} 2019-11-28T21:39:16.765 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1203} 2019-11-28T21:39:16.994 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1203} 2019-11-28T21:39:17.099 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1204} 2019-11-28T21:39:17.339 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1204} 2019-11-28T21:39:17.433 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1205} 2019-11-28T21:39:17.673 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1205} 2019-11-28T21:39:17.778 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1206} 2019-11-28T21:39:17.986 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1206} 2019-11-28T21:39:18.124 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1207} 2019-11-28T21:39:18.331 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1207} 2019-11-28T21:39:18.479 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1208} 2019-11-28T21:39:18.666 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1208} 2019-11-28T21:39:18.774 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1209} 2019-11-28T21:39:18.997 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1209} 2019-11-28T21:39:19.120 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1210} 2019-11-28T21:39:19.344 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1210} 2019-11-28T21:39:19.426 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1211} 2019-11-28T21:39:19.687 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1211} 2019-11-28T21:39:19.771 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1212} 2019-11-28T21:39:20.007 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1212} 2019-11-28T21:39:20.131 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1213} 2019-11-28T21:39:20.356 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1213} 2019-11-28T21:39:20.453 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1214} 2019-11-28T21:39:20.692 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1214} 2019-11-28T21:39:20.766 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-11-28T21:39:21.002 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-11-28T21:39:21.097 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10102, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 10102} 2019-11-28T21:39:21.351 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10102, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 10102} 2019-11-28T21:39:21.771 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "name": "rraja", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2019-11-28T21:39:21.907 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:39:21 +0000 (0:00:39.469) 0:00:51.723 ***** 2019-11-28T21:39:21.935 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2019-11-28T21:39:21.972 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:39:21 +0000 (0:00:00.064) 0:00:51.788 ***** 2019-11-28T21:39:22.021 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2019-11-28T21:39:22.025 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "tr 2019-11-28T21:39:22.032 INFO:teuthology.task.ansible.out:ociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04 2019-11-28T21:39:22.034 INFO:teuthology.task.ansible.out:okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "jos 2019-11-28T21:39:22.037 INFO:teuthology.task.ansible.out:hd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jo 2019-11-28T21:39:22.038 INFO:teuthology.task.ansible.out:wilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f 2019-11-28T21:39:22.040 INFO:teuthology.task.ansible.out:966b2794c94caa110d313e927a1c1b\n"}, {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h 2019-11-28T21:39:22.041 INFO:teuthology.task.ansible.out:7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6 2019-11-28T21:39:22.042 INFO:teuthology.task.ansible.out:c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa 2019-11-28T21:39:22.044 INFO:teuthology.task.ansible.out:2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db2 2019-11-28T21:39:22.045 INFO:teuthology.task.ansible.out:93dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.red 2019-11-28T21:39:22.047 INFO:teuthology.task.ansible.out:hat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f 2019-11-28T21:39:22.048 INFO:teuthology.task.ansible.out:57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}]}, "changed": false} TASK [users : Create all admin users with sudo access.] ************************ changed: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a 2019-11-28T21:39:22.050 INFO:teuthology.task.ansible.out:3546e532b"}, "name": "rraja", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2019-11-28T21:39:22.088 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:39:22 +0000 (0:00:00.115) 0:00:51.904 ***** 2019-11-28T21:39:22.299 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:39:22 +0000 (0:00:00.211) 0:00:52.115 ***** 2019-11-28T21:39:22.326 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2019-11-28T21:39:22.363 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:39:22 +0000 (0:00:00.063) 0:00:52.179 ***** 2019-11-28T21:39:22.413 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2019-11-28T21:39:22.418 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "tr 2019-11-28T21:39:22.419 INFO:teuthology.task.ansible.out:ociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04 2019-11-28T21:39:22.420 INFO:teuthology.task.ansible.out:okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "jos 2019-11-28T21:39:22.424 INFO:teuthology.task.ansible.out:hd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jo 2019-11-28T21:39:22.426 INFO:teuthology.task.ansible.out:wilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851 2019-11-28T21:39:22.428 INFO:teuthology.task.ansible.out:f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde189 2019-11-28T21:39:22.429 INFO:teuthology.task.ansible.out:0af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f45903 2019-11-28T21:39:22.430 INFO:teuthology.task.ansible.out:0cb7a195"}, {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d7 2019-11-28T21:39:22.432 INFO:teuthology.task.ansible.out:12ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA d 2019-11-28T21:39:22.433 INFO:teuthology.task.ansible.out:a2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@ 2019-11-28T21:39:22.437 INFO:teuthology.task.ansible.out:localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.re 2019-11-28T21:39:22.438 INFO:teuthology.task.ansible.out:dhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}]}, "changed": false} 2019-11-28T21:39:22.498 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:39:22 +0000 (0:00:00.135) 0:00:52.314 ***** 2019-11-28T21:39:23.088 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2019-11-28T21:39:23.090 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com -> localhost] => {"after": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "attempts": 1, "before": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "changed": false, "remote_url_changed": false} 2019-11-28T21:39:23.128 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:39:23 +0000 (0:00:00.630) 0:00:52.944 ***** 2019-11-28T21:39:23.157 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com -> localhost] => {"after": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "attempts": 1, "before": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "changed": false, "remote_url_changed": false} 2019-11-28T21:39:23.203 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:39:23 +0000 (0:00:00.074) 0:00:53.019 ***** 2019-11-28T21:39:23.511 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-28T21:39:23.512 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2019-11-28T21:39:23.612 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2019-11-28T21:39:23.839 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2019-11-28T21:39:23.964 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2019-11-28T21:39:24.195 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2019-11-28T21:39:24.258 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2019-11-28T21:39:24.507 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCWy2i6Iv6IWLh53Z44O4fQ0ctxR8odCAWIZAaSQXAxxC++RS+95Zr+BZ5wJwsBOyP1G4AAhl+9uwnn3NmDDG7fKGexPoQrTZZ27KdJ3bHpZRq5LJf9byWFwz4rDsqIqkGjI9sUkfa6nV7ci2BdEkIgLupTT2uXUzTb/njOjI7Fc+cQ7ac4QfJ+yeIcqxeje/YYDF3068V4z1yynk9q2KRXYdERKQghaWDNJlbdBhn/fmsam6okOtUnsXjE88qGPd+LVHWfK0EfYvYXiAoOaJDK8d4EXnJ4RKJceQPBk8ravuQtKVwnRIr8WtmILHuoztthfwqb2WvZ5iMDt6v7oQZ alfredo@papaya.local", "key_options": null, "keyfile": "/home/adeza/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adeza", "validate_certs": true} 2019-11-28T21:39:24.571 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCWy2i6Iv6IWLh53Z44O4fQ0ctxR8odCAWIZAaSQXAxxC++RS+95Zr+BZ5wJwsBOyP1G4AAhl+9uwnn3NmDDG7fKGexPoQrTZZ27KdJ3bHpZRq5LJf9byWFwz4rDsqIqkGjI9sUkfa6nV7ci2BdEkIgLupTT2uXUzTb/njOjI7Fc+cQ7ac4QfJ+yeIcqxeje/YYDF3068V4z1yynk9q2KRXYdERKQghaWDNJlbdBhn/fmsam6okOtUnsXjE88qGPd+LVHWfK0EfYvYXiAoOaJDK8d4EXnJ4RKJceQPBk8ravuQtKVwnRIr8WtmILHuoztthfwqb2WvZ5iMDt6v7oQZ alfredo@papaya.local", "key_options": null, "keyfile": "/home/adeza/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adeza", "validate_certs": true} 2019-11-28T21:39:24.849 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2019-11-28T21:39:24.851 INFO:teuthology.task.ansible.out:lidate_certs": true} 2019-11-28T21:39:24.923 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2019-11-28T21:39:24.925 INFO:teuthology.task.ansible.out:lidate_certs": true} 2019-11-28T21:39:25.193 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2019-11-28T21:39:25.287 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2019-11-28T21:39:25.521 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2019-11-28T21:39:25.523 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2019-11-28T21:39:25.647 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2019-11-28T21:39:25.649 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2019-11-28T21:39:25.857 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2019-11-28T21:39:25.984 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2019-11-28T21:39:26.204 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2019-11-28T21:39:26.226 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:39:26.343 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2019-11-28T21:39:26.344 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:39:26.521 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2019-11-28T21:39:26.523 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2019-11-28T21:39:26.532 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:39:26.543 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:39:26.555 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:39:26.565 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:39:26.711 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2019-11-28T21:39:26.713 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2019-11-28T21:39:26.723 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:39:26.734 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:39:26.744 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:39:26.756 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:39:26.870 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2019-11-28T21:39:27.097 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2019-11-28T21:39:27.232 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2019-11-28T21:39:27.234 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2019-11-28T21:39:27.440 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2019-11-28T21:39:27.441 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2019-11-28T21:39:27.586 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2019-11-28T21:39:27.752 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2019-11-28T21:39:27.933 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2019-11-28T21:39:28.100 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2019-11-28T21:39:28.247 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2019-11-28T21:39:28.424 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2019-11-28T21:39:28.600 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2019-11-28T21:39:28.774 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2019-11-28T21:39:28.964 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2019-11-28T21:39:29.111 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2019-11-28T21:39:29.287 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2019-11-28T21:39:29.466 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2019-11-28T21:39:29.638 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2019-11-28T21:39:29.640 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2019-11-28T21:39:29.819 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2019-11-28T21:39:29.821 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2019-11-28T21:39:29.966 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2019-11-28T21:39:29.968 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2019-11-28T21:39:30.153 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2019-11-28T21:39:30.155 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2019-11-28T21:39:30.319 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2019-11-28T21:39:30.516 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2019-11-28T21:39:30.674 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2019-11-28T21:39:30.871 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2019-11-28T21:39:31.006 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2019-11-28T21:39:31.014 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2019-11-28T21:39:31.207 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2019-11-28T21:39:31.208 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2019-11-28T21:39:31.339 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2019-11-28T21:39:31.560 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2019-11-28T21:39:31.661 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2019-11-28T21:39:31.921 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2019-11-28T21:39:32.005 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2019-11-28T21:39:32.265 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2019-11-28T21:39:32.360 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2019-11-28T21:39:32.591 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2019-11-28T21:39:32.684 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2019-11-28T21:39:32.931 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2019-11-28T21:39:33.019 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2019-11-28T21:39:33.020 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2019-11-28T21:39:33.257 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2019-11-28T21:39:33.259 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2019-11-28T21:39:33.383 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXvd7F0n4DeBROTLYDE4lItYn/2S1cMM1uAkkwissUh4LGsMAVWi5tUI0EUC7I2BUxACvIIA4yfkhe2ATAu95UQxKWVql67sfCW6WwY7lNa65kQC9S5dE/+d4vPxFoFSFnri981laJXOjbjTsWD7j1SGfqbRuAHQKL8y95DQ3y/B7/1oxTg1jjK8BTr3GAUp8/7lNlWE+x2S3gjHqqH92yWU7OBbPWRZjjkVkXS/5CbWDDUx8nbeGPcAIfM95rRQR0VkwzVi1FWsXd6qIbZ9TqOhYyLR0fCsnDuveNV68FB1ddvqCLdXRxPLmucwzdjGMbZ5EJ0H/CAAutj3Vjn6gh jj@newdream.net\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRXOkus/WHB3llEH1u4rWj0F/bZSslq4/o7pBUGFYrHKqa2iBiCj4DxBEsaReWUm0aDyesGuEVeoECTtzh7byJ6iZHFbf0McubxnuFMImneQ2mB0+raa3uWblwnyiwAqiZgtcJGQpCxCnrmLzyNN6xUUmzN27cDOMSDpbWr3VdPSBH+ixIuZI8r8UkSbmlX30V2bvk4lGl2SPV385tAvRPRU9KfMG9AgwNv+R2WCiA2GOrjes2VHm7LneqI/vE5yOxJsm4tPxEkOpCp3/0xt9L9cmPz47HnzJ2Qure3kZmOsCxOX1+9dXFIwhPaNconD4KDlv4MNs/M425Gp6KKnnV jj@laptop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBjrQ3drodiPr83uvpUUf6SXZ0utOFIfy5Cj3BGcn7bY29BKXCwomAUmmLMk76cGBZ7jHf3ZJYid1ESbHmvmSgKFShr9JFXBHvlMdnyewi7hFix+sjX9ZtuZfSaIsBbU5Jlz3RqHtDrScS1wJRh+ 2019-11-28T21:39:33.384 INFO:teuthology.task.ansible.out:oDlH6is5QWSCABVWhUk+hJtQFg4dfespqomt88NmPZuR0aR0b22hkrMYINXP0y3iz3Jjs5vg8td7VJ2hXb5yIBk+Izuq1LnjPyRCZv5LkZMuwofexpfflLKeVHw0t31HXuzBUZMoKqXiGJweyPDzY/xbeTVnYvQQEvoGxRDpaYuiGSfhFW0UHE3HSeuYfklO2x juanjose@aurora", "key_options": null, "keyfile": "/home/jj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jj", "validate_certs": true} 2019-11-28T21:39:33.612 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXvd7F0n4DeBROTLYDE4lItYn/2S1cMM1uAkkwissUh4LGsMAVWi5tUI0EUC7I2BUxACvIIA4yfkhe2ATAu95UQxKWVql67sfCW6WwY7lNa65kQC9S5dE/+d4vPxFoFSFnri981laJXOjbjTsWD7j1SGfqbRuAHQKL8y95DQ3y/B7/1oxTg1jjK8BTr3GAUp8/7lNlWE+x2S3gjHqqH92yWU7OBbPWRZjjkVkXS/5CbWDDUx8nbeGPcAIfM95rRQR0VkwzVi1FWsXd6qIbZ9TqOhYyLR0fCsnDuveNV68FB1ddvqCLdXRxPLmucwzdjGMbZ5EJ0H/CAAutj3Vjn6gh jj@newdream.net\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRXOkus/WHB3llEH1u4rWj0F/bZSslq4/o7pBUGFYrHKqa2iBiCj4DxBEsaReWUm0aDyesGuEVeoECTtzh7byJ6iZHFbf0McubxnuFMImneQ2mB0+raa3uWblwnyiwAqiZgtcJGQpCxCnrmLzyNN6xUUmzN27cDOMSDpbWr3VdPSBH+ixIuZI8r8UkSbmlX30V2bvk4lGl2SPV385tAvRPRU9KfMG9AgwNv+R2WCiA2GOrjes2VHm7LneqI/vE5yOxJsm4tPxEkOpCp3/0xt9L9cmPz47HnzJ2Qure3kZmOsCxOX1+9dXFIwhPaNconD4KDlv4MNs/M425Gp6KKnnV jj@laptop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBjrQ3drodiPr83uvpUUf6SXZ0utOFIfy5Cj3BGcn7bY29BKXCwomAUmmLMk76cGBZ7jHf3ZJYid1ESbHmvmSgKFShr9JFXBHvlMdnyewi7hFix+sjX9ZtuZfSaIsBbU5Jlz3RqHtDrScS1wJRh+ 2019-11-28T21:39:33.614 INFO:teuthology.task.ansible.out:oDlH6is5QWSCABVWhUk+hJtQFg4dfespqomt88NmPZuR0aR0b22hkrMYINXP0y3iz3Jjs5vg8td7VJ2hXb5yIBk+Izuq1LnjPyRCZv5LkZMuwofexpfflLKeVHw0t31HXuzBUZMoKqXiGJweyPDzY/xbeTVnYvQQEvoGxRDpaYuiGSfhFW0UHE3HSeuYfklO2x juanjose@aurora", "key_options": null, "keyfile": "/home/jj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jj", "validate_certs": true} 2019-11-28T21:39:33.717 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2019-11-28T21:39:33.967 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2019-11-28T21:39:34.061 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2019-11-28T21:39:34.316 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2019-11-28T21:39:34.349 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2019-11-28T21:39:34.662 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2019-11-28T21:39:34.694 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2019-11-28T21:39:34.993 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2019-11-28T21:39:35.036 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2019-11-28T21:39:35.306 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2019-11-28T21:39:35.403 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2019-11-28T21:39:35.662 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2019-11-28T21:39:35.724 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-11-28T21:39:35.993 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-11-28T21:39:36.077 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2019-11-28T21:39:36.337 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2019-11-28T21:39:36.431 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2019-11-28T21:39:36.690 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2019-11-28T21:39:36.732 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDAfEhx/xZpJV9ouKFW4QBC46cNicIQMzU8DSYl1GOP9+pnnD+AudVQubvrEePGA7TFkSar5Ccv4dnoQ2s1CaPAtbT+s+nQlf5OFO9P/qvhkM4JhlmH2XxgJAcOvZH2W1HXfGTc4WIuU/OtXM+yWMGlTXxqMqwCvGfqc+Yf8zkt0t3m0kBdWoFcZvdYqKuS15bvdVuiKz7GUxDrtw98yMXb/ob/E+Ygmmphn9dMatTeZ6SD1fbcrHh9oIVbYiY93+++jXzjEXrGzJh/gphgEtvIf8UPMF9HiXXPqwhxneRvghvZ/B05LGfcsqGAtyK09eF94hglyl9kJIdm/d7lmmM/ abhishek.varshney@VS-C02PJ2CSFVH5.local", "key_options": null, "keyfile": "/home/abhishekvrshny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhishekvrshny", "validate_certs": true} 2019-11-28T21:39:37.022 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDAfEhx/xZpJV9ouKFW4QBC46cNicIQMzU8DSYl1GOP9+pnnD+AudVQubvrEePGA7TFkSar5Ccv4dnoQ2s1CaPAtbT+s+nQlf5OFO9P/qvhkM4JhlmH2XxgJAcOvZH2W1HXfGTc4WIuU/OtXM+yWMGlTXxqMqwCvGfqc+Yf8zkt0t3m0kBdWoFcZvdYqKuS15bvdVuiKz7GUxDrtw98yMXb/ob/E+Ygmmphn9dMatTeZ6SD1fbcrHh9oIVbYiY93+++jXzjEXrGzJh/gphgEtvIf8UPMF9HiXXPqwhxneRvghvZ/B05LGfcsqGAtyK09eF94hglyl9kJIdm/d7lmmM/ abhishek.varshney@VS-C02PJ2CSFVH5.local", "key_options": null, "keyfile": "/home/abhishekvrshny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhishekvrshny", "validate_certs": true} 2019-11-28T21:39:37.085 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2019-11-28T21:39:37.087 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2019-11-28T21:39:37.364 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2019-11-28T21:39:37.366 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2019-11-28T21:39:37.437 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2019-11-28T21:39:37.439 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2019-11-28T21:39:37.737 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2019-11-28T21:39:37.739 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2019-11-28T21:39:37.759 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2019-11-28T21:39:38.079 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2019-11-28T21:39:38.101 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUqFGbkDz4L4BpIs2znPSWeawZZM2FBLrR3htaMBM6lcmiX2h+vgVGv2ZLpajGo7KB6J59kzWLBCJXN2DG0uUqa7dOdjEDuDrjZkNgDzXZ20lqzFAjLwNF6a9PcDN/oX6jzK9+3xArleQuTIJsOPRue2dQYGRnyIIrYpapJkkUgI+lXfwrEixCY3xjGNvVoh5bqQmkk3buLIvKEMwhPXJ94SGqsNTNC75HfKhVMjxA8QmuiXJVEgiW00V3Cctwv+yjiDMts4Dcs6yEzxXzjv0c0APxxN78bKlkwFgXiqawLiApk752/x2teSg7kvdrlGcCAWq/BhwphYjwaRlXIj1N shehbaz@donjaffer", "key_options": null, "keyfile": "/home/shehbazj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shehbazj", "validate_certs": true} 2019-11-28T21:39:38.414 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUqFGbkDz4L4BpIs2znPSWeawZZM2FBLrR3htaMBM6lcmiX2h+vgVGv2ZLpajGo7KB6J59kzWLBCJXN2DG0uUqa7dOdjEDuDrjZkNgDzXZ20lqzFAjLwNF6a9PcDN/oX6jzK9+3xArleQuTIJsOPRue2dQYGRnyIIrYpapJkkUgI+lXfwrEixCY3xjGNvVoh5bqQmkk3buLIvKEMwhPXJ94SGqsNTNC75HfKhVMjxA8QmuiXJVEgiW00V3Cctwv+yjiDMts4Dcs6yEzxXzjv0c0APxxN78bKlkwFgXiqawLiApk752/x2teSg7kvdrlGcCAWq/BhwphYjwaRlXIj1N shehbaz@donjaffer", "key_options": null, "keyfile": "/home/shehbazj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shehbazj", "validate_certs": true} 2019-11-28T21:39:38.447 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2019-11-28T21:39:38.730 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2019-11-28T21:39:38.792 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJorrIT68EZc7A4IHwQGv8uoblSAIUnMxhOq6rlnvmqx4clpUzKkbzzrZUctP47aeqaSX5Mc6mV8TY0sIH8fFQwahF3ueTKT3YecZvPwiK4ALmawkvFpmgnJKKYhTrEApbFBhtH0KnNLtozpl4RJds4p09maNeoUXJDy3A24tpXViU2Nrw8lSIT6VJzvqSlK+miNEf3VKI6gnRB7fGcJe913zITf09Rew7GexAyQUYHusZbJCf5rl6hkewkZMkgbXfG22f/XWcYjoRtA/ZqeWIP2UDO/H3tfJnlMxUshbDGLllMFJzwmwhkYbapqVmnu7Y01rEQ4LqvaHZMr/yKn+N fche@very.elastic.org", "key_options": null, "keyfile": "/home/fche/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "fche", "validate_certs": true} 2019-11-28T21:39:39.072 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJorrIT68EZc7A4IHwQGv8uoblSAIUnMxhOq6rlnvmqx4clpUzKkbzzrZUctP47aeqaSX5Mc6mV8TY0sIH8fFQwahF3ueTKT3YecZvPwiK4ALmawkvFpmgnJKKYhTrEApbFBhtH0KnNLtozpl4RJds4p09maNeoUXJDy3A24tpXViU2Nrw8lSIT6VJzvqSlK+miNEf3VKI6gnRB7fGcJe913zITf09Rew7GexAyQUYHusZbJCf5rl6hkewkZMkgbXfG22f/XWcYjoRtA/ZqeWIP2UDO/H3tfJnlMxUshbDGLllMFJzwmwhkYbapqVmnu7Y01rEQ4LqvaHZMr/yKn+N fche@very.elastic.org", "key_options": null, "keyfile": "/home/fche/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "fche", "validate_certs": true} 2019-11-28T21:39:39.084 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmKchKXS6xKpo+25ZN5vMpbuL4OoFZWPfPSxur6iaBKdr6LSMejnAwkJOhfhH55pZLuAglHWdMcZi8H/ktzsZVd+ybvJNhpZsXdefNqqxUyjn320cT73pDdDC/W1519fUiokss23S6B4GR0B44VrVKezN5Dyhf4sATN8l76QnIALVK5hvYOI3v5k70weaPJM4fma7xYF5b6qSxauGofzMb5XwjNaaPE9F8U08nxGk5XK+S0rHoFnCjoKBlN9Ee1gk6PjsStQAyK5ujWvPGtG/UvuU9LewVbt6wuPbpwsf7Ck0u4wHECHK+185JF/X+qsWwv030pKShXblLVckNVhAx ani@orchid", "key_options": null, "keyfile": "/home/onyb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "onyb", "validate_certs": true} 2019-11-28T21:39:39.372 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmKchKXS6xKpo+25ZN5vMpbuL4OoFZWPfPSxur6iaBKdr6LSMejnAwkJOhfhH55pZLuAglHWdMcZi8H/ktzsZVd+ybvJNhpZsXdefNqqxUyjn320cT73pDdDC/W1519fUiokss23S6B4GR0B44VrVKezN5Dyhf4sATN8l76QnIALVK5hvYOI3v5k70weaPJM4fma7xYF5b6qSxauGofzMb5XwjNaaPE9F8U08nxGk5XK+S0rHoFnCjoKBlN9Ee1gk6PjsStQAyK5ujWvPGtG/UvuU9LewVbt6wuPbpwsf7Ck0u4wHECHK+185JF/X+qsWwv030pKShXblLVckNVhAx ani@orchid", "key_options": null, "keyfile": "/home/onyb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "onyb", "validate_certs": true} 2019-11-28T21:39:39.439 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2019-11-28T21:39:39.709 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2019-11-28T21:39:39.762 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzf8fjotuelTIdz7clDpSN/VDtXirYrmzM/r157Np9uTMgn/rhzzplp2DKqFrCEDwawJ1O1Fr/H5DqttPonyRmjPmAIf96P8KKLsC600R63xk4DNhnByY0WBU3o1e46LP7DJLsOOy6hZRbyjgoFfzcapH7aV+fa37k7/Ri5mpmdmENa6lYI38+YaItFJf0kTXdFou0iLAt7xogOTimgblMst6UjOhRIsMFA3QS4PvOFR+AedCHeVtYK9mAeRtQ530wKzjz8x4NFU3Y93jmygwTTG2RTEfRjfbObfFOQXJGKcl28pxGPUL9ZlrLx1juAekn2Uz+2oO/eQ8G5w+XW3rp", "key_options": null, "keyfile": "/home/oprypin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oprypin", "validate_certs": true} 2019-11-28T21:39:40.061 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzf8fjotuelTIdz7clDpSN/VDtXirYrmzM/r157Np9uTMgn/rhzzplp2DKqFrCEDwawJ1O1Fr/H5DqttPonyRmjPmAIf96P8KKLsC600R63xk4DNhnByY0WBU3o1e46LP7DJLsOOy6hZRbyjgoFfzcapH7aV+fa37k7/Ri5mpmdmENa6lYI38+YaItFJf0kTXdFou0iLAt7xogOTimgblMst6UjOhRIsMFA3QS4PvOFR+AedCHeVtYK9mAeRtQ530wKzjz8x4NFU3Y93jmygwTTG2RTEfRjfbObfFOQXJGKcl28pxGPUL9ZlrLx1juAekn2Uz+2oO/eQ8G5w+XW3rp", "key_options": null, "keyfile": "/home/oprypin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oprypin", "validate_certs": true} 2019-11-28T21:39:40.104 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2019-11-28T21:39:40.105 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-11-28T21:39:40.382 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2019-11-28T21:39:40.384 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-11-28T21:39:40.466 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2019-11-28T21:39:40.467 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2019-11-28T21:39:40.469 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2019-11-28T21:39:40.747 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2019-11-28T21:39:40.748 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2019-11-28T21:39:40.750 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2019-11-28T21:39:40.779 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2019-11-28T21:39:41.060 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2019-11-28T21:39:41.129 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2019-11-28T21:39:41.400 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2019-11-28T21:39:41.425 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2019-11-28T21:39:41.748 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2019-11-28T21:39:41.801 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDLCJHta/5O2C2MXRegwo+bJUiqbkESr+RwoH/VIdb4L0JDlVsqV+K+BOBjLZy3vwzWCaSackvshoZHAwGvvfGXjtLbhAYs6QWWHODf/XWBvOW4a96fbTToNpV1dXkHAGqlJMYln3GKVD0o9b69iQUTcLILJhWQjCoTjZsvTtP9OYn9YLfuoxhaaU3PazZVhZYml4Ca/3ns9vNQ/m+v4nh82ysyflGKYozEq0pl8VH0Ydy/FtOO98PhQx3crrivu3qghubntVRQnULUmlDSFhMff+ukLVdj2U0AdSBatlJuaSofWUMAQkv0Ia/om9doDGv2TqkXhJnZdGaWJwmuh6rKIZr7d7TYTD6Uag3wJ1NKiDETRNtmMCLuniEJzPO4asBpSSWGyVatyrNmAgBb6XCeZRkRcYvTXdA5OESKG3HJeguk0XCrjosIEYcvxyye9SgA8U73jWdDUdh0yIHLWcfrgC2eynE1uBnTPNBvtnf9pKqMEp5opdRAUhckhPRxJQ2JHcYMAFnq7gz1bL2boL2ElZOqHBx9qgv0ZKnk+YXqhyp2EP2JK0urd0EHMqkGUsRc7D0FSrz+j4lSkd71sHu3tMgwIrgDR55wYMBBRXTrR8pGTMnGldDBaxvUCgWnlsTQJdjs9xCM5gcJzzgZgkRBmrTOUkw2ABre6KMRAmQ4Zg3HxO0MBr5rfV5glWXuDJXsEowLPp/NQ+3X7PIU9LAtKkcZPWC3MayoFdEdNpKieCgOfRAiwJ34fWz4ozM0IvENmUmCKz8+yDAOeupJJ1/367Rl3+U8XTsDNSsqcmsRdr8ZnUIN0662FGr/nHkVaDq79rEywt/V2eMLWyunF0FUUnbwBB8/J0hgIQPX1ncziuzPTF/YCTR6lgVEtvNHPI1xTQsaVQkF9Whu9Eq6Gz1cFq6H/abb1DLJAoO1Cy0HjoT8MjwOICVcsrqxGXsNRBsv4fCxOaz6+WyVWz2O5gpNKOLLmenr9JbiTGjamjfl9dDempRROSDjsJJY6TPdRb0WBuk3i6mOAsAYeBHoargi+a+dQ1IDzGdVY2mUXtDTA6HluZVvzEKnAR6QzuEdRLOrbteETRQ3cV9STXgscCTokzDNzhYbkLUIl/SRBYBdPMiR9TgW+m/0IJkBTEEUuDtYVzyHezV94F17vzpK+xbRdk3/WmWPScPDkc9tDp0AGLdZ/FAkNzGM1VE8G5OJ7OduogIdIQW6yR8y+CP1O4e2WYZ3M0IjJFX8pc/zBinUBNOBvgAzO8aSXTgxXbs/Q1fcv7htmJZ/3nnB4U6N85tq5oklCWulk3tIFI5pMGiQUoQCW8PH2nwasaKKtOInBZMWm8B2K0c5bU2/bKRcXJNJ asheplyakov@as-ubuntu", "key_options": null, "keyfile": "/home/asheplyakov/.ssh/authorized_keys 2019-11-28T21:39:41.802 INFO:teuthology.task.ansible.out:", "manage_dir": true, "path": null, "state": "present", "user": "asheplyakov", "validate_certs": true} 2019-11-28T21:39:42.091 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDLCJHta/5O2C2MXRegwo+bJUiqbkESr+RwoH/VIdb4L0JDlVsqV+K+BOBjLZy3vwzWCaSackvshoZHAwGvvfGXjtLbhAYs6QWWHODf/XWBvOW4a96fbTToNpV1dXkHAGqlJMYln3GKVD0o9b69iQUTcLILJhWQjCoTjZsvTtP9OYn9YLfuoxhaaU3PazZVhZYml4Ca/3ns9vNQ/m+v4nh82ysyflGKYozEq0pl8VH0Ydy/FtOO98PhQx3crrivu3qghubntVRQnULUmlDSFhMff+ukLVdj2U0AdSBatlJuaSofWUMAQkv0Ia/om9doDGv2TqkXhJnZdGaWJwmuh6rKIZr7d7TYTD6Uag3wJ1NKiDETRNtmMCLuniEJzPO4asBpSSWGyVatyrNmAgBb6XCeZRkRcYvTXdA5OESKG3HJeguk0XCrjosIEYcvxyye9SgA8U73jWdDUdh0yIHLWcfrgC2eynE1uBnTPNBvtnf9pKqMEp5opdRAUhckhPRxJQ2JHcYMAFnq7gz1bL2boL2ElZOqHBx9qgv0ZKnk+YXqhyp2EP2JK0urd0EHMqkGUsRc7D0FSrz+j4lSkd71sHu3tMgwIrgDR55wYMBBRXTrR8pGTMnGldDBaxvUCgWnlsTQJdjs9xCM5gcJzzgZgkRBmrTOUkw2ABre6KMRAmQ4Zg3HxO0MBr5rfV5glWXuDJXsEowLPp/NQ+3X7PIU9LAtKkcZPWC3MayoFdEdNpKieCgOfRAiwJ34fWz4ozM0IvENmUmCKz8+yDAOeupJJ1/367Rl3+U8XTsDNSsqcmsRdr8ZnUIN0662FGr/nHkVaDq79rEywt/V2eMLWyunF0FUUnbwBB8/J0hgIQPX1ncziuzPTF/YCTR6lgVEtvNHPI1xTQsaVQkF9Whu9Eq6Gz1cFq6H/abb1DLJAoO1Cy0HjoT8MjwOICVcsrqxGXsNRBsv4fCxOaz6+WyVWz2O5gpNKOLLmenr9JbiTGjamjfl9dDempRROSDjsJJY6TPdRb0WBuk3i6mOAsAYeBHoargi+a+dQ1IDzGdVY2mUXtDTA6HluZVvzEKnAR6QzuEdRLOrbteETRQ3cV9STXgscCTokzDNzhYbkLUIl/SRBYBdPMiR9TgW+m/0IJkBTEEUuDtYVzyHezV94F17vzpK+xbRdk3/WmWPScPDkc9tDp0AGLdZ/FAkNzGM1VE8G5OJ7OduogIdIQW6yR8y+CP1O4e2WYZ3M0IjJFX8pc/zBinUBNOBvgAzO8aSXTgxXbs/Q1fcv7htmJZ/3nnB4U6N85tq5oklCWulk3tIFI5pMGiQUoQCW8PH2nwasaKKtOInBZMWm8B2K0c5bU2/bKRcXJNJ asheplyakov@as-ubuntu", "key_options": null, "keyfile": "/home/asheplyakov/.ssh/authorized_keys 2019-11-28T21:39:42.092 INFO:teuthology.task.ansible.out:", "manage_dir": true, "path": null, "state": "present", "user": "asheplyakov", "validate_certs": true} 2019-11-28T21:39:42.154 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2019-11-28T21:39:42.423 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2019-11-28T21:39:42.465 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2019-11-28T21:39:42.735 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2019-11-28T21:39:42.798 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2019-11-28T21:39:43.056 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2019-11-28T21:39:43.130 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2019-11-28T21:39:43.388 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2019-11-28T21:39:43.481 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2019-11-28T21:39:43.719 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2019-11-28T21:39:43.833 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCmp/WxBoQxK/3bI3N9X4INmChIFtG/75NULYt9CAAnoOhFHe8xHMOU4x/YS6JdoIBJXusrjbDhCksFSK/caoOow9CQp3VWytslRSjfjkjbwwWHSdcyGpSO4lS5F32SgLOZBuyktpkLDgi6Ou5OTNKokJO8qiZo9Uw0rEBNakfsVi+fpysUDL792Jk1ROUr0HUpwqrQfTPZaue+PomXPQSYIqf06EH1nJYho6D4jt/g6U0qc66WTW5dXTkWD2VVQjZbFGkamz0ICHBJ/Xpf4TjWQVotsYD5NtbvqPo6ygpJYNhKR2n2zA+L4Zu2n0AEib5S4ftNxc7gNDCCfVs/EEIvXp/3CjKVPxHf4xUUPUZj+SQFnSUPQfeY1iIydoX+IG9oj5kKmQBdQFxbAaZJ679bORIqlH73dUFGr2rfS1UlIgPW5ll77bixsB0GP3+Jw4FF5QbO+k1d5qJpUw+8D6FbWAppP7hnSAok9PTpBqfkMpFiX00ZTIFwKCBLxdtJOfbIhbOPCnyEoB2ZLfRiBJmXhBpLjGghWIPPnGZh+yeJiy/EyKwN57vLmjdmvcDgSsjHswT+rQ+QzPoF+/KcdU1LL6ME6i+R7o7aiLOdDpZo4p5d1kr3VMNjVNM+L9ECpTntPhyrglOX018Q8xcNRh2/z+G6NsiiV4t0YxFdk/ICTQ== Jesse.Williamson@suse.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCXsBAd8JfyMT352SjfhZ2Nj3gR2PkeyPS9yB6fKck5CW0Ns1EcUAOIFYw7a1R6zCDJbkkXZDRgM1W6v/UBgpOm69HaNCZuqx19mQRNgo1lhw6hDHc+9754wOmIbgu3gInIS/XPvGzAkGwBW3rWlOaNurY4Y/PH1QyiaujD1Ii9X2Q6yRP8hsDrccual36gngY6wV3G4xKbS8kTY4qQekHkgFT+ZDHv9ibliDfAxtzm5X8N25sICpvcnQkG+Co3QP2XADEhoQrs8L7QekKYPlX8zq6rJBO0cGYW50E58LJk7s67n7QQPCy04xeAf9KOZZBSMHTI8eSFHjb8B034IkHH jwilliamson@linux-z0c6", "key_options": null, "keyfile": "/home/jwilliamson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jwilliamson", "validate_certs": true} 2019-11-28T21:39:44.052 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCmp/WxBoQxK/3bI3N9X4INmChIFtG/75NULYt9CAAnoOhFHe8xHMOU4x/YS6JdoIBJXusrjbDhCksFSK/caoOow9CQp3VWytslRSjfjkjbwwWHSdcyGpSO4lS5F32SgLOZBuyktpkLDgi6Ou5OTNKokJO8qiZo9Uw0rEBNakfsVi+fpysUDL792Jk1ROUr0HUpwqrQfTPZaue+PomXPQSYIqf06EH1nJYho6D4jt/g6U0qc66WTW5dXTkWD2VVQjZbFGkamz0ICHBJ/Xpf4TjWQVotsYD5NtbvqPo6ygpJYNhKR2n2zA+L4Zu2n0AEib5S4ftNxc7gNDCCfVs/EEIvXp/3CjKVPxHf4xUUPUZj+SQFnSUPQfeY1iIydoX+IG9oj5kKmQBdQFxbAaZJ679bORIqlH73dUFGr2rfS1UlIgPW5ll77bixsB0GP3+Jw4FF5QbO+k1d5qJpUw+8D6FbWAppP7hnSAok9PTpBqfkMpFiX00ZTIFwKCBLxdtJOfbIhbOPCnyEoB2ZLfRiBJmXhBpLjGghWIPPnGZh+yeJiy/EyKwN57vLmjdmvcDgSsjHswT+rQ+QzPoF+/KcdU1LL6ME6i+R7o7aiLOdDpZo4p5d1kr3VMNjVNM+L9ECpTntPhyrglOX018Q8xcNRh2/z+G6NsiiV4t0YxFdk/ICTQ== Jesse.Williamson@suse.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCXsBAd8JfyMT352SjfhZ2Nj3gR2PkeyPS9yB6fKck5CW0Ns1EcUAOIFYw7a1R6zCDJbkkXZDRgM1W6v/UBgpOm69HaNCZuqx19mQRNgo1lhw6hDHc+9754wOmIbgu3gInIS/XPvGzAkGwBW3rWlOaNurY4Y/PH1QyiaujD1Ii9X2Q6yRP8hsDrccual36gngY6wV3G4xKbS8kTY4qQekHkgFT+ZDHv9ibliDfAxtzm5X8N25sICpvcnQkG+Co3QP2XADEhoQrs8L7QekKYPlX8zq6rJBO0cGYW50E58LJk7s67n7QQPCy04xeAf9KOZZBSMHTI8eSFHjb8B034IkHH jwilliamson@linux-z0c6", "key_options": null, "keyfile": "/home/jwilliamson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jwilliamson", "validate_certs": true} 2019-11-28T21:39:44.137 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2019-11-28T21:39:44.139 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2019-11-28T21:39:44.413 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2019-11-28T21:39:44.415 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2019-11-28T21:39:44.476 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2019-11-28T21:39:44.776 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2019-11-28T21:39:44.788 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2019-11-28T21:39:45.127 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2019-11-28T21:39:45.149 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2019-11-28T21:39:45.150 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2019-11-28T21:39:45.491 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2019-11-28T21:39:45.493 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2019-11-28T21:39:45.502 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2019-11-28T21:39:45.835 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2019-11-28T21:39:45.846 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2019-11-28T21:39:46.162 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDC3aWYoBDxRh13e+qver2xcmCtNsiVEt9NkN1cntdUxVbjfWgb+E/b54kPW456tswoVaYS+3xI5DYTPTN1tMhx8jnrgVKI2HhIYC3SO0+V+HNofzU1p7v5CfZxwyupXOgdfHmEWKOepPop8qWon8wZVUkj2t80w8Ifxh5gLVigGquc4kvMLyy6nBI0k6UGeRr9lSKmWLvzudWP70cWij3ynwxEeIuurU0HI9tDmjaVW5dJuu6IZHDhJrCpeUZBQIDqjH0pg1i1uXXwwiLI9NW8jWuALREDeMxAG4IgOZtoXdS7J9vVXHxKpa8ofb+qYNXI7B3OTLgjSS2ziiU1KEIr wanjun.lp@alibaba-inc.com", "key_options": null, "keyfile": "/home/liupan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liupan", "validate_certs": true} 2019-11-28T21:39:46.173 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2019-11-28T21:39:46.512 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2019-11-28T21:39:46.523 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDC3aWYoBDxRh13e+qver2xcmCtNsiVEt9NkN1cntdUxVbjfWgb+E/b54kPW456tswoVaYS+3xI5DYTPTN1tMhx8jnrgVKI2HhIYC3SO0+V+HNofzU1p7v5CfZxwyupXOgdfHmEWKOepPop8qWon8wZVUkj2t80w8Ifxh5gLVigGquc4kvMLyy6nBI0k6UGeRr9lSKmWLvzudWP70cWij3ynwxEeIuurU0HI9tDmjaVW5dJuu6IZHDhJrCpeUZBQIDqjH0pg1i1uXXwwiLI9NW8jWuALREDeMxAG4IgOZtoXdS7J9vVXHxKpa8ofb+qYNXI7B3OTLgjSS2ziiU1KEIr wanjun.lp@alibaba-inc.com", "key_options": null, "keyfile": "/home/liupan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liupan", "validate_certs": true} 2019-11-28T21:39:46.865 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0PusmXbjqduPTosGmqFsi2cUjRIiWmMnATY/vuawopBxRNykGnyeh1MfVLgkulM6zBJ3cDZxLsZYykpsHGvaXgLL5r6bEOOKPu8sSMwaTfZWNewue6xa1vOYAggeWOt8KTd0IO/pZZfvFcJ80tjtcNvY8zOJ9TO5W7RpglfJhPneC9Kr726yZ4RX3Hqlx+nIMzrSlvZVtwsKikanImvGLDulRiHqgE5BcqGvDF1yCSIq4OYF2i2Sk+dnPnQtN2uePsxPYKikd0B/rua5q+hDDAz2I36NhaUIhLteE6acWJK5Z2s0o1rWAS5XMbF4qYM3nbaE1Au/nXHcjO3sf6mj3 amarangone@macair.local", "key_options": null, "keyfile": "/home/amarangone/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amarangone", "validate_certs": true} 2019-11-28T21:39:46.876 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2019-11-28T21:39:47.192 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0PusmXbjqduPTosGmqFsi2cUjRIiWmMnATY/vuawopBxRNykGnyeh1MfVLgkulM6zBJ3cDZxLsZYykpsHGvaXgLL5r6bEOOKPu8sSMwaTfZWNewue6xa1vOYAggeWOt8KTd0IO/pZZfvFcJ80tjtcNvY8zOJ9TO5W7RpglfJhPneC9Kr726yZ4RX3Hqlx+nIMzrSlvZVtwsKikanImvGLDulRiHqgE5BcqGvDF1yCSIq4OYF2i2Sk+dnPnQtN2uePsxPYKikd0B/rua5q+hDDAz2I36NhaUIhLteE6acWJK5Z2s0o1rWAS5XMbF4qYM3nbaE1Au/nXHcjO3sf6mj3 amarangone@macair.local", "key_options": null, "keyfile": "/home/amarangone/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amarangone", "validate_certs": true} 2019-11-28T21:39:47.204 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-11-28T21:39:47.530 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIGGibBaZykvZPLLQm/UIDUlqVxeyJvZEOO+/7pjqX3O47nilNILLnv/oWhQN1S5eGVev9lnTlTxqI0Mt0N/B9vbCxoxx3ujsSgc+FZL58rMBN4uaTvHhYgqOYo3ht6fciRqSvcqeOGNKU8HnXS0/C8bJrYoKUTnmaaZjQ0bSw/AMsAIxu3bZmWT+HfgVaMh9PjPgC+XnDypEcRkOLbeEIs+0s1TgSR7Hs/vEuVtLH3Ph4WZwKVKQhfugmbblLLNvHvTy0q5afdh2RQ9MEaUgxXMgVq4hJ/JcFNZp+ZU5irOPQosZfjSLWJKx/LH+Ye4/8nINi08w0MZgcK79CwukJ kmroz@suse.com", "key_options": null, "keyfile": "/home/kmroz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kmroz", "validate_certs": true} 2019-11-28T21:39:47.541 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-11-28T21:39:47.850 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2019-11-28T21:39:47.892 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIGGibBaZykvZPLLQm/UIDUlqVxeyJvZEOO+/7pjqX3O47nilNILLnv/oWhQN1S5eGVev9lnTlTxqI0Mt0N/B9vbCxoxx3ujsSgc+FZL58rMBN4uaTvHhYgqOYo3ht6fciRqSvcqeOGNKU8HnXS0/C8bJrYoKUTnmaaZjQ0bSw/AMsAIxu3bZmWT+HfgVaMh9PjPgC+XnDypEcRkOLbeEIs+0s1TgSR7Hs/vEuVtLH3Ph4WZwKVKQhfugmbblLLNvHvTy0q5afdh2RQ9MEaUgxXMgVq4hJ/JcFNZp+ZU5irOPQosZfjSLWJKx/LH+Ye4/8nINi08w0MZgcK79CwukJ kmroz@suse.com", "key_options": null, "keyfile": "/home/kmroz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kmroz", "validate_certs": true} 2019-11-28T21:39:48.167 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2019-11-28T21:39:48.230 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2019-11-28T21:39:48.515 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2019-11-28T21:39:48.578 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2019-11-28T21:39:48.858 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2019-11-28T21:39:48.914 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2019-11-28T21:39:49.162 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2019-11-28T21:39:49.228 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2019-11-28T21:39:49.507 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2019-11-28T21:39:49.508 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2019-11-28T21:39:49.830 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2019-11-28T21:39:49.861 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDf1IrqEe8zPM6DWf8Y+WLRU+TwX8Xzki1CQDRwK/w/F7qxAuh9cbX8tCTkZUt0L3pUjGpM1C3bkTzLHaN4bxK1RQ/klB7C3AXjNOJSPJSjcn/N3YuKU3sKWuQkXnQTwqUdTzHuZ8lQWywFItmwQR2Y6T+xG/Ecig+vdU5lwQ479gtt/lB9buI+T10Lefk2bUiYq1PmKSCIF4KtsIdmSazmIQyvsbsBVblMEezCC0auwo7P7SdfSaobf4x4ZZyJfYkVxiL6eGJ8vmBSbJFrcVMkAO07wBtpn/gQa3Dt4xUdXXt7zBizpMmRPLm8m3Pl2kIJhqrIa1cFXPRr5GJ0YXzR mu3e@Mu3e\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNisR+EK2sG/E9dSeoEYCfgzIunFnuu+SFWGyWR3K6Q5Evt7bVAsGnjglNXdVgLbGV4Il+Z+FFgtR/oJgtUZ7G0IwWKG+nlx06hOu2DObsgM7gcIlhrf7SNsI13Bit0v5dQkyLwcmpdwioQyUx5hnx8UamqVo7lLtKsHS8melz7JE/+dnGwIMJLB1Ot/8PIRAb+/NRXpnD/lje5u8idr43bhreuJ6Lell+h8X2vomuvLlA5XjAoROY6L5qKoM3+bD4QXbU006VHg/7wl9tpZIi9XwAuHfaktsmfks+u3eYFCd9nYUKN20zbEecoAA1rOrCF1qhgwTYpa/Rmh7Iy53p mu3e@thinkpad-t510", "key_options": null, "keyfile": "/home/adamyanova/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adamyanova", "validate_certs": true} 2019-11-28T21:39:50.183 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDf1IrqEe8zPM6DWf8Y+WLRU+TwX8Xzki1CQDRwK/w/F7qxAuh9cbX8tCTkZUt0L3pUjGpM1C3bkTzLHaN4bxK1RQ/klB7C3AXjNOJSPJSjcn/N3YuKU3sKWuQkXnQTwqUdTzHuZ8lQWywFItmwQR2Y6T+xG/Ecig+vdU5lwQ479gtt/lB9buI+T10Lefk2bUiYq1PmKSCIF4KtsIdmSazmIQyvsbsBVblMEezCC0auwo7P7SdfSaobf4x4ZZyJfYkVxiL6eGJ8vmBSbJFrcVMkAO07wBtpn/gQa3Dt4xUdXXt7zBizpMmRPLm8m3Pl2kIJhqrIa1cFXPRr5GJ0YXzR mu3e@Mu3e\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNisR+EK2sG/E9dSeoEYCfgzIunFnuu+SFWGyWR3K6Q5Evt7bVAsGnjglNXdVgLbGV4Il+Z+FFgtR/oJgtUZ7G0IwWKG+nlx06hOu2DObsgM7gcIlhrf7SNsI13Bit0v5dQkyLwcmpdwioQyUx5hnx8UamqVo7lLtKsHS8melz7JE/+dnGwIMJLB1Ot/8PIRAb+/NRXpnD/lje5u8idr43bhreuJ6Lell+h8X2vomuvLlA5XjAoROY6L5qKoM3+bD4QXbU006VHg/7wl9tpZIi9XwAuHfaktsmfks+u3eYFCd9nYUKN20zbEecoAA1rOrCF1qhgwTYpa/Rmh7Iy53p mu3e@thinkpad-t510", "key_options": null, "keyfile": "/home/adamyanova/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adamyanova", "validate_certs": true} 2019-11-28T21:39:50.205 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2019-11-28T21:39:50.505 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2019-11-28T21:39:50.516 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2019-11-28T21:39:50.786 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2019-11-28T21:39:50.849 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2019-11-28T21:39:51.129 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2019-11-28T21:39:51.186 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2019-11-28T21:39:51.458 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2019-11-28T21:39:51.532 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2019-11-28T21:39:51.795 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2019-11-28T21:39:51.835 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2019-11-28T21:39:52.154 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2019-11-28T21:39:52.166 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2019-11-28T21:39:52.501 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2019-11-28T21:39:52.512 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2019-11-28T21:39:52.815 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2019-11-28T21:39:52.858 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2019-11-28T21:39:53.162 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2019-11-28T21:39:53.202 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2019-11-28T21:39:53.486 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2019-11-28T21:39:53.530 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2019-11-28T21:39:53.830 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2019-11-28T21:39:53.852 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2019-11-28T21:39:54.166 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2019-11-28T21:39:54.198 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2019-11-28T21:39:54.522 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2019-11-28T21:39:54.533 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2019-11-28T21:39:54.855 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2019-11-28T21:39:54.856 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2019-11-28T21:39:55.180 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2019-11-28T21:39:55.182 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2019-11-28T21:39:55.482 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2019-11-28T21:39:55.484 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2019-11-28T21:39:55.525 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2019-11-28T21:39:55.526 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2019-11-28T21:39:55.838 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2019-11-28T21:39:55.840 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEJa/U9zUfZ7YFl0kwU7Mx3rHPn2O4sdh1J3XBUgoVdrJ4Qnh7i+QhN+fw0eaBWQE2GIsGEX6YWAL5xJ7EuYZyas8OVLNdP9cJIr79M51d8dG/ywqBpgcFnx7qhCSua3sKmP6GCTWGD9Y0eWL2Z6y9t3amb8dPXviMNqKGDz/DaDtp5bPaoG8mDHQ9QeADYYk3tx6V7+phIBXrI2GKt0BBlJeuZysiUI/XWO46JdMyHvCzvzcdquD446aoWS44waDGj501sgnHVQ7gwf4P1+vFOSEHzkWhbenpJmmTA26f4dim+Jo5JpBW/Ma5mMBvORFhH/Kt+S9P9sPCiF1shWc3 d@d", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2019-11-28T21:39:56.182 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEJa/U9zUfZ7YFl0kwU7Mx3rHPn2O4sdh1J3XBUgoVdrJ4Qnh7i+QhN+fw0eaBWQE2GIsGEX6YWAL5xJ7EuYZyas8OVLNdP9cJIr79M51d8dG/ywqBpgcFnx7qhCSua3sKmP6GCTWGD9Y0eWL2Z6y9t3amb8dPXviMNqKGDz/DaDtp5bPaoG8mDHQ9QeADYYk3tx6V7+phIBXrI2GKt0BBlJeuZysiUI/XWO46JdMyHvCzvzcdquD446aoWS44waDGj501sgnHVQ7gwf4P1+vFOSEHzkWhbenpJmmTA26f4dim+Jo5JpBW/Ma5mMBvORFhH/Kt+S9P9sPCiF1shWc3 d@d", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2019-11-28T21:39:56.183 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2019-11-28T21:39:56.504 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2019-11-28T21:39:56.515 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2019-11-28T21:39:56.816 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2019-11-28T21:39:56.848 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2019-11-28T21:39:57.158 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2019-11-28T21:39:57.231 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2019-11-28T21:39:57.481 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2019-11-28T21:39:57.585 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2019-11-28T21:39:57.798 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2019-11-28T21:39:57.908 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2019-11-28T21:39:58.085 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2019-11-28T21:39:58.242 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2019-11-28T21:39:58.440 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2019-11-28T21:39:58.587 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2019-11-28T21:39:58.777 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2019-11-28T21:39:58.902 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2019-11-28T21:39:59.119 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2019-11-28T21:39:59.223 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2019-11-28T21:39:59.451 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2019-11-28T21:39:59.575 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2019-11-28T21:39:59.771 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2019-11-28T21:39:59.926 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2019-11-28T21:40:00.102 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2019-11-28T21:40:00.237 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2019-11-28T21:40:00.423 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2019-11-28T21:40:00.583 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2019-11-28T21:40:00.585 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-11-28T21:40:00.755 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2019-11-28T21:40:00.756 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-11-28T21:40:00.911 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2019-11-28T21:40:01.087 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2019-11-28T21:40:01.212 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2019-11-28T21:40:01.323 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:01 +0000 (0:00:38.116) 0:01:31.135 ***** 2019-11-28T21:40:01.367 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-28T21:40:01.368 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:01.369 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:01.379 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:01.390 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:01.402 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:01.403 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:01.414 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:01.415 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:01.416 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** changed: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2019-11-28T21:40:01.491 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:01.528 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:01 +0000 (0:00:00.209) 0:01:31.344 ***** 2019-11-28T21:40:01.569 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:01.580 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:01.581 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:01.592 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:01.603 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:01.614 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:01.636 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:01.637 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:01.773 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2019-11-28T21:40:01.786 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:01.951 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2019-11-28T21:40:01.983 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:02.140 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2019-11-28T21:40:02.287 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2019-11-28T21:40:02.474 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "key_options": null, "keyfile": "/home/sbillah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sbillah", "validate_certs": true} 2019-11-28T21:40:02.620 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "key_options": null, "keyfile": "/home/sbillah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sbillah", "validate_certs": true} 2019-11-28T21:40:02.798 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2019-11-28T21:40:02.964 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2019-11-28T21:40:03.121 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2019-11-28T21:40:03.132 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.134 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.145 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.155 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.168 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.179 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.179 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.190 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.201 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.212 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.213 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.224 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.235 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.245 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.246 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.257 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.270 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.279 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.280 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2019-11-28T21:40:03.281 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.292 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.296 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c 2019-11-28T21:40:03.298 INFO:teuthology.task.ansible.out:19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.312 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.317 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.318 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.329 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.330 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.331 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.337 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.338 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.349 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.349 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.360 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.361 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.372 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.373 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.384 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.384 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.386 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.397 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.397 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.409 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.410 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.412 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.413 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.424 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.435 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.435 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.437 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.447 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.447 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.449 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.459 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.461 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.462 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.463 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.473 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.474 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.485 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.487 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.487 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.489 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.509 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.511 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.518 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "skip_reason": "Conditional result was False"} skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.524 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.525 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.536 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.537 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.547 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.548 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.549 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.559 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.560 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.572 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.572 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.577 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.584 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.585 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.596 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.597 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.599 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.600 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.611 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.613 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.623 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.625 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.626 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.627 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.637 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.638 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.648 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.649 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.660 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.661 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.663 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.673 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.674 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.686 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.704 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.710 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.711 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.713 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.724 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.726 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.736 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.738 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.739 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.740 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.750 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.751 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.763 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.764 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.765 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.767 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.779 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.788 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.790 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.792 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.793 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.804 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.805 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.820 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.821 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.822 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.824 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.836 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.837 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.838 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.849 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.850 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.851 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.865 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.867 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.867 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.880 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.887 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.894 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.894 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.912 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.915 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.916 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.918 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.919 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.931 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.932 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.933 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.935 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.945 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.946 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.948 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.949 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.960 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.962 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.973 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.975 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.976 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.977 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.988 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.989 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:03.990 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:04.000 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:04.001 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:04.014 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:04.016 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:04.017 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:04.019 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:04.049 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:04.050 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:04.051 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:04.053 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:04.092 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:04 +0000 (0:00:02.561) 0:01:33.906 ***** 2019-11-28T21:40:04.098 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:04.099 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:04.123 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:04.161 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:04 +0000 (0:00:00.070) 0:01:33.977 ***** 2019-11-28T21:40:04.199 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-28T21:40:04.200 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:04.210 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:04.221 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:04.222 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:04.233 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:04.244 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:04.255 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:04.255 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:04.267 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:04.279 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:04.280 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:04.291 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:04.302 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:04.313 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:04.314 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:04.381 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:04 +0000 (0:00:00.220) 0:01:34.197 ***** 2019-11-28T21:40:04.407 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2019-11-28T21:40:04.409 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:04.443 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:04 +0000 (0:00:00.061) 0:01:34.259 ***** 2019-11-28T21:40:04.510 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-28T21:40:04.512 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2019-11-28T21:40:04.790 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2019-11-28T21:40:04.843 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2019-11-28T21:40:05.124 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2019-11-28T21:40:05.166 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2019-11-28T21:40:05.405 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2019-11-28T21:40:05.438 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2019-11-28T21:40:05.668 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2019-11-28T21:40:05.772 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2019-11-28T21:40:05.970 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2019-11-28T21:40:06.098 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2019-11-28T21:40:06.306 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2019-11-28T21:40:06.425 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2019-11-28T21:40:06.653 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2019-11-28T21:40:06.748 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2019-11-28T21:40:06.966 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2019-11-28T21:40:07.060 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2019-11-28T21:40:07.292 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2019-11-28T21:40:07.395 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2019-11-28T21:40:07.594 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2019-11-28T21:40:07.741 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2019-11-28T21:40:07.928 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2019-11-28T21:40:08.056 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2019-11-28T21:40:08.254 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2019-11-28T21:40:08.368 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2019-11-28T21:40:08.566 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2019-11-28T21:40:08.690 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2019-11-28T21:40:08.876 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2019-11-28T21:40:09.010 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2019-11-28T21:40:09.209 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2019-11-28T21:40:09.323 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2019-11-28T21:40:09.510 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2019-11-28T21:40:09.654 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2019-11-28T21:40:09.795 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2019-11-28T21:40:09.966 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2019-11-28T21:40:10.090 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2019-11-28T21:40:10.276 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2019-11-28T21:40:10.410 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2019-11-28T21:40:10.607 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2019-11-28T21:40:10.731 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2019-11-28T21:40:10.950 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2019-11-28T21:40:11.054 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2019-11-28T21:40:11.271 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2019-11-28T21:40:11.335 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2019-11-28T21:40:11.603 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2019-11-28T21:40:11.656 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2019-11-28T21:40:11.905 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2019-11-28T21:40:11.989 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2019-11-28T21:40:12.217 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2019-11-28T21:40:12.331 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2019-11-28T21:40:12.507 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2019-11-28T21:40:12.622 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2019-11-28T21:40:12.842 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2019-11-28T21:40:12.961 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2019-11-28T21:40:13.176 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2019-11-28T21:40:13.229 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:13 +0000 (0:00:08.786) 0:01:43.045 ***** 2019-11-28T21:40:13.277 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2019-11-28T21:40:13.350 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:13 +0000 (0:00:00.120) 0:01:43.166 ***** 2019-11-28T21:40:14.260 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** changed: [smithi074.front.sepia.ceph.com] => {"changed": true, "checksum": "50650ef8f5fa65d26a4b4e7fa94b1571b873d967", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "f08a845f35203e506ea1deb151ba8443", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574977213.25-182440669258821/source", "state": "file", "uid": 0} 2019-11-28T21:40:14.298 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:14 +0000 (0:00:00.948) 0:01:44.115 ***** 2019-11-28T21:40:14.326 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2019-11-28T21:40:14.328 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => { "msg": "Host smithi074.front.sepia.ceph.com is running CentOS 7.6 (Core)" } 2019-11-28T21:40:14.368 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:14 +0000 (0:00:00.069) 0:01:44.184 ***** 2019-11-28T21:40:14.406 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2019-11-28T21:40:14.407 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => {"changed": true, "checksum": "50650ef8f5fa65d26a4b4e7fa94b1571b873d967", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "f08a845f35203e506ea1deb151ba8443", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574977213.37-170989659924368/source", "state": "file", "uid": 0} 2019-11-28T21:40:14.408 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** ok: [smithi074.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2019-11-28T21:40:14.450 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:14 +0000 (0:00:00.082) 0:01:44.267 ***** 2019-11-28T21:40:14.500 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:14 +0000 (0:00:00.049) 0:01:44.316 ***** 2019-11-28T21:40:14.507 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2019-11-28T21:40:14.508 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:14.550 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:14 +0000 (0:00:00.049) 0:01:44.366 ***** 2019-11-28T21:40:14.567 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2019-11-28T21:40:14.568 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => { "msg": "Host smithi141.front.sepia.ceph.com is running CentOS 7.6 (Core)" } 2019-11-28T21:40:14.612 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:14 +0000 (0:00:00.062) 0:01:44.428 ***** 2019-11-28T21:40:14.650 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2019-11-28T21:40:14.652 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2019-11-28T21:40:14.688 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:14 +0000 (0:00:00.076) 0:01:44.504 ***** 2019-11-28T21:40:14.717 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2019-11-28T21:40:14.719 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:14.755 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:14 +0000 (0:00:00.066) 0:01:44.571 ***** 2019-11-28T21:40:14.966 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2019-11-28T21:40:14.967 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.088914", "end": "2019-11-28 21:40:14.936829", "rc": 0, "start": "2019-11-28 21:40:14.847915", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2019-11-28T21:40:15.007 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:15 +0000 (0:00:00.251) 0:01:44.823 ***** 2019-11-28T21:40:15.034 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2019-11-28T21:40:15.036 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:15.076 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:15 +0000 (0:00:00.069) 0:01:44.892 ***** 2019-11-28T21:40:15.103 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2019-11-28T21:40:15.105 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:15.143 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:15 +0000 (0:00:00.066) 0:01:44.959 ***** 2019-11-28T21:40:15.150 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2019-11-28T21:40:15.151 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.088083", "end": "2019-11-28 21:40:15.120359", "rc": 0, "start": "2019-11-28 21:40:15.032276", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2019-11-28T21:40:15.191 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:15 +0000 (0:00:00.047) 0:01:45.007 ***** 2019-11-28T21:40:15.198 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:15.239 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:15 +0000 (0:00:00.047) 0:01:45.055 ***** 2019-11-28T21:40:15.245 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2019-11-28T21:40:15.246 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:15.284 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:15 +0000 (0:00:00.044) 0:01:45.100 ***** 2019-11-28T21:40:15.288 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2019-11-28T21:40:15.290 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:15.328 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:15 +0000 (0:00:00.044) 0:01:45.144 ***** 2019-11-28T21:40:15.334 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2019-11-28T21:40:15.337 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:15.374 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:15 +0000 (0:00:00.046) 0:01:45.190 ***** 2019-11-28T21:40:15.381 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:15.423 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:15 +0000 (0:00:00.048) 0:01:45.239 ***** 2019-11-28T21:40:15.436 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2019-11-28T21:40:15.438 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:15.484 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:15 +0000 (0:00:00.061) 0:01:45.300 ***** 2019-11-28T21:40:15.489 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2019-11-28T21:40:15.490 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:15.529 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:15 +0000 (0:00:00.044) 0:01:45.344 ***** 2019-11-28T21:40:15.532 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2019-11-28T21:40:15.534 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:15.574 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:15 +0000 (0:00:00.045) 0:01:45.390 ***** 2019-11-28T21:40:15.579 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2019-11-28T21:40:15.581 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi074.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-28T21:40:15.618 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:15 +0000 (0:00:00.043) 0:01:45.434 ***** 2019-11-28T21:40:15.623 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2019-11-28T21:40:15.625 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:15.663 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:15 +0000 (0:00:00.045) 0:01:45.479 ***** 2019-11-28T21:40:15.668 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2019-11-28T21:40:15.670 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:15.714 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:15 +0000 (0:00:00.045) 0:01:45.525 ***** 2019-11-28T21:40:15.715 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:15.752 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:15 +0000 (0:00:00.043) 0:01:45.568 ***** 2019-11-28T21:40:15.757 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:15.796 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:15 +0000 (0:00:00.044) 0:01:45.613 ***** 2019-11-28T21:40:15.802 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2019-11-28T21:40:15.803 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-28T21:40:15.804 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-28T21:40:15.847 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:15 +0000 (0:00:00.051) 0:01:45.664 ***** 2019-11-28T21:40:15.853 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2019-11-28T21:40:15.853 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-28T21:40:15.894 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:15 +0000 (0:00:00.046) 0:01:45.710 ***** 2019-11-28T21:40:15.899 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2019-11-28T21:40:15.901 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:15.938 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:15 +0000 (0:00:00.043) 0:01:45.754 ***** 2019-11-28T21:40:15.944 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2019-11-28T21:40:15.946 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:15.982 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:15 +0000 (0:00:00.044) 0:01:45.798 ***** 2019-11-28T21:40:15.987 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2019-11-28T21:40:15.989 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:16.025 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:16 +0000 (0:00:00.043) 0:01:45.842 ***** 2019-11-28T21:40:16.030 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2019-11-28T21:40:16.031 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-28T21:40:16.070 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:16 +0000 (0:00:00.044) 0:01:45.887 ***** 2019-11-28T21:40:16.075 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2019-11-28T21:40:16.077 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-28T21:40:16.112 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:16 +0000 (0:00:00.041) 0:01:45.928 ***** 2019-11-28T21:40:16.116 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2019-11-28T21:40:16.124 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:16.160 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:16 +0000 (0:00:00.047) 0:01:45.976 ***** 2019-11-28T21:40:16.165 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2019-11-28T21:40:16.167 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:16.202 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:16 +0000 (0:00:00.042) 0:01:46.019 ***** 2019-11-28T21:40:16.208 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:16.248 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:16 +0000 (0:00:00.045) 0:01:46.064 ***** 2019-11-28T21:40:16.254 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2019-11-28T21:40:16.256 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-28T21:40:16.292 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:16 +0000 (0:00:00.043) 0:01:46.108 ***** 2019-11-28T21:40:16.297 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2019-11-28T21:40:16.299 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:16.334 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:16 +0000 (0:00:00.042) 0:01:46.150 ***** 2019-11-28T21:40:16.340 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2019-11-28T21:40:16.342 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:16.381 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:16 +0000 (0:00:00.044) 0:01:46.195 ***** 2019-11-28T21:40:16.384 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2019-11-28T21:40:16.384 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:16.422 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:16 +0000 (0:00:00.043) 0:01:46.238 ***** 2019-11-28T21:40:16.428 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2019-11-28T21:40:16.429 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:16.466 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:16 +0000 (0:00:00.043) 0:01:46.282 ***** 2019-11-28T21:40:16.471 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2019-11-28T21:40:16.473 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-28T21:40:16.509 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:16 +0000 (0:00:00.043) 0:01:46.325 ***** 2019-11-28T21:40:16.523 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:16.551 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:16 +0000 (0:00:00.042) 0:01:46.368 ***** 2019-11-28T21:40:16.556 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2019-11-28T21:40:16.558 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:16.594 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:16 +0000 (0:00:00.042) 0:01:46.410 ***** 2019-11-28T21:40:16.600 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2019-11-28T21:40:16.602 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:16.639 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:16 +0000 (0:00:00.045) 0:01:46.456 ***** 2019-11-28T21:40:16.645 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2019-11-28T21:40:16.647 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:16.685 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:16 +0000 (0:00:00.045) 0:01:46.501 ***** 2019-11-28T21:40:16.692 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi141.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-28T21:40:16.729 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:16 +0000 (0:00:00.043) 0:01:46.545 ***** 2019-11-28T21:40:16.734 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2019-11-28T21:40:16.735 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:16.772 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:16 +0000 (0:00:00.043) 0:01:46.588 ***** 2019-11-28T21:40:16.778 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2019-11-28T21:40:16.780 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:16.816 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:16 +0000 (0:00:00.043) 0:01:46.632 ***** 2019-11-28T21:40:16.829 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:16.858 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:16 +0000 (0:00:00.041) 0:01:46.673 ***** 2019-11-28T21:40:16.862 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2019-11-28T21:40:16.863 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:16.900 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:16 +0000 (0:00:00.043) 0:01:46.717 ***** 2019-11-28T21:40:16.906 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2019-11-28T21:40:16.907 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:16.943 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:16 +0000 (0:00:00.042) 0:01:46.759 ***** 2019-11-28T21:40:16.948 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2019-11-28T21:40:16.950 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:16.988 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:16 +0000 (0:00:00.045) 0:01:46.804 ***** 2019-11-28T21:40:16.993 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2019-11-28T21:40:16.997 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:17.032 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:17 +0000 (0:00:00.044) 0:01:46.848 ***** 2019-11-28T21:40:17.037 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2019-11-28T21:40:17.039 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:17.077 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:17 +0000 (0:00:00.044) 0:01:46.893 ***** 2019-11-28T21:40:17.082 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2019-11-28T21:40:17.082 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-28T21:40:17.120 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:17 +0000 (0:00:00.043) 0:01:46.936 ***** 2019-11-28T21:40:17.125 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2019-11-28T21:40:17.126 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:17.164 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:17 +0000 (0:00:00.041) 0:01:46.977 ***** 2019-11-28T21:40:17.165 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2019-11-28T21:40:17.202 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:17 +0000 (0:00:00.040) 0:01:47.018 ***** 2019-11-28T21:40:17.207 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2019-11-28T21:40:17.209 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:17.252 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:17 +0000 (0:00:00.050) 0:01:47.068 ***** 2019-11-28T21:40:17.257 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2019-11-28T21:40:17.258 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:17.297 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:17 +0000 (0:00:00.044) 0:01:47.113 ***** 2019-11-28T21:40:17.303 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2019-11-28T21:40:17.303 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-28T21:40:17.341 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:17 +0000 (0:00:00.044) 0:01:47.157 ***** 2019-11-28T21:40:17.368 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2019-11-28T21:40:17.404 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:17 +0000 (0:00:00.063) 0:01:47.221 ***** 2019-11-28T21:40:17.444 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:17.479 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:17 +0000 (0:00:00.074) 0:01:47.296 ***** 2019-11-28T21:40:17.623 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2019-11-28T21:40:17.625 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-28T21:40:17.660 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:17 +0000 (0:00:00.179) 0:01:47.475 ***** 2019-11-28T21:40:17.810 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-28T21:40:17.855 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:17 +0000 (0:00:00.196) 0:01:47.672 ***** 2019-11-28T21:40:18.858 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2019-11-28T21:40:18.859 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "1d6dcd385d1b7c9c2b757c62b841c887e90d7f66", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 293, "state": "file", "uid": 0} 2019-11-28T21:40:18.882 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "1d6dcd385d1b7c9c2b757c62b841c887e90d7f66", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 293, "state": "file", "uid": 0} 2019-11-28T21:40:19.729 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "d9691278f687ee76cfe8a3de60fcbd4f1f79a8c6", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 327, "state": "file", "uid": 0} 2019-11-28T21:40:19.777 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:19 +0000 (0:00:01.921) 0:01:49.593 ***** 2019-11-28T21:40:19.787 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "d9691278f687ee76cfe8a3de60fcbd4f1f79a8c6", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 327, "state": "file", "uid": 0} 2019-11-28T21:40:19.835 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:19 +0000 (0:00:00.057) 0:01:49.651 ***** 2019-11-28T21:40:20.830 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* changed: [smithi141.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "73c387451a4fa299c9cb53e25b182ae50e8b8563", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "md5sum": "6467980f3cbb5aa63a3cfe239626f53e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 418, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574977219.81-2728331492118/source", "state": "file", "uid": 0} 2019-11-28T21:40:20.945 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "73c387451a4fa299c9cb53e25b182ae50e8b8563", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "md5sum": "6467980f3cbb5aa63a3cfe239626f53e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 418, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574977219.88-140463569209620/source", "state": "file", "uid": 0} 2019-11-28T21:40:21.935 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "9d25e11bf71dfd21a39ace708c03408897a4f263", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "md5sum": "0848bb8607c5b0c5706d8e1930fa7d55", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 474, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574977220.84-86741421986846/source", "state": "file", "uid": 0} 2019-11-28T21:40:21.975 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:21 +0000 (0:00:02.140) 0:01:51.791 ***** 2019-11-28T21:40:22.054 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "9d25e11bf71dfd21a39ace708c03408897a4f263", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "md5sum": "0848bb8607c5b0c5706d8e1930fa7d55", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 474, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574977220.96-136945732666678/source", "state": "file", "uid": 0} 2019-11-28T21:40:22.094 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:22 +0000 (0:00:00.119) 0:01:51.910 ***** 2019-11-28T21:40:22.540 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** 2019-11-28T21:40:22.541 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made", "warnings": ["Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually"]} 2019-11-28T21:40:22.563 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made", "warnings": ["Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually"]} 2019-11-28T21:40:22.834 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-11-28T21:40:22.836 INFO:teuthology.task.ansible.out: [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually 2019-11-28T21:40:22.875 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:22 +0000 (0:00:00.780) 0:01:52.691 ***** 2019-11-28T21:40:22.881 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-11-28T21:40:22.920 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:22 +0000 (0:00:00.045) 0:01:52.736 ***** 2019-11-28T21:40:36.280 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** 2019-11-28T21:40:36.281 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the file module with state=absent rather than running 'rm'. If you need to use command because file is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2019-11-28T21:40:36.282 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => {"changed": true, "cmd": "rm -rf /var/cache/yum/*; yum clean all; yum makecache", "delta": "0:00:13.030965", "end": "2019-11-28 21:40:36.253934", "rc": 0, "start": "2019-11-28 21:40:23.222969", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nCleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates\nLoaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirror.cogentco.com\n * extras: mirror.umd.edu\n * updates: mirror.wdc1.us.leaseweb.net\nMetadata Cache Created", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Cleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates", "Loaded plugins: fastestmirror, langpacks, priorities", "Determining fastest mirrors", " * base: mirror.cogentco.com", " * extras: mirror.umd.edu", " * updates: mirror.wdc1.us.leaseweb.net", "Metadata Cache Created"]} 2019-11-28T21:40:36.331 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:36 +0000 (0:00:13.411) 0:02:06.148 ***** 2019-11-28T21:40:36.683 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-11-28T21:40:36.685 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made"} 2019-11-28T21:40:36.978 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-11-28T21:40:37.016 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:37 +0000 (0:00:00.684) 0:02:06.832 ***** 2019-11-28T21:40:37.042 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-11-28T21:40:37.043 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:37.077 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:37 +0000 (0:00:00.061) 0:02:06.894 ***** 2019-11-28T21:40:37.103 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2019-11-28T21:40:37.105 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:37.140 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:37 +0000 (0:00:00.062) 0:02:06.956 ***** 2019-11-28T21:40:37.165 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2019-11-28T21:40:37.167 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:37.201 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:37 +0000 (0:00:00.060) 0:02:07.017 ***** 2019-11-28T21:40:37.234 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-11-28T21:40:37.235 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:37.270 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:37 +0000 (0:00:00.068) 0:02:07.086 ***** 2019-11-28T21:40:37.296 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2019-11-28T21:40:37.297 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:37.332 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:37 +0000 (0:00:00.062) 0:02:07.148 ***** 2019-11-28T21:40:37.357 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2019-11-28T21:40:37.359 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:37.394 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:37 +0000 (0:00:00.061) 0:02:07.210 ***** 2019-11-28T21:40:37.419 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2019-11-28T21:40:37.421 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:37.457 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:37 +0000 (0:00:00.063) 0:02:07.274 ***** 2019-11-28T21:40:37.483 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2019-11-28T21:40:37.485 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:37.521 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:37 +0000 (0:00:00.063) 0:02:07.338 ***** 2019-11-28T21:40:37.788 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** 2019-11-28T21:40:37.789 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => {"changed": true, "cmd": "rm -rf /var/cache/yum/*; yum clean all; yum makecache", "delta": "0:00:14.605394", "end": "2019-11-28 21:40:37.761516", "rc": 0, "start": "2019-11-28 21:40:23.156122", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nCleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates\nLoaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirror.cogentco.com\n * extras: mirror.ash.fastserv.com\n * updates: mirror.wdc1.us.leaseweb.net\nMetadata Cache Created", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Cleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates", "Loaded plugins: fastestmirror, langpacks, priorities", "Determining fastest mirrors", " * base: mirror.cogentco.com", " * extras: mirror.ash.fastserv.com", " * updates: mirror.wdc1.us.leaseweb.net", "Metadata Cache Created"]} 2019-11-28T21:40:37.826 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:37 +0000 (0:00:00.304) 0:02:07.643 ***** 2019-11-28T21:40:38.161 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-11-28T21:40:38.161 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made"} 2019-11-28T21:40:38.464 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-11-28T21:40:38.504 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:38 +0000 (0:00:00.677) 0:02:08.320 ***** 2019-11-28T21:40:38.531 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2019-11-28T21:40:38.532 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.706353", "end": "2019-11-28 21:40:38.500493", "rc": 0, "start": "2019-11-28 21:40:37.794140", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T21:40:38.533 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:38.570 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:38 +0000 (0:00:00.066) 0:02:08.386 ***** 2019-11-28T21:40:38.604 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:38 +0000 (0:00:00.033) 0:02:08.420 ***** 2019-11-28T21:40:38.631 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2019-11-28T21:40:38.633 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:38.677 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:38 +0000 (0:00:00.072) 0:02:08.493 ***** 2019-11-28T21:40:38.703 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2019-11-28T21:40:38.705 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:38.746 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:38 +0000 (0:00:00.068) 0:02:08.562 ***** 2019-11-28T21:40:38.773 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-11-28T21:40:38.774 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:38.811 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:38 +0000 (0:00:00.065) 0:02:08.627 ***** 2019-11-28T21:40:38.839 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2019-11-28T21:40:38.844 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:38.880 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:38 +0000 (0:00:00.069) 0:02:08.697 ***** 2019-11-28T21:40:38.910 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2019-11-28T21:40:38.911 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:38.954 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:38 +0000 (0:00:00.073) 0:02:08.770 ***** 2019-11-28T21:40:38.980 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2019-11-28T21:40:38.981 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:39.021 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:39 +0000 (0:00:00.067) 0:02:08.838 ***** 2019-11-28T21:40:39.047 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2019-11-28T21:40:39.049 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:39.084 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:39 +0000 (0:00:00.062) 0:02:08.900 ***** 2019-11-28T21:40:39.412 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2019-11-28T21:40:39.413 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["krb5-workstation-1.15.1-37.el7_7.2.x86_64 providing krb5-workstation is already installed"]} 2019-11-28T21:40:39.458 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:39 +0000 (0:00:00.374) 0:02:09.274 ***** 2019-11-28T21:40:39.487 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:39.522 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:39 +0000 (0:00:00.063) 0:02:09.338 ***** 2019-11-28T21:40:39.549 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2019-11-28T21:40:39.550 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:39.586 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:39 +0000 (0:00:00.063) 0:02:09.402 ***** 2019-11-28T21:40:39.612 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2019-11-28T21:40:39.613 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:39.657 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:39 +0000 (0:00:00.071) 0:02:09.474 ***** 2019-11-28T21:40:39.683 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2019-11-28T21:40:39.685 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:39.721 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:39 +0000 (0:00:00.063) 0:02:09.537 ***** 2019-11-28T21:40:40.534 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2019-11-28T21:40:40.535 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:01.118238", "end": "2019-11-28 21:40:40.500472", "rc": 0, "start": "2019-11-28 21:40:39.382234", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T21:40:40.571 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:40 +0000 (0:00:00.849) 0:02:10.387 ***** 2019-11-28T21:40:40.575 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2019-11-28T21:40:40.576 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2019-11-28T21:40:40.615 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:40 +0000 (0:00:00.044) 0:02:10.432 ***** 2019-11-28T21:40:41.067 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2019-11-28T21:40:41.068 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["krb5-workstation-1.15.1-37.el7_7.2.x86_64 providing krb5-workstation is already installed"]} 2019-11-28T21:40:41.112 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:41 +0000 (0:00:00.488) 0:02:10.920 ***** 2019-11-28T21:40:41.129 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2019-11-28T21:40:41.131 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:41.165 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:41 +0000 (0:00:00.061) 0:02:10.981 ***** 2019-11-28T21:40:41.191 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2019-11-28T21:40:41.192 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:41.226 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:41 +0000 (0:00:00.061) 0:02:11.042 ***** 2019-11-28T21:40:41.251 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2019-11-28T21:40:41.252 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:41.287 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:41 +0000 (0:00:00.060) 0:02:11.103 ***** 2019-11-28T21:40:41.312 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2019-11-28T21:40:41.314 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:41.348 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:41 +0000 (0:00:00.061) 0:02:11.165 ***** 2019-11-28T21:40:42.216 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2019-11-28T21:40:42.217 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2019-11-28T21:40:42.254 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:42 +0000 (0:00:00.905) 0:02:12.070 ***** 2019-11-28T21:40:44.485 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing smartmontools are up to date", ""]} 2019-11-28T21:40:44.522 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:44 +0000 (0:00:02.267) 0:02:14.338 ***** 2019-11-28T21:40:45.427 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-11-28T21:40:45.427 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2019-11-28T21:40:46.050 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2019-11-28T21:40:46.052 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing smartmontools are up to date", ""]} 2019-11-28T21:40:46.120 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:46 +0000 (0:00:01.598) 0:02:15.936 ***** 2019-11-28T21:40:46.261 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-11-28T21:40:46.261 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2019-11-28T21:40:47.066 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2019-11-28T21:40:47.129 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2019-11-28T21:40:47.185 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:47 +0000 (0:00:01.065) 0:02:17.002 ***** 2019-11-28T21:40:47.495 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2019-11-28T21:40:47.495 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-28T21:40:47.532 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:47 +0000 (0:00:00.346) 0:02:17.348 ***** 2019-11-28T21:40:47.933 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi141.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2019-11-28T21:40:48.409 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-11-28T21:40:48.411 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2019-11-28T21:40:48.772 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi141.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2019-11-28T21:40:48.813 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:48 +0000 (0:00:01.280) 0:02:18.629 ***** 2019-11-28T21:40:49.118 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-28T21:40:49.160 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:49 +0000 (0:00:00.346) 0:02:18.976 ***** 2019-11-28T21:40:49.234 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi074.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2019-11-28T21:40:50.045 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2019-11-28T21:40:50.086 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:50 +0000 (0:00:00.926) 0:02:19.902 ***** 2019-11-28T21:40:50.093 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2019-11-28T21:40:50.115 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:50.160 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:50 +0000 (0:00:00.074) 0:02:19.976 ***** 2019-11-28T21:40:50.209 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2019-11-28T21:40:50.211 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2019-11-28T21:40:50.252 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:50 +0000 (0:00:00.091) 0:02:20.068 ***** 2019-11-28T21:40:50.586 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* changed: [smithi074.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-11-28T21:40:50.630 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:50 +0000 (0:00:00.378) 0:02:20.446 ***** 2019-11-28T21:40:50.793 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2019-11-28T21:40:50.795 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-28T21:40:50.812 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-28T21:40:50.822 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-28T21:40:50.833 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-28T21:40:50.877 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:50 +0000 (0:00:00.246) 0:02:20.693 ***** 2019-11-28T21:40:50.914 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-11-28T21:40:50.915 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2019-11-28T21:40:51.766 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2019-11-28T21:40:51.815 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:51 +0000 (0:00:00.938) 0:02:21.631 ***** 2019-11-28T21:40:51.969 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2019-11-28T21:40:51.971 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:52.007 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:52 +0000 (0:00:00.192) 0:02:21.823 ***** 2019-11-28T21:40:52.171 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2019-11-28T21:40:52.173 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2019-11-28T21:40:52.324 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:52 +0000 (0:00:00.317) 0:02:22.141 ***** 2019-11-28T21:40:52.644 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2019-11-28T21:40:52.646 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-11-28T21:40:52.685 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:52 +0000 (0:00:00.360) 0:02:22.501 ***** 2019-11-28T21:40:52.733 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2019-11-28T21:40:52.734 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-28T21:40:52.746 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-28T21:40:52.756 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-28T21:40:52.769 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-28T21:40:52.807 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:52 +0000 (0:00:00.121) 0:02:22.623 ***** 2019-11-28T21:40:54.263 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing nagios-common are up to date", "All packages providing nrpe are up to date", "All packages providing nagios-plugins are up to date", "All packages providing nagios-plugins-load are up to date", ""]} 2019-11-28T21:40:54.302 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:54 +0000 (0:00:01.494) 0:02:24.118 ***** 2019-11-28T21:40:54.330 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** 2019-11-28T21:40:54.331 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:54.369 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:54 +0000 (0:00:00.067) 0:02:24.186 ***** 2019-11-28T21:40:55.272 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2019-11-28T21:40:55.273 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2019-11-28T21:40:55.309 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:55 +0000 (0:00:00.939) 0:02:25.125 ***** 2019-11-28T21:40:56.185 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2019-11-28T21:40:56.187 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2019-11-28T21:40:56.223 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:56 +0000 (0:00:00.914) 0:02:26.039 ***** 2019-11-28T21:40:56.230 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2019-11-28T21:40:56.231 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing nagios-common are up to date", "All packages providing nrpe are up to date", "All packages providing nagios-plugins are up to date", "All packages providing nagios-plugins-load are up to date", ""]} 2019-11-28T21:40:56.270 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:56 +0000 (0:00:00.047) 0:02:26.086 ***** 2019-11-28T21:40:56.277 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2019-11-28T21:40:56.278 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:56.318 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:56 +0000 (0:00:00.047) 0:02:26.134 ***** 2019-11-28T21:40:56.324 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** 2019-11-28T21:40:56.324 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:56.363 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:56 +0000 (0:00:00.044) 0:02:26.179 ***** 2019-11-28T21:40:56.629 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2019-11-28T21:40:56.629 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-28T21:40:56.668 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:56 +0000 (0:00:00.304) 0:02:26.484 ***** 2019-11-28T21:40:57.017 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2019-11-28T21:40:57.019 INFO:teuthology.task.ansible.out:fatal: [smithi074.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2019-11-28T21:40:57.063 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:57 +0000 (0:00:00.395) 0:02:26.880 ***** 2019-11-28T21:40:57.091 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2019-11-28T21:40:57.093 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:57.130 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:57 +0000 (0:00:00.066) 0:02:26.946 ***** 2019-11-28T21:40:57.266 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2019-11-28T21:40:57.305 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:57 +0000 (0:00:00.175) 0:02:27.121 ***** 2019-11-28T21:40:58.070 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2019-11-28T21:40:58.071 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2019-11-28T21:40:58.110 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:58 +0000 (0:00:00.805) 0:02:27.927 ***** 2019-11-28T21:40:58.248 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2019-11-28T21:40:58.249 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2019-11-28T21:40:58.286 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:58 +0000 (0:00:00.175) 0:02:28.102 ***** 2019-11-28T21:40:58.313 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2019-11-28T21:40:58.314 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:58.348 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:58 +0000 (0:00:00.062) 0:02:28.165 ***** 2019-11-28T21:40:58.660 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2019-11-28T21:40:58.661 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-28T21:40:58.699 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:58 +0000 (0:00:00.350) 0:02:28.515 ***** 2019-11-28T21:40:58.957 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2019-11-28T21:40:58.959 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2019-11-28 21:37:56 UTC", "ActiveEnterTimestampMonotonic": "21408592", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "var-run.mount nss-lookup.target network.target systemd-journald.socket system.slice basic.target time-sync.target local-fs.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Thu 2019-11-28 21:37:56 UTC", "AssertTimestampMonotonic": "21407687", "Before": "multi-user.target xdm.service shutdown.target getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2019-11-28 21:37:56 UTC", "ConditionTimestampMonotonic": "21407686", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Program Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "EnvironmentFile": "/etc/sysconfig/nrpe (ignore_errors=no)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8969", "ExecMainStartTimestamp": "Thu 2019-11-28 21:37:56 UTC", "ExecMainStartTimestampMonotonic": "21408516", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_err 2019-11-28T21:40:58.963 INFO:teuthology.task.ansible.out:ors=no ; start_time=[Thu 2019-11-28 21:37:56 UTC] ; stop_time=[n/a] ; pid=8969 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "Group": "nrpe", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2019-11-28 21:37:56 UTC", "InactiveExitTimestampMonotonic": "21408592", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127510", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127510", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "8969", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "network-online.target basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOn 2019-11-28T21:40:58.965 INFO:teuthology.task.ansible.out:ly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestamp": "Thu 2019-11-28 21:37:56 UTC", "WatchdogTimestampMonotonic": "21408562", "WatchdogUSec": "0"}} 2019-11-28T21:40:59.000 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:58 +0000 (0:00:00.297) 0:02:28.812 ***** 2019-11-28T21:40:59.054 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2019-11-28T21:40:59.055 INFO:teuthology.task.ansible.out:fatal: [smithi141.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2019-11-28T21:40:59.109 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:59 +0000 (0:00:00.113) 0:02:28.925 ***** 2019-11-28T21:40:59.137 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2019-11-28T21:40:59.138 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:40:59.176 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:59 +0000 (0:00:00.066) 0:02:28.992 ***** 2019-11-28T21:40:59.318 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* changed: [smithi074.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.004655", "end": "2019-11-28 21:40:59.295263", "rc": 0, "start": "2019-11-28 21:40:59.290608", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2019-11-28T21:40:59.356 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:59 +0000 (0:00:00.180) 0:02:29.172 ***** 2019-11-28T21:40:59.861 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["libsemanage-python-2.5-14.el7.x86_64 providing libsemanage-python is already installed", "policycoreutils-python-2.5-29.el7.x86_64 providing policycoreutils-python is already installed"]} 2019-11-28T21:40:59.900 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:40:59 +0000 (0:00:00.543) 0:02:29.716 ***** 2019-11-28T21:41:00.094 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2019-11-28T21:41:00.095 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2019-11-28T21:41:00.140 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:00 +0000 (0:00:00.240) 0:02:29.956 ***** 2019-11-28T21:41:00.585 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2019-11-28T21:41:00.588 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2019-11-28 21:37:55 UTC", "ActiveEnterTimestampMonotonic": "22000830", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target system.slice systemd-journald.socket var-run.mount network.target nss-lookup.target local-fs.target time-sync.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Thu 2019-11-28 21:37:55 UTC", "AssertTimestampMonotonic": "22000126", "Before": "xdm.service shutdown.target getty@tty1.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2019-11-28 21:37:55 UTC", "ConditionTimestampMonotonic": "22000123", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Program Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "EnvironmentFile": "/etc/sysconfig/nrpe (ignore_errors=no)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8939", "ExecMainStartTimestamp": "Thu 2019-11-28 21:37:55 UTC", "ExecMainStartTimestampMonotonic": "22000784", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_err 2019-11-28T21:41:00.589 INFO:teuthology.task.ansible.out:ors=no ; start_time=[Thu 2019-11-28 21:37:55 UTC] ; stop_time=[n/a] ; pid=8939 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "Group": "nrpe", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2019-11-28 21:37:55 UTC", "InactiveExitTimestampMonotonic": "22000830", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "8939", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target network-online.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOn 2019-11-28T21:41:00.591 INFO:teuthology.task.ansible.out:ly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestamp": "Thu 2019-11-28 21:37:55 UTC", "WatchdogTimestampMonotonic": "22000813", "WatchdogUSec": "0"}} 2019-11-28T21:41:00.628 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:00 +0000 (0:00:00.487) 0:02:30.444 ***** 2019-11-28T21:41:00.957 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2019-11-28T21:41:00.959 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.004697", "end": "2019-11-28 21:41:00.928230", "rc": 0, "start": "2019-11-28 21:41:00.923533", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2019-11-28T21:41:00.995 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:00 +0000 (0:00:00.367) 0:02:30.811 ***** 2019-11-28T21:41:01.466 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2019-11-28T21:41:01.468 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["libsemanage-python-2.5-14.el7.x86_64 providing libsemanage-python is already installed", "policycoreutils-python-2.5-29.el7.x86_64 providing policycoreutils-python is already installed"]} 2019-11-28T21:41:01.503 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:01 +0000 (0:00:00.507) 0:02:31.319 ***** 2019-11-28T21:41:02.305 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2019-11-28T21:41:02.306 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing selinux-policy-targeted are up to date", ""]} 2019-11-28T21:41:02.343 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:02 +0000 (0:00:00.840) 0:02:32.160 ***** 2019-11-28T21:41:03.762 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2019-11-28T21:41:03.764 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2019-11-28T21:41:03.801 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:03 +0000 (0:00:01.457) 0:02:33.617 ***** 2019-11-28T21:41:03.944 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2019-11-28T21:41:03.944 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing selinux-policy-targeted are up to date", ""]} 2019-11-28T21:41:03.989 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:03 +0000 (0:00:00.187) 0:02:33.805 ***** 2019-11-28T21:41:06.819 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2019-11-28T21:41:06.857 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:06 +0000 (0:00:02.867) 0:02:36.673 ***** 2019-11-28T21:41:12.751 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2019-11-28T21:41:12.752 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:08.615214", "end": "2019-11-28 21:41:12.714241", "failed_when_result": false, "rc": 0, "start": "2019-11-28 21:41:04.099027", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2019-11-28T21:41:12.792 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:12 +0000 (0:00:05.935) 0:02:42.608 ***** 2019-11-28T21:41:13.773 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2019-11-28T21:41:13.774 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2019-11-28T21:41:13.829 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:13 +0000 (0:00:01.036) 0:02:43.645 ***** 2019-11-28T21:41:14.155 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2019-11-28T21:41:14.156 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.020824", "end": "2019-11-28 21:41:14.127584", "rc": 0, "start": "2019-11-28 21:41:14.106760", "stderr": "", "stderr_lines": [], "stdout": "checkmodule: loading policy configuration from /tmp/nrpe.te\ncheckmodule: policy configuration loaded\ncheckmodule: writing binary representation (version 19) to /tmp/nrpe.mod", "stdout_lines": ["checkmodule: loading policy configuration from /tmp/nrpe.te", "checkmodule: policy configuration loaded", "checkmodule: writing binary representation (version 19) to /tmp/nrpe.mod"]} 2019-11-28T21:41:14.199 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:14 +0000 (0:00:00.369) 0:02:44.015 ***** 2019-11-28T21:41:14.510 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2019-11-28T21:41:14.511 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.017262", "end": "2019-11-28 21:41:14.485504", "rc": 0, "start": "2019-11-28 21:41:14.468242", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T21:41:14.552 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:14 +0000 (0:00:00.353) 0:02:44.368 ***** 2019-11-28T21:41:15.082 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2019-11-28T21:41:15.084 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:07.904860", "end": "2019-11-28 21:41:15.052976", "failed_when_result": false, "rc": 0, "start": "2019-11-28 21:41:07.148116", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2019-11-28T21:41:15.137 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:15 +0000 (0:00:00.585) 0:02:44.953 ***** 2019-11-28T21:41:16.098 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2019-11-28T21:41:16.100 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2019-11-28T21:41:16.137 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:16 +0000 (0:00:00.999) 0:02:45.953 ***** 2019-11-28T21:41:16.497 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2019-11-28T21:41:16.498 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.017531", "end": "2019-11-28 21:41:16.469939", "rc": 0, "start": "2019-11-28 21:41:16.452408", "stderr": "", "stderr_lines": [], "stdout": "checkmodule: loading policy configuration from /tmp/nrpe.te\ncheckmodule: policy configuration loaded\ncheckmodule: writing binary representation (version 19) to /tmp/nrpe.mod", "stdout_lines": ["checkmodule: loading policy configuration from /tmp/nrpe.te", "checkmodule: policy configuration loaded", "checkmodule: writing binary representation (version 19) to /tmp/nrpe.mod"]} 2019-11-28T21:41:16.558 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:16 +0000 (0:00:00.421) 0:02:46.374 ***** 2019-11-28T21:41:16.901 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2019-11-28T21:41:16.902 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.016245", "end": "2019-11-28 21:41:16.871700", "rc": 0, "start": "2019-11-28 21:41:16.855455", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T21:41:16.962 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:16 +0000 (0:00:00.404) 0:02:46.779 ***** 2019-11-28T21:41:22.707 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2019-11-28T21:41:22.709 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:07.837895", "end": "2019-11-28 21:41:22.671210", "rc": 0, "start": "2019-11-28 21:41:14.833315", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T21:41:22.748 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:22 +0000 (0:00:05.785) 0:02:52.564 ***** 2019-11-28T21:41:23.109 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2019-11-28T21:41:23.111 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2019-11-28T21:41:23.150 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:23 +0000 (0:00:00.401) 0:02:52.966 ***** 2019-11-28T21:41:23.184 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** ok: [smithi074.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/yum_systems.yml"], "changed": false} 2019-11-28T21:41:23.221 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:23 +0000 (0:00:00.071) 0:02:53.037 ***** 2019-11-28T21:41:23.260 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2019-11-28T21:41:23.262 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-11-28T21:41:23.300 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:23 +0000 (0:00:00.078) 0:02:53.116 ***** 2019-11-28T21:41:23.339 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2019-11-28T21:41:23.340 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml) => {"ansible_facts": {"epel_packages": ["cryptopp-devel", "cryptopp", "fcgi", "dbench", "fuse-sshfs", "bonnie++", "perl-JSON-XS"], "packages": ["@core", "@base", "yum-plugin-priorities", "yum-plugin-fastestmirror", "redhat-lsb", "sysstat", "gdb", "git-all", "python-configobj", "gcc-c++", "libedit", "openssl098e", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse", "fuse-libs", "python-virtualenv", "openssl", "libuuid", "btrfs-progs", "attr", "valgrind", "python-nose", "mpich", "podman", "ant", "iozone", "libtool", "automake", "gettext", "libuuid-devel", "libacl-devel", "bc", "xfsdump", "xfsprogs-devel", "blktrace", "numpy", "python-matplotlib", "qemu-kvm", "usbredir", "genisoimage", "httpd", "httpd-devel", "httpd-tools", "mod_ssl", "mod_fastcgi-2.4.7-1.ceph.el7.centos", "libev-devel", "perl-XML-Twig", "java-1.6.0-openjdk-devel", "junit4", "nfs-utils", "ncurses-devel", "python-devel", "python-virtualenv", "perl-CPAN"], "yum_repos": {"centos7-fcgi-ceph": {"baseurl": "http://{{ gitbuilder_host }}/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}, "lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"} 2019-11-28T21:41:23.380 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:23 +0000 (0:00:00.080) 0:02:53.196 ***** 2019-11-28T21:41:23.431 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [smithi074.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-11-28T21:41:23.469 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:23 +0000 (0:00:00.088) 0:02:53.285 ***** 2019-11-28T21:41:23.813 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2019-11-28T21:41:23.816 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-11-28T21:41:23.850 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:23 +0000 (0:00:00.381) 0:02:53.666 ***** 2019-11-28T21:41:24.181 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "name": "ubuntu", "state": "present", "system": false} 2019-11-28T21:41:24.219 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:24 +0000 (0:00:00.368) 0:02:54.035 ***** 2019-11-28T21:41:24.245 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2019-11-28T21:41:24.248 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:41:24.284 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:24 +0000 (0:00:00.065) 0:02:54.101 ***** 2019-11-28T21:41:24.311 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2019-11-28T21:41:24.312 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:41:24.349 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:24 +0000 (0:00:00.064) 0:02:54.165 ***** 2019-11-28T21:41:24.714 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2019-11-28T21:41:24.716 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2019-11-28T21:41:24.752 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:24 +0000 (0:00:00.403) 0:02:54.568 ***** 2019-11-28T21:41:25.313 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2019-11-28T21:41:25.314 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:08.044871", "end": "2019-11-28 21:41:25.282679", "rc": 0, "start": "2019-11-28 21:41:17.237808", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T21:41:25.354 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:25 +0000 (0:00:00.601) 0:02:55.170 ***** 2019-11-28T21:41:25.689 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2019-11-28T21:41:25.694 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2019-11-28T21:41:25.730 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:25 +0000 (0:00:00.376) 0:02:55.546 ***** 2019-11-28T21:41:25.757 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2019-11-28T21:41:25.758 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/yum_systems.yml"], "changed": false} 2019-11-28T21:41:25.800 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:25 +0000 (0:00:00.070) 0:02:55.616 ***** 2019-11-28T21:41:25.806 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2019-11-28T21:41:25.807 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2019-11-28T21:41:25.846 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:25 +0000 (0:00:00.045) 0:02:55.662 ***** 2019-11-28T21:41:25.851 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2019-11-28T21:41:25.853 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-11-28T21:41:25.895 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:25 +0000 (0:00:00.048) 0:02:55.711 ***** 2019-11-28T21:41:25.900 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2019-11-28T21:41:25.901 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi074"}, "changed": false} 2019-11-28T21:41:25.945 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:25 +0000 (0:00:00.050) 0:02:55.761 ***** 2019-11-28T21:41:25.952 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2019-11-28T21:41:25.953 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml) => {"ansible_facts": {"epel_packages": ["cryptopp-devel", "cryptopp", "fcgi", "dbench", "fuse-sshfs", "bonnie++", "perl-JSON-XS"], "packages": ["@core", "@base", "yum-plugin-priorities", "yum-plugin-fastestmirror", "redhat-lsb", "sysstat", "gdb", "git-all", "python-configobj", "gcc-c++", "libedit", "openssl098e", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse", "fuse-libs", "python-virtualenv", "openssl", "libuuid", "btrfs-progs", "attr", "valgrind", "python-nose", "mpich", "podman", "ant", "iozone", "libtool", "automake", "gettext", "libuuid-devel", "libacl-devel", "bc", "xfsdump", "xfsprogs-devel", "blktrace", "numpy", "python-matplotlib", "qemu-kvm", "usbredir", "genisoimage", "httpd", "httpd-devel", "httpd-tools", "mod_ssl", "mod_fastcgi-2.4.7-1.ceph.el7.centos", "libev-devel", "perl-XML-Twig", "java-1.6.0-openjdk-devel", "junit4", "nfs-utils", "ncurses-devel", "python-devel", "python-virtualenv", "perl-CPAN"], "yum_repos": {"centos7-fcgi-ceph": {"baseurl": "http://{{ gitbuilder_host }}/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}, "lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"} 2019-11-28T21:41:25.995 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:25 +0000 (0:00:00.049) 0:02:55.811 ***** 2019-11-28T21:41:26.044 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2019-11-28T21:41:26.045 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-11-28T21:41:26.087 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:26 +0000 (0:00:00.092) 0:02:55.903 ***** 2019-11-28T21:41:26.415 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-11-28T21:41:26.456 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:26 +0000 (0:00:00.369) 0:02:56.273 ***** 2019-11-28T21:41:26.774 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2019-11-28T21:41:26.776 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "name": "ubuntu", "state": "present", "system": false} 2019-11-28T21:41:26.818 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:26 +0000 (0:00:00.361) 0:02:56.634 ***** 2019-11-28T21:41:26.846 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2019-11-28T21:41:26.848 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:41:26.884 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:26 +0000 (0:00:00.066) 0:02:56.701 ***** 2019-11-28T21:41:26.911 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2019-11-28T21:41:26.913 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:41:26.950 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:26 +0000 (0:00:00.065) 0:02:56.766 ***** 2019-11-28T21:41:26.956 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2019-11-28T21:41:26.956 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi074.front.sepia.ceph.com", "ansible_hostname": "smithi074", "ansible_nodename": "smithi074"}, "changed": true, "name": "smithi074"} 2019-11-28T21:41:26.996 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:26 +0000 (0:00:00.045) 0:02:56.812 ***** 2019-11-28T21:41:27.314 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2019-11-28T21:41:27.314 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2019-11-28T21:41:27.360 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:27 +0000 (0:00:00.363) 0:02:57.176 ***** 2019-11-28T21:41:27.944 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2019-11-28T21:41:27.946 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "checksum": "28e3f1fe12efa510f1199f3ab5f2a5a0feb586ff", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1042, "state": "file", "uid": 0} 2019-11-28T21:41:27.983 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:27 +0000 (0:00:00.622) 0:02:57.798 ***** 2019-11-28T21:41:28.388 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2019-11-28T21:41:28.391 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2019-11-28T21:41:28.437 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:28 +0000 (0:00:00.449) 0:02:58.247 ***** 2019-11-28T21:41:28.468 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2019-11-28T21:41:28.470 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi141"}, "changed": false} 2019-11-28T21:41:28.507 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:28 +0000 (0:00:00.075) 0:02:58.323 ***** 2019-11-28T21:41:28.905 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2019-11-28T21:41:28.961 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:28 +0000 (0:00:00.454) 0:02:58.777 ***** 2019-11-28T21:41:29.053 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2019-11-28T21:41:29.055 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi141.front.sepia.ceph.com", "ansible_hostname": "smithi141", "ansible_nodename": "smithi141"}, "changed": true, "name": "smithi141"} 2019-11-28T21:41:29.098 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:29 +0000 (0:00:00.137) 0:02:58.914 ***** 2019-11-28T21:41:29.842 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** changed: [smithi074.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2019-11-28T21:41:29.880 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:29 +0000 (0:00:00.782) 0:02:59.697 ***** 2019-11-28T21:41:29.961 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2019-11-28T21:41:29.962 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "checksum": "28e3f1fe12efa510f1199f3ab5f2a5a0feb586ff", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1042, "state": "file", "uid": 0} 2019-11-28T21:41:30.001 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:29 +0000 (0:00:00.120) 0:02:59.817 ***** 2019-11-28T21:41:30.835 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2019-11-28T21:41:30.835 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2019-11-28T21:41:30.873 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:30 +0000 (0:00:00.872) 0:03:00.689 ***** 2019-11-28T21:41:30.920 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2019-11-28T21:41:30.922 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2019-11-28T21:41:30.962 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:30 +0000 (0:00:00.085) 0:03:00.774 ***** 2019-11-28T21:41:31.214 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-11-28T21:41:31.216 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2019-11-28T21:41:31.252 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:31 +0000 (0:00:00.293) 0:03:01.068 ***** 2019-11-28T21:41:31.572 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-11-28T21:41:31.573 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "gid": 10103, "name": "kvm", "state": "present", "system": false} 2019-11-28T21:41:31.619 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:31 +0000 (0:00:00.366) 0:03:01.435 ***** 2019-11-28T21:41:31.860 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** changed: [smithi141.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2019-11-28T21:41:31.897 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:31 +0000 (0:00:00.277) 0:03:01.713 ***** 2019-11-28T21:41:31.997 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-11-28T21:41:31.998 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1215, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2019-11-28T21:41:32.037 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:32 +0000 (0:00:00.140) 0:03:01.853 ***** 2019-11-28T21:41:32.835 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2019-11-28T21:41:32.836 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2019-11-28T21:41:32.872 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:32 +0000 (0:00:00.834) 0:03:02.688 ***** 2019-11-28T21:41:32.981 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-11-28T21:41:32.982 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2019-11-28T21:41:33.018 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:33 +0000 (0:00:00.145) 0:03:02.834 ***** 2019-11-28T21:41:33.197 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-11-28T21:41:33.199 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2019-11-28T21:41:33.236 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:33 +0000 (0:00:00.218) 0:03:03.052 ***** 2019-11-28T21:41:33.564 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-11-28T21:41:33.565 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "gid": 10103, "name": "kvm", "state": "present", "system": false} 2019-11-28T21:41:33.600 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:33 +0000 (0:00:00.363) 0:03:03.416 ***** 2019-11-28T21:41:33.897 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-11-28T21:41:33.897 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2019-11-28T21:41:33.937 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:33 +0000 (0:00:00.337) 0:03:03.753 ***** 2019-11-28T21:41:33.966 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-11-28T21:41:33.967 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1215, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2019-11-28T21:41:34.003 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:33 +0000 (0:00:00.066) 0:03:03.820 ***** 2019-11-28T21:41:34.946 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2019-11-28T21:41:34.984 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:34 +0000 (0:00:00.980) 0:03:04.800 ***** 2019-11-28T21:41:35.808 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2019-11-28T21:41:35.852 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:35 +0000 (0:00:00.868) 0:03:05.668 ***** 2019-11-28T21:41:36.322 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-11-28T21:41:36.324 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi074.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.083531", "end": "2019-11-28 21:41:36.295170", "rc": 0, "start": "2019-11-28 21:41:34.211639", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T21:41:36.362 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:36 +0000 (0:00:00.509) 0:03:06.178 ***** 2019-11-28T21:41:36.389 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2019-11-28T21:41:36.428 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:36 +0000 (0:00:00.065) 0:03:06.244 ***** 2019-11-28T21:41:37.348 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-11-28T21:41:37.349 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'CentOS 7 Local fastcgi Repo', u'baseurl': u'http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/'}, 'key': u'centos7-fcgi-ceph'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "58f6bfe213f63251ef8c4f03709a8fcef9b9e7bf", "dest": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "gid": 0, "group": "root", "item": {"key": "centos7-fcgi-ceph", "value": {"baseurl": "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 250, "state": "file", "uid": 0} 2019-11-28T21:41:38.160 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-11-28T21:41:38.161 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.014085", "end": "2019-11-28 21:41:38.133111", "rc": 0, "start": "2019-11-28 21:41:36.119026", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T21:41:38.200 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:38 +0000 (0:00:01.772) 0:03:08.017 ***** 2019-11-28T21:41:38.227 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2019-11-28T21:41:38.265 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:38 +0000 (0:00:00.064) 0:03:08.081 ***** 2019-11-28T21:41:38.270 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-11-28T21:41:38.271 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "765bacbb40da31f952344b310a4be4322cbee8a4", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 209, "state": "file", "uid": 0} 2019-11-28T21:41:38.315 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:38 +0000 (0:00:00.049) 0:03:08.131 ***** 2019-11-28T21:41:38.341 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2019-11-28T21:41:38.342 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:41:38.379 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:38 +0000 (0:00:00.064) 0:03:08.196 ***** 2019-11-28T21:41:38.417 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2019-11-28T21:41:38.419 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi074.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-11-28T21:41:38.455 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:38 +0000 (0:00:00.075) 0:03:08.271 ***** 2019-11-28T21:41:38.483 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2019-11-28T21:41:38.485 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:41:38.530 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:38 +0000 (0:00:00.074) 0:03:08.346 ***** 2019-11-28T21:41:38.566 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-28T21:41:38.568 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2019-11-28T21:41:38.606 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:38 +0000 (0:00:00.076) 0:03:08.422 ***** 2019-11-28T21:41:39.110 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2019-11-28T21:41:39.112 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["yum-utils-1.1.31-50.el7.noarch providing yum-utils is already installed"]} 2019-11-28T21:41:39.157 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:39 +0000 (0:00:00.551) 0:03:08.973 ***** 2019-11-28T21:41:39.227 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-11-28T21:41:39.228 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'CentOS 7 Local fastcgi Repo', u'baseurl': u'http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/'}, 'key': u'centos7-fcgi-ceph'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "58f6bfe213f63251ef8c4f03709a8fcef9b9e7bf", "dest": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "gid": 0, "group": "root", "item": {"key": "centos7-fcgi-ceph", "value": {"baseurl": "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 250, "state": "file", "uid": 0} 2019-11-28T21:41:39.798 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2019-11-28T21:41:39.799 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "cmd": ["yum-complete-transaction", "--cleanup-only"], "delta": "0:00:00.310969", "end": "2019-11-28 21:41:39.760016", "rc": 0, "start": "2019-11-28 21:41:39.449047", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.cogentco.com\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.umd.edu\n * updates: mirror.wdc1.us.leaseweb.net\nNo unfinished transactions left.", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Loading mirror speeds from cached hostfile", " * base: mirror.cogentco.com", " * epel: download-cc-rdu01.fedoraproject.org", " * extras: mirror.umd.edu", " * updates: mirror.wdc1.us.leaseweb.net", "No unfinished transactions left."]} 2019-11-28T21:41:39.836 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:39 +0000 (0:00:00.678) 0:03:09.652 ***** 2019-11-28T21:41:40.090 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-11-28T21:41:40.091 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "765bacbb40da31f952344b310a4be4322cbee8a4", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 209, "state": "file", "uid": 0} 2019-11-28T21:41:40.135 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:40 +0000 (0:00:00.299) 0:03:09.951 ***** 2019-11-28T21:41:40.162 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2019-11-28T21:41:40.164 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:41:40.198 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:40 +0000 (0:00:00.062) 0:03:10.014 ***** 2019-11-28T21:41:40.219 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* fatal: [smithi074.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.055846", "end": "2019-11-28 21:41:40.183634", "msg": "non-zero return code", "rc": 1, "start": "2019-11-28 21:41:40.127788", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2019-11-28T21:41:40.265 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:40 +0000 (0:00:00.067) 0:03:10.081 ***** 2019-11-28T21:41:40.271 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2019-11-28T21:41:40.271 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-11-28T21:41:40.273 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-11-28T21:41:40.309 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:40 +0000 (0:00:00.044) 0:03:10.126 ***** 2019-11-28T21:41:40.314 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2019-11-28T21:41:40.316 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:41:40.355 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:40 +0000 (0:00:00.045) 0:03:10.171 ***** 2019-11-28T21:41:40.360 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2019-11-28T21:41:40.363 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:41:40.398 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:40 +0000 (0:00:00.043) 0:03:10.214 ***** 2019-11-28T21:41:40.434 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-28T21:41:40.435 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2019-11-28T21:41:40.470 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:40 +0000 (0:00:00.071) 0:03:10.286 ***** 2019-11-28T21:41:40.982 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2019-11-28T21:41:40.984 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["yum-utils-1.1.31-50.el7.noarch providing yum-utils is already installed"]} 2019-11-28T21:41:41.020 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:41 +0000 (0:00:00.550) 0:03:10.836 ***** 2019-11-28T21:41:41.723 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2019-11-28T21:41:41.724 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "cmd": ["yum-complete-transaction", "--cleanup-only"], "delta": "0:00:00.358698", "end": "2019-11-28 21:41:41.681786", "rc": 0, "start": "2019-11-28 21:41:41.323088", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.cogentco.com\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.ash.fastserv.com\n * updates: mirror.wdc1.us.leaseweb.net\nNo unfinished transactions left.", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Loading mirror speeds from cached hostfile", " * base: mirror.cogentco.com", " * epel: download-cc-rdu01.fedoraproject.org", " * extras: mirror.ash.fastserv.com", " * updates: mirror.wdc1.us.leaseweb.net", "No unfinished transactions left."]} 2019-11-28T21:41:41.761 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:41 +0000 (0:00:00.741) 0:03:11.577 ***** 2019-11-28T21:41:42.121 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2019-11-28T21:41:42.122 INFO:teuthology.task.ansible.out:fatal: [smithi141.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.051142", "end": "2019-11-28 21:41:42.093157", "msg": "non-zero return code", "rc": 1, "start": "2019-11-28 21:41:42.042015", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2019-11-28T21:41:42.164 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:42 +0000 (0:00:00.402) 0:03:11.980 ***** 2019-11-28T21:41:42.199 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2019-11-28T21:41:42.200 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:41:42.236 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:42 +0000 (0:00:00.072) 0:03:12.053 ***** 2019-11-28T21:41:50.716 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-11-28T21:41:50.718 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["librbd1", "librados2", "mod_fastcgi", "iozone"]}, "msg": "", "rc": 0, "results": ["ceph is not installed", "ceph-base is not installed", "ceph-selinux is not installed", "ceph-common is not installed", "ceph-debuginfo is not installed", "ceph-release is not installed", "libcephfs1 is not installed", "ceph-radosgw is not installed", "python-ceph is not installed", "python-rados is not installed", "python-rbd is not installed", "python-cephfs is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be erased\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be erased\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-img-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be erased\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be erased\n--> Running transaction check\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n iozone x86_64 3.424-2_ceph.el7.centos @lab-extras 1.3 M\n librados2 x86_64 1:10.2.5-4.el7 @base 5.5 M\n librbd1 x86_64 1:10.2.5-4.el7 2019-11-28T21:41:50.719 INFO:teuthology.task.ansible.out: @base 7.4 M\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos @centos7-fcgi-ceph 213 k\nRemoving for dependencies:\n qemu-img x86_64 10:1.5.3-167.el7_7.1 @updates 2.3 M\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 @updates 5.7 M\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 @updates 755 k\n\nTransaction Summary\n================================================================================\nRemove 4 Packages (+3 Dependent packages)\n\nInstalled size: 23 M\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 1/7 \n Erasing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 2/7 \n Erasing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 3/7 \n Erasing : 1:librbd1-10.2.5-4.el7.x86_64 4/7 \n Erasing : 1:librados2-10.2.5-4.el7.x86_64 5/7 \n Erasing : iozone-3.424-2_ceph.el7.centos.x86_64 6/7 \n Erasing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 7/7 \nwarning: file /var/run/mod_fastcgi: remove failed: No such file or directory\n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/7 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/7 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/7 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/7 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/7 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/7 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 7/7 \n\nRemoved:\n iozone.x86_64 0:3.424-2_ceph.el7.centos 2019-11-28T21:41:50.721 INFO:teuthology.task.ansible.out: \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n\nDependency Removed:\n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-11-28T21:41:50.762 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:50 +0000 (0:00:08.524) 0:03:20.578 ***** 2019-11-28T21:41:52.361 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["librbd1", "librados2", "mod_fastcgi", "iozone"]}, "msg": "", "rc": 0, "results": ["ceph is not installed", "ceph-base is not installed", "ceph-selinux is not installed", "ceph-common is not installed", "ceph-debuginfo is not installed", "ceph-release is not installed", "libcephfs1 is not installed", "ceph-radosgw is not installed", "python-ceph is not installed", "python-rados is not installed", "python-rbd is not installed", "python-cephfs is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be erased\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be erased\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-img-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be erased\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be erased\n--> Running transaction check\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n iozone x86_64 3.424-2_ceph.el7.centos @lab-extras 1.3 M\n librados2 x86_64 1:10.2.5-4.el7 @base 5.5 M\n librbd1 x86_64 1:10.2.5-4.el7 2019-11-28T21:41:52.362 INFO:teuthology.task.ansible.out: @base 7.4 M\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos @centos7-fcgi-ceph 213 k\nRemoving for dependencies:\n qemu-img x86_64 10:1.5.3-167.el7_7.1 @updates 2.3 M\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 @updates 5.7 M\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 @updates 755 k\n\nTransaction Summary\n================================================================================\nRemove 4 Packages (+3 Dependent packages)\n\nInstalled size: 23 M\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 1/7 \n Erasing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 2/7 \n Erasing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 3/7 \n Erasing : 1:librbd1-10.2.5-4.el7.x86_64 4/7 \n Erasing : 1:librados2-10.2.5-4.el7.x86_64 5/7 \n Erasing : iozone-3.424-2_ceph.el7.centos.x86_64 6/7 \n Erasing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 7/7 \nwarning: file /var/run/mod_fastcgi: remove failed: No such file or directory\n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/7 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/7 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/7 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/7 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/7 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/7 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 7/7 \n\nRemoved:\n iozone.x86_64 0:3.424-2_ceph.el7.centos 2019-11-28T21:41:52.364 INFO:teuthology.task.ansible.out: \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n\nDependency Removed:\n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-11-28T21:41:52.404 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:52 +0000 (0:00:01.641) 0:03:22.220 ***** 2019-11-28T21:41:54.100 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* changed: [smithi074.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["boost-random", "boost-random"]}, "msg": "", "rc": 0, "results": ["boost-program-options is not installed", "leveldb is not installed", "xmlstarlet is not installed", "python-jinja2 is not installed", "python-ceph is not installed", "python-flask is not installed", "python-requests is not installed", "python-urllib3 is not installed", "python-babel is not installed", "hdparm is not installed", "python-markupsafe is not installed", "python-werkzeug is not installed", "python-itsdangerous is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n boost-random x86_64 1.53.0-27.el7 @base 28 k\n\nTransaction Summary\n================================================================================\nRemove 1 Package\n\nInstalled size: 28 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : boost-random-1.53.0-27.el7.x86_64 1/1 \n Verifying : boost-random-1.53.0-27.el7.x86_64 1/1 \n\nRemoved:\n boost-random.x86_64 0:1.53.0-27.el7 \n\nComplete!\n"]} 2019-11-28T21:41:54.137 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:54 +0000 (0:00:01.733) 0:03:23.954 ***** 2019-11-28T21:41:55.678 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["boost-random", "boost-random"]}, "msg": "", "rc": 0, "results": ["boost-program-options is not installed", "leveldb is not installed", "xmlstarlet is not installed", "python-jinja2 is not installed", "python-ceph is not installed", "python-flask is not installed", "python-requests is not installed", "python-urllib3 is not installed", "python-babel is not installed", "hdparm is not installed", "python-markupsafe is not installed", "python-werkzeug is not installed", "python-itsdangerous is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n boost-random x86_64 1.53.0-27.el7 @base 28 k\n\nTransaction Summary\n================================================================================\nRemove 1 Package\n\nInstalled size: 28 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : boost-random-1.53.0-27.el7.x86_64 1/1 \n Verifying : boost-random-1.53.0-27.el7.x86_64 1/1 \n\nRemoved:\n boost-random.x86_64 0:1.53.0-27.el7 \n\nComplete!\n"]} 2019-11-28T21:41:55.715 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:41:55 +0000 (0:00:01.577) 0:03:25.531 ***** 2019-11-28T21:42:13.772 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-11-28T21:42:13.773 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": ["@core", "@base", "iozone", "qemu-kvm", "mod_fastcgi-2.4.7-1.ceph.el7.centos"]}, "msg": "Warning: Group core does not have any packages to install.\nWarning: Group base does not have any packages to install.\nGroup base does have 1 conditional packages, which may get installed.\n", "rc": 0, "results": ["yum-plugin-priorities-1.1.31-52.el7.noarch providing yum-plugin-priorities is already installed", "yum-plugin-fastestmirror-1.1.31-50.el7.noarch providing yum-plugin-fastestmirror is already installed", "redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed", "sysstat-10.1.5-17.el7.x86_64 providing sysstat is already installed", "gdb-7.6.1-114.el7.x86_64 providing gdb is already installed", "git-all-1.8.3.1-20.el7.noarch providing git-all is already installed", "python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed", "gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed", "libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed", "openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed", "boost-thread-1.53.0-27.el7.x86_64 providing boost-thread is already installed", "xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed", "gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "parted-3.1-29.el7.x86_64 providing parted is already installed", "libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed", "fuse-2.9.2-11.el7.x86_64 providing fuse is already installed", "fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "1:openssl-1.0.2k-16.el7.x86_64 providing openssl is already installed", "libuuid-2.23.2-61.el7.x86_64 providing libuuid is already installed", "btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is alrea 2019-11-28T21:42:13.775 INFO:teuthology.task.ansible.out:dy installed", "attr-2.4.46-13.el7.x86_64 providing attr is already installed", "1:valgrind-3.14.0-16.el7.x86_64 providing valgrind is already installed", "python-nose-1.3.7-1.el7.noarch providing python-nose is already installed", "mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed", "podman-1.4.4-4.el7.centos.x86_64 providing podman is already installed", "ant-1.9.4-2.el7.noarch providing ant is already installed", "libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed", "automake-1.13.4-3.el7.noarch providing automake is already installed", "gettext-0.19.8.1-2.el7.x86_64 providing gettext is already installed", "libuuid-devel-2.23.2-61.el7.x86_64 providing libuuid-devel is already installed", "libacl-devel-2.2.51-14.el7.x86_64 providing libacl-devel is already installed", "bc-1.06.95-13.el7.x86_64 providing bc is already installed", "xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed", "xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed", "blktrace-1.0.5-8.el7.x86_64 providing blktrace is already installed", "1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed", "python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed", "usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed", "genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed", "httpd-2.4.6-90.el7.centos.x86_64 providing httpd is already installed", "httpd-devel-2.4.6-90.el7.centos.x86_64 providing httpd-devel is already installed", "httpd-tools-2.4.6-90.el7.centos.x86_64 providing httpd-tools is already installed", "1:mod_ssl-2.4.6-90.el7.centos.x86_64 providing mod_ssl is already installed", "libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed", "perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed", "1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already insta 2019-11-28T21:42:13.776 INFO:teuthology.task.ansible.out:lled", "junit-4.11-8.el7.noarch providing junit4 is already installed", "1:nfs-utils-1.3.0-0.65.el7.x86_64 providing nfs-utils is already installed", "ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed", "python-devel-2.7.5-86.el7.x86_64 providing python-devel is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "perl-CPAN-1.9800-294.el7_6.noarch providing perl-CPAN is already installed", "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.cogentco.com\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.ash.fastserv.com\n * updates: mirror.wdc1.us.leaseweb.net\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be installed\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: qemu-img = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Running transaction check\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be installed\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be installed\n--> Finished Dependency Resolution\n\nDependenc 2019-11-28T21:42:13.778 INFO:teuthology.task.ansible.out:ies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n iozone x86_64 3.424-2_ceph.el7.centos lab-extras 800 k\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 updates 1.9 M\nInstalling for dependencies:\n boost-random x86_64 1.53.0-27.el7 base 39 k\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\n qemu-img x86_64 10:1.5.3-167.el7_7.1 updates 699 k\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 updates 435 k\n\nTransaction Summary\n================================================================================\nInstall 3 Packages (+5 Dependent packages)\n\nTotal download size: 8.1 M\nInstalled size: 23 M\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 17 MB/s | 8.1 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : boost-random-1.53.0-27.el7.x86_64 1/8 \n Installing : 1:librados2-10.2.5-4.el7.x86_64 2/8 \n Installing : 1:librbd1-10.2.5-4.el7.x86_64 3/8 \n Installing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 4/8 \n Installing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 5/8 \n Installing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 6/8 \n Installing : iozone-3.424-2_ceph.el7.centos.x86_64 2019-11-28T21:42:13.779 INFO:teuthology.task.ansible.out: 7/8 \n Installing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 8/8 \n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/8 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/8 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/8 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/8 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/8 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/8 \n Verifying : boost-random-1.53.0-27.el7.x86_64 7/8 \n Verifying : iozone-3.424-2_ce 2019-11-28T21:42:13.781 INFO:teuthology.task.ansible.out:ph.el7.centos.x86_64 8/8 \n\nInstalled:\n iozone.x86_64 0:3.424-2_ceph.el7.centos \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n\nDependency Installed:\n boost-random.x86_64 0:1.53.0-27.el7 \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-11-28T21:42:13.817 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:13 +0000 (0:00:18.101) 0:03:43.633 ***** 2019-11-28T21:42:14.365 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": ["@core", "@base", "iozone", "qemu-kvm", "mod_fastcgi-2.4.7-1.ceph.el7.centos"]}, "msg": "Warning: Group core does not have any packages to install.\nWarning: Group base does not have any packages to install.\nGroup base does have 1 conditional packages, which may get installed.\n", "rc": 0, "results": ["yum-plugin-priorities-1.1.31-52.el7.noarch providing yum-plugin-priorities is already installed", "yum-plugin-fastestmirror-1.1.31-50.el7.noarch providing yum-plugin-fastestmirror is already installed", "redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed", "sysstat-10.1.5-17.el7.x86_64 providing sysstat is already installed", "gdb-7.6.1-114.el7.x86_64 providing gdb is already installed", "git-all-1.8.3.1-20.el7.noarch providing git-all is already installed", "python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed", "gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed", "libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed", "openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed", "boost-thread-1.53.0-27.el7.x86_64 providing boost-thread is already installed", "xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed", "gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "parted-3.1-29.el7.x86_64 providing parted is already installed", "libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed", "fuse-2.9.2-11.el7.x86_64 providing fuse is already installed", "fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "1:openssl-1.0.2k-16.el7.x86_64 providing openssl is already installed", "libuuid-2.23.2-61.el7.x86_64 providing libuuid is already installed", "btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is alrea 2019-11-28T21:42:14.366 INFO:teuthology.task.ansible.out:dy installed", "attr-2.4.46-13.el7.x86_64 providing attr is already installed", "1:valgrind-3.14.0-16.el7.x86_64 providing valgrind is already installed", "python-nose-1.3.7-1.el7.noarch providing python-nose is already installed", "mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed", "podman-1.4.4-4.el7.centos.x86_64 providing podman is already installed", "ant-1.9.4-2.el7.noarch providing ant is already installed", "libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed", "automake-1.13.4-3.el7.noarch providing automake is already installed", "gettext-0.19.8.1-2.el7.x86_64 providing gettext is already installed", "libuuid-devel-2.23.2-61.el7.x86_64 providing libuuid-devel is already installed", "libacl-devel-2.2.51-14.el7.x86_64 providing libacl-devel is already installed", "bc-1.06.95-13.el7.x86_64 providing bc is already installed", "xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed", "xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed", "blktrace-1.0.5-8.el7.x86_64 providing blktrace is already installed", "1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed", "python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed", "usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed", "genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed", "httpd-2.4.6-90.el7.centos.x86_64 providing httpd is already installed", "httpd-devel-2.4.6-90.el7.centos.x86_64 providing httpd-devel is already installed", "httpd-tools-2.4.6-90.el7.centos.x86_64 providing httpd-tools is already installed", "1:mod_ssl-2.4.6-90.el7.centos.x86_64 providing mod_ssl is already installed", "libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed", "perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed", "1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already insta 2019-11-28T21:42:14.368 INFO:teuthology.task.ansible.out:lled", "junit-4.11-8.el7.noarch providing junit4 is already installed", "1:nfs-utils-1.3.0-0.65.el7.x86_64 providing nfs-utils is already installed", "ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed", "python-devel-2.7.5-86.el7.x86_64 providing python-devel is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "perl-CPAN-1.9800-294.el7_6.noarch providing perl-CPAN is already installed", "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.cogentco.com\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.umd.edu\n * updates: mirror.wdc1.us.leaseweb.net\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be installed\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: qemu-img = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Running transaction check\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be installed\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be installed\n--> Finished Dependency Resolution\n\nDependencies Resol 2019-11-28T21:42:14.370 INFO:teuthology.task.ansible.out:ved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n iozone x86_64 3.424-2_ceph.el7.centos lab-extras 800 k\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 updates 1.9 M\nInstalling for dependencies:\n boost-random x86_64 1.53.0-27.el7 base 39 k\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\n qemu-img x86_64 10:1.5.3-167.el7_7.1 updates 699 k\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 updates 435 k\n\nTransaction Summary\n================================================================================\nInstall 3 Packages (+5 Dependent packages)\n\nTotal download size: 8.1 M\nInstalled size: 23 M\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 3.4 MB/s | 8.1 MB 00:02 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : boost-random-1.53.0-27.el7.x86_64 1/8 \n Installing : 1:librados2-10.2.5-4.el7.x86_64 2/8 \n Installing : 1:librbd1-10.2.5-4.el7.x86_64 3/8 \n Installing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 4/8 \n Installing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 5/8 \n Installing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 6/8 \n Installing : iozone-3.424-2_ceph.el7.centos.x86_64 2019-11-28T21:42:14.371 INFO:teuthology.task.ansible.out: 7/8 \n Installing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 8/8 \n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/8 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/8 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/8 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/8 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/8 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/8 \n Verifying : boost-random-1.53.0-27.el7.x86_64 7/8 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 8/8 \n\nInstalled:\n iozone.x86_64 0:3.424-2_ceph.el7.centos \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n\nDependency Installed:\n boost-random.x86_64 0:1.53.0-27.el7 \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-11-28T21:42:14.403 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:14 +0000 (0:00:00.586) 0:03:44.220 ***** 2019-11-28T21:42:14.598 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2019-11-28T21:42:14.600 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["cryptopp-devel-5.6.2-10.el7.x86_64 providing cryptopp-devel is already installed", "cryptopp-5.6.2-10.el7.x86_64 providing cryptopp is already installed", "fcgi-2.4.0-25.el7.x86_64 providing fcgi is already installed", "dbench-4.0-10.el7.x86_64 providing dbench is already installed", "fuse-sshfs-2.10-1.el7.x86_64 providing fuse-sshfs is already installed", "bonnie++-1.97.3-1.el7.x86_64 providing bonnie++ is already installed", "1:perl-JSON-XS-3.01-2.el7.x86_64 providing perl-JSON-XS is already installed"]} 2019-11-28T21:42:14.636 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:14 +0000 (0:00:00.232) 0:03:44.452 ***** 2019-11-28T21:42:15.178 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["cryptopp-devel-5.6.2-10.el7.x86_64 providing cryptopp-devel is already installed", "cryptopp-5.6.2-10.el7.x86_64 providing cryptopp is already installed", "fcgi-2.4.0-25.el7.x86_64 providing fcgi is already installed", "dbench-4.0-10.el7.x86_64 providing dbench is already installed", "fuse-sshfs-2.10-1.el7.x86_64 providing fuse-sshfs is already installed", "bonnie++-1.97.3-1.el7.x86_64 providing bonnie++ is already installed", "1:perl-JSON-XS-3.01-2.el7.x86_64 providing perl-JSON-XS is already installed"]} 2019-11-28T21:42:15.220 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:15 +0000 (0:00:00.580) 0:03:45.032 ***** 2019-11-28T21:42:15.223 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-11-28T21:42:15.224 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["device-mapper-multipath is not installed"]} 2019-11-28T21:42:15.263 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:15 +0000 (0:00:00.046) 0:03:45.079 ***** 2019-11-28T21:42:15.301 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-11-28T21:42:15.302 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:15.340 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:15 +0000 (0:00:00.076) 0:03:45.156 ***** 2019-11-28T21:42:15.761 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-11-28T21:42:15.763 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["device-mapper-multipath is not installed"]} 2019-11-28T21:42:15.799 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:15 +0000 (0:00:00.458) 0:03:45.615 ***** 2019-11-28T21:42:15.806 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2019-11-28T21:42:15.808 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "polkit.service system.slice dbus.service basic.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "Conflicts": "ipset.service ebtables.service shutdown.target ip6tables.service iptables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "EnvironmentFile": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "Igno 2019-11-28T21:42:15.810 INFO:teuthology.task.ansible.out:reOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", " 2019-11-28T21:42:15.811 INFO:teuthology.task.ansible.out:TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "Wants": "system.slice network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-11-28T21:42:15.849 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:15 +0000 (0:00:00.049) 0:03:45.665 ***** 2019-11-28T21:42:15.854 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-11-28T21:42:15.854 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:15.895 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:15 +0000 (0:00:00.045) 0:03:45.711 ***** 2019-11-28T21:42:16.266 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ fatal: [smithi141.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2019-11-28T21:42:16.301 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:16 +0000 (0:00:00.406) 0:03:46.117 ***** 2019-11-28T21:42:16.303 INFO:teuthology.task.ansible.out: 2019-11-28T21:42:16.343 INFO:teuthology.task.ansible.out: 2019-11-28T21:42:16.345 INFO:teuthology.task.ansible.out:TASK [testnode : Stop and disable firewalld] *********************************** 2019-11-28T21:42:16.347 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "polkit.service dbus.service basic.target system.slice", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "Conflicts": "ebtables.service ip6tables.service shutdown.target iptables.service ipset.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "EnvironmentFile": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "Igno 2019-11-28T21:42:16.349 INFO:teuthology.task.ansible.out:reOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127510", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127510", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", " 2019-11-28T21:42:16.350 INFO:teuthology.task.ansible.out:TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "Wants": "network-pre.target system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-11-28T21:42:16.383 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:16 +0000 (0:00:00.081) 0:03:46.199 ***** 2019-11-28T21:42:16.387 INFO:teuthology.task.ansible.out: 2019-11-28T21:42:16.721 INFO:teuthology.task.ansible.out: 2019-11-28T21:42:16.722 INFO:teuthology.task.ansible.out:TASK [testnode : Stop and disable iptables] ************************************ 2019-11-28T21:42:16.724 INFO:teuthology.task.ansible.out: fatal: [smithi074.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2019-11-28T21:42:16.759 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:16 +0000 (0:00:00.376) 0:03:46.575 ***** 2019-11-28T21:42:17.090 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2019-11-28T21:42:17.129 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:17 +0000 (0:00:00.366) 0:03:46.942 ***** 2019-11-28T21:42:17.154 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:17.190 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:17 +0000 (0:00:00.063) 0:03:47.006 ***** 2019-11-28T21:42:17.193 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2019-11-28T21:42:17.194 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2019-11-28T21:42:17.231 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:17 +0000 (0:00:00.041) 0:03:47.047 ***** 2019-11-28T21:42:17.237 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2019-11-28T21:42:17.276 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:17 +0000 (0:00:00.044) 0:03:47.092 ***** 2019-11-28T21:42:17.284 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:17.325 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:17 +0000 (0:00:00.044) 0:03:47.136 ***** 2019-11-28T21:42:17.326 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2019-11-28T21:42:17.328 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:17.366 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:17 +0000 (0:00:00.046) 0:03:47.182 ***** 2019-11-28T21:42:17.371 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2019-11-28T21:42:17.408 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:17 +0000 (0:00:00.042) 0:03:47.224 ***** 2019-11-28T21:42:17.413 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2019-11-28T21:42:17.416 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:17.453 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:17 +0000 (0:00:00.044) 0:03:47.269 ***** 2019-11-28T21:42:17.458 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2019-11-28T21:42:17.459 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:17.500 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:17 +0000 (0:00:00.046) 0:03:47.316 ***** 2019-11-28T21:42:17.506 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2019-11-28T21:42:17.506 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-11-28T21:42:17.508 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-11-28T21:42:17.546 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:17 +0000 (0:00:00.046) 0:03:47.363 ***** 2019-11-28T21:42:17.553 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2019-11-28T21:42:17.553 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:17.592 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:17 +0000 (0:00:00.045) 0:03:47.408 ***** 2019-11-28T21:42:17.597 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2019-11-28T21:42:17.598 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:17.649 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:17 +0000 (0:00:00.049) 0:03:47.457 ***** TASK [testnode : Install apt keys] ********************************************* skipping: [smithi074.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi074.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-11-28T21:42:17.686 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:17 +0000 (0:00:00.045) 0:03:47.502 ***** 2019-11-28T21:42:17.692 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2019-11-28T21:42:17.730 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:17 +0000 (0:00:00.043) 0:03:47.546 ***** 2019-11-28T21:42:17.734 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2019-11-28T21:42:17.735 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:17.777 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:17 +0000 (0:00:00.046) 0:03:47.593 ***** 2019-11-28T21:42:17.782 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2019-11-28T21:42:17.783 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:17.822 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:17 +0000 (0:00:00.044) 0:03:47.637 ***** 2019-11-28T21:42:17.826 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2019-11-28T21:42:17.865 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:17 +0000 (0:00:00.043) 0:03:47.681 ***** 2019-11-28T21:42:17.871 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2019-11-28T21:42:17.874 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:17.910 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:17 +0000 (0:00:00.045) 0:03:47.726 ***** 2019-11-28T21:42:17.915 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2019-11-28T21:42:17.916 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:17.953 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:17 +0000 (0:00:00.042) 0:03:47.769 ***** 2019-11-28T21:42:17.958 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2019-11-28T21:42:17.960 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:18.000 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:17 +0000 (0:00:00.042) 0:03:47.812 ***** 2019-11-28T21:42:18.002 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2019-11-28T21:42:18.003 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:18.045 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:18 +0000 (0:00:00.048) 0:03:47.861 ***** 2019-11-28T21:42:18.050 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-11-28T21:42:18.051 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:18.094 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:18 +0000 (0:00:00.048) 0:03:47.910 ***** 2019-11-28T21:42:18.101 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2019-11-28T21:42:18.102 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:18.137 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:18 +0000 (0:00:00.043) 0:03:47.953 ***** 2019-11-28T21:42:18.142 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2019-11-28T21:42:18.144 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:18.194 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:18 +0000 (0:00:00.043) 0:03:47.996 ***** TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:18.225 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:18 +0000 (0:00:00.044) 0:03:48.041 ***** 2019-11-28T21:42:18.231 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-11-28T21:42:18.233 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:18.269 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:18 +0000 (0:00:00.043) 0:03:48.085 ***** 2019-11-28T21:42:18.273 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2019-11-28T21:42:18.274 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:18.310 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:18 +0000 (0:00:00.041) 0:03:48.127 ***** 2019-11-28T21:42:18.318 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2019-11-28T21:42:18.320 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:18.354 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:18 +0000 (0:00:00.043) 0:03:48.170 ***** 2019-11-28T21:42:18.359 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-11-28T21:42:18.359 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:18.396 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:18 +0000 (0:00:00.042) 0:03:48.212 ***** 2019-11-28T21:42:18.401 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2019-11-28T21:42:18.403 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:18.441 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:18 +0000 (0:00:00.045) 0:03:48.257 ***** 2019-11-28T21:42:18.446 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2019-11-28T21:42:18.447 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:18.483 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:18 +0000 (0:00:00.041) 0:03:48.299 ***** 2019-11-28T21:42:18.488 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2019-11-28T21:42:18.489 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:18.525 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:18 +0000 (0:00:00.041) 0:03:48.341 ***** 2019-11-28T21:42:18.530 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2019-11-28T21:42:18.533 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:18.568 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:18 +0000 (0:00:00.043) 0:03:48.384 ***** 2019-11-28T21:42:18.573 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2019-11-28T21:42:18.574 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:18.610 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:18 +0000 (0:00:00.042) 0:03:48.426 ***** 2019-11-28T21:42:18.614 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2019-11-28T21:42:18.615 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:18.652 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:18 +0000 (0:00:00.041) 0:03:48.468 ***** 2019-11-28T21:42:18.658 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2019-11-28T21:42:18.659 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:18.696 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:18 +0000 (0:00:00.043) 0:03:48.512 ***** 2019-11-28T21:42:18.701 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:18.738 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:18 +0000 (0:00:00.042) 0:03:48.554 ***** 2019-11-28T21:42:18.745 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2019-11-28T21:42:18.747 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:18.780 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:18 +0000 (0:00:00.042) 0:03:48.596 ***** 2019-11-28T21:42:18.785 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2019-11-28T21:42:18.785 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:18.822 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:18 +0000 (0:00:00.041) 0:03:48.638 ***** 2019-11-28T21:42:18.827 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2019-11-28T21:42:18.827 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:18.865 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:18 +0000 (0:00:00.042) 0:03:48.681 ***** 2019-11-28T21:42:18.870 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2019-11-28T21:42:18.871 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:18.908 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:18 +0000 (0:00:00.042) 0:03:48.724 ***** 2019-11-28T21:42:18.913 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2019-11-28T21:42:18.915 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:18.951 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:18 +0000 (0:00:00.043) 0:03:48.767 ***** 2019-11-28T21:42:18.964 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:19.000 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:18 +0000 (0:00:00.048) 0:03:48.816 ***** 2019-11-28T21:42:19.006 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-11-28T21:42:19.007 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:19.044 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:19 +0000 (0:00:00.043) 0:03:48.860 ***** 2019-11-28T21:42:19.048 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2019-11-28T21:42:19.049 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:19.088 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:19 +0000 (0:00:00.043) 0:03:48.903 ***** 2019-11-28T21:42:19.093 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-11-28T21:42:19.094 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:19.132 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:19 +0000 (0:00:00.043) 0:03:48.946 ***** 2019-11-28T21:42:19.136 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-11-28T21:42:19.136 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:19.175 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:19 +0000 (0:00:00.044) 0:03:48.991 ***** 2019-11-28T21:42:19.185 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-11-28T21:42:19.186 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:19.220 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:19 +0000 (0:00:00.044) 0:03:49.036 ***** 2019-11-28T21:42:19.224 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-11-28T21:42:19.225 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:19.263 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:19 +0000 (0:00:00.043) 0:03:49.079 ***** 2019-11-28T21:42:19.269 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-11-28T21:42:19.269 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:19.310 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:19 +0000 (0:00:00.044) 0:03:49.124 ***** 2019-11-28T21:42:19.313 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-11-28T21:42:19.314 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:19.351 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:19 +0000 (0:00:00.043) 0:03:49.168 ***** 2019-11-28T21:42:19.357 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-11-28T21:42:19.357 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:19.396 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:19 +0000 (0:00:00.044) 0:03:49.212 ***** 2019-11-28T21:42:19.403 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-11-28T21:42:19.404 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:19.440 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:19 +0000 (0:00:00.044) 0:03:49.257 ***** 2019-11-28T21:42:19.446 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-11-28T21:42:19.447 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:19.484 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:19 +0000 (0:00:00.043) 0:03:49.300 ***** 2019-11-28T21:42:19.490 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-11-28T21:42:19.490 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:19.528 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:19 +0000 (0:00:00.043) 0:03:49.344 ***** 2019-11-28T21:42:19.533 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-11-28T21:42:19.534 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:19.574 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:19 +0000 (0:00:00.046) 0:03:49.390 ***** 2019-11-28T21:42:19.579 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-11-28T21:42:19.580 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:19.616 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:19 +0000 (0:00:00.042) 0:03:49.433 ***** 2019-11-28T21:42:19.622 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-11-28T21:42:19.624 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:19.659 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:19 +0000 (0:00:00.042) 0:03:49.476 ***** 2019-11-28T21:42:19.664 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-11-28T21:42:19.665 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:19.702 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:19 +0000 (0:00:00.042) 0:03:49.518 ***** 2019-11-28T21:42:19.708 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-11-28T21:42:19.708 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:19.746 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:19 +0000 (0:00:00.043) 0:03:49.562 ***** 2019-11-28T21:42:19.751 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-11-28T21:42:19.751 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:19.789 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:19 +0000 (0:00:00.042) 0:03:49.605 ***** 2019-11-28T21:42:19.794 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-11-28T21:42:19.795 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:19.832 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:19 +0000 (0:00:00.043) 0:03:49.649 ***** 2019-11-28T21:42:19.838 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-11-28T21:42:19.840 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:19.877 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:19 +0000 (0:00:00.044) 0:03:49.693 ***** 2019-11-28T21:42:19.893 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:19.920 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:19 +0000 (0:00:00.043) 0:03:49.736 ***** 2019-11-28T21:42:19.925 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-11-28T21:42:19.926 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:19.965 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:19 +0000 (0:00:00.043) 0:03:49.780 ***** 2019-11-28T21:42:19.969 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-11-28T21:42:19.970 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:20.007 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:20 +0000 (0:00:00.043) 0:03:49.823 ***** 2019-11-28T21:42:20.012 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-11-28T21:42:20.012 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:20.051 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:20 +0000 (0:00:00.043) 0:03:49.867 ***** 2019-11-28T21:42:20.087 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-11-28T21:42:20.089 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:20.124 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:20 +0000 (0:00:00.073) 0:03:49.940 ***** 2019-11-28T21:42:20.327 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-11-28T21:42:20.328 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2019-11-28T21:42:20.364 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:20 +0000 (0:00:00.240) 0:03:50.180 ***** 2019-11-28T21:42:20.434 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2019-11-28T21:42:20.475 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:20 +0000 (0:00:00.111) 0:03:50.291 ***** 2019-11-28T21:42:20.682 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-28T21:42:20.682 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-28T21:42:20.719 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:20 +0000 (0:00:00.243) 0:03:50.535 ***** 2019-11-28T21:42:20.819 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-28T21:42:20.856 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:20 +0000 (0:00:00.136) 0:03:50.672 ***** 2019-11-28T21:42:21.060 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-28T21:42:21.061 INFO:teuthology.task.ansible.out: [WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2019-11-28T21:42:21.097 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:21 +0000 (0:00:00.241) 0:03:50.913 ***** 2019-11-28T21:42:21.124 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-11-28T21:42:21.125 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:21.164 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:21 +0000 (0:00:00.066) 0:03:50.980 ***** 2019-11-28T21:42:21.181 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-28T21:42:21.182 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2019-11-28T21:42:21.226 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:21 +0000 (0:00:00.062) 0:03:51.042 ***** 2019-11-28T21:42:21.233 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-11-28T21:42:21.235 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:21.277 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:21 +0000 (0:00:00.049) 0:03:51.092 ***** 2019-11-28T21:42:21.281 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-11-28T21:42:21.283 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:21.322 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:21 +0000 (0:00:00.045) 0:03:51.138 ***** 2019-11-28T21:42:21.330 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-11-28T21:42:21.331 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:21.368 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:21 +0000 (0:00:00.046) 0:03:51.184 ***** 2019-11-28T21:42:21.376 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:21.414 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:21 +0000 (0:00:00.045) 0:03:51.230 ***** 2019-11-28T21:42:21.420 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-11-28T21:42:21.421 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:21.462 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:21 +0000 (0:00:00.048) 0:03:51.278 ***** 2019-11-28T21:42:21.468 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-11-28T21:42:21.468 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:21.507 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:21 +0000 (0:00:00.044) 0:03:51.323 ***** 2019-11-28T21:42:21.512 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-28T21:42:21.514 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:21.553 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:21 +0000 (0:00:00.046) 0:03:51.369 ***** 2019-11-28T21:42:21.558 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-11-28T21:42:21.561 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:21.598 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:21 +0000 (0:00:00.045) 0:03:51.415 ***** 2019-11-28T21:42:21.604 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-28T21:42:21.605 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:21.644 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:21 +0000 (0:00:00.045) 0:03:51.460 ***** 2019-11-28T21:42:21.649 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-28T21:42:21.650 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:21.690 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:21 +0000 (0:00:00.046) 0:03:51.507 ***** 2019-11-28T21:42:21.696 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-11-28T21:42:21.696 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:21.745 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:21 +0000 (0:00:00.054) 0:03:51.561 ***** 2019-11-28T21:42:21.751 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-28T21:42:21.751 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:21.789 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:21 +0000 (0:00:00.044) 0:03:51.606 ***** 2019-11-28T21:42:21.795 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-28T21:42:21.798 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:21.834 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:21 +0000 (0:00:00.045) 0:03:51.651 ***** 2019-11-28T21:42:21.841 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-11-28T21:42:21.842 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:21.886 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:21 +0000 (0:00:00.051) 0:03:51.702 ***** 2019-11-28T21:42:21.894 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:21.931 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:21 +0000 (0:00:00.044) 0:03:51.747 ***** 2019-11-28T21:42:21.936 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-28T21:42:21.937 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:21.973 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:21 +0000 (0:00:00.042) 0:03:51.789 ***** 2019-11-28T21:42:21.978 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2019-11-28T21:42:21.980 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:22.014 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:22 +0000 (0:00:00.041) 0:03:51.830 ***** 2019-11-28T21:42:22.021 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-28T21:42:22.023 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:22.058 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:22 +0000 (0:00:00.043) 0:03:51.874 ***** 2019-11-28T21:42:22.064 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:22.101 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:22 +0000 (0:00:00.043) 0:03:51.917 ***** 2019-11-28T21:42:22.106 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2019-11-28T21:42:22.108 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:22.143 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:22 +0000 (0:00:00.042) 0:03:51.960 ***** 2019-11-28T21:42:22.148 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-11-28T21:42:22.150 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:22.185 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:22 +0000 (0:00:00.041) 0:03:52.002 ***** 2019-11-28T21:42:22.190 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2019-11-28T21:42:22.191 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:22.227 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:22 +0000 (0:00:00.041) 0:03:52.043 ***** 2019-11-28T21:42:22.232 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-11-28T21:42:22.235 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:22.272 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:22 +0000 (0:00:00.044) 0:03:52.088 ***** 2019-11-28T21:42:22.277 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-11-28T21:42:22.279 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:22.320 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:22 +0000 (0:00:00.048) 0:03:52.136 ***** 2019-11-28T21:42:22.325 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2019-11-28T21:42:22.327 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:22.372 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:22 +0000 (0:00:00.052) 0:03:52.188 ***** 2019-11-28T21:42:22.379 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-11-28T21:42:22.379 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:22.422 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:22 +0000 (0:00:00.049) 0:03:52.238 ***** 2019-11-28T21:42:22.428 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2019-11-28T21:42:22.439 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:22.470 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:22 +0000 (0:00:00.047) 0:03:52.286 ***** 2019-11-28T21:42:22.484 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2019-11-28T21:42:22.485 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:22.521 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:22 +0000 (0:00:00.051) 0:03:52.337 ***** 2019-11-28T21:42:22.526 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2019-11-28T21:42:22.526 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:22.565 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:22 +0000 (0:00:00.044) 0:03:52.381 ***** 2019-11-28T21:42:22.570 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2019-11-28T21:42:22.571 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:22.611 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:22 +0000 (0:00:00.045) 0:03:52.427 ***** 2019-11-28T21:42:22.618 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2019-11-28T21:42:22.620 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:22.660 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:22 +0000 (0:00:00.048) 0:03:52.476 ***** 2019-11-28T21:42:22.665 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2019-11-28T21:42:22.667 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:22.707 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:22 +0000 (0:00:00.047) 0:03:52.523 ***** 2019-11-28T21:42:22.714 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:22.752 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:22 +0000 (0:00:00.044) 0:03:52.568 ***** 2019-11-28T21:42:22.756 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2019-11-28T21:42:22.757 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:22.798 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:22 +0000 (0:00:00.046) 0:03:52.615 ***** 2019-11-28T21:42:22.804 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2019-11-28T21:42:22.805 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:22.845 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:22 +0000 (0:00:00.046) 0:03:52.661 ***** 2019-11-28T21:42:22.852 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2019-11-28T21:42:22.853 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:22.891 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:22 +0000 (0:00:00.046) 0:03:52.707 ***** 2019-11-28T21:42:22.905 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:22.934 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:22 +0000 (0:00:00.043) 0:03:52.750 ***** 2019-11-28T21:42:22.938 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2019-11-28T21:42:22.941 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:22.976 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:22 +0000 (0:00:00.042) 0:03:52.793 ***** 2019-11-28T21:42:22.982 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2019-11-28T21:42:22.983 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:23.020 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:23 +0000 (0:00:00.043) 0:03:52.836 ***** 2019-11-28T21:42:23.025 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2019-11-28T21:42:23.026 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:23.065 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:23 +0000 (0:00:00.044) 0:03:52.881 ***** 2019-11-28T21:42:23.070 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2019-11-28T21:42:23.070 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:23.109 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:23 +0000 (0:00:00.044) 0:03:52.925 ***** 2019-11-28T21:42:23.114 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2019-11-28T21:42:23.115 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:23.155 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:23 +0000 (0:00:00.046) 0:03:52.971 ***** 2019-11-28T21:42:23.161 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-28T21:42:23.168 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2019-11-28T21:42:23.201 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:23 +0000 (0:00:00.045) 0:03:53.017 ***** 2019-11-28T21:42:23.207 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2019-11-28T21:42:23.209 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:23.264 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:23 +0000 (0:00:00.063) 0:03:53.080 ***** 2019-11-28T21:42:23.270 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2019-11-28T21:42:23.271 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2019-11-28T21:42:23.273 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [smithi141.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2019-11-28T21:42:23.274 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2019-11-28T21:42:23.284 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2019-11-28T21:42:23.285 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2019-11-28T21:42:23.296 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-28T21:42:23.297 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2019-11-28T21:42:23.299 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi141.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2019-11-28T21:42:23.335 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:23 +0000 (0:00:00.070) 0:03:53.151 ***** 2019-11-28T21:42:23.373 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:23 +0000 (0:00:00.037) 0:03:53.189 ***** 2019-11-28T21:42:23.379 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2019-11-28T21:42:23.392 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2019-11-28T21:42:23.393 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2019-11-28T21:42:23.404 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2019-11-28T21:42:23.404 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2019-11-28T21:42:23.429 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2019-11-28T21:42:23.438 INFO:teuthology.task.ansible.out: 2019-11-28T21:42:23.438 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2019-11-28T21:42:23.483 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:23 +0000 (0:00:00.110) 0:03:53.299 ***** 2019-11-28T21:42:23.521 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi141.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003909", "end": "2019-11-28 21:42:23.498514", "rc": 0, "start": "2019-11-28 21:42:23.494605", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2019-11-28T21:42:23.566 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:23 +0000 (0:00:00.082) 0:03:53.382 ***** 2019-11-28T21:42:23.606 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:23.645 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:23 +0000 (0:00:00.079) 0:03:53.462 ***** 2019-11-28T21:42:23.650 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2019-11-28T21:42:23.651 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003605", "end": "2019-11-28 21:42:23.611824", "rc": 0, "start": "2019-11-28 21:42:23.608219", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2019-11-28T21:42:23.699 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:23 +0000 (0:00:00.053) 0:03:53.515 ***** 2019-11-28T21:42:23.704 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2019-11-28T21:42:23.705 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:23.744 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:23 +0000 (0:00:00.045) 0:03:53.560 ***** 2019-11-28T21:42:23.750 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2019-11-28T21:42:23.751 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:23.794 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:23 +0000 (0:00:00.049) 0:03:53.610 ***** 2019-11-28T21:42:23.800 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2019-11-28T21:42:23.803 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:23.838 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:23 +0000 (0:00:00.044) 0:03:53.655 ***** 2019-11-28T21:42:23.843 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2019-11-28T21:42:23.844 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:23.885 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:23 +0000 (0:00:00.046) 0:03:53.701 ***** 2019-11-28T21:42:23.893 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2019-11-28T21:42:23.894 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:23.932 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:23 +0000 (0:00:00.047) 0:03:53.748 ***** 2019-11-28T21:42:23.937 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2019-11-28T21:42:23.939 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:23.976 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:23 +0000 (0:00:00.044) 0:03:53.792 ***** 2019-11-28T21:42:24.011 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2019-11-28T21:42:24.013 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:24.055 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:24 +0000 (0:00:00.079) 0:03:53.871 ***** 2019-11-28T21:42:24.404 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2019-11-28T21:42:24.405 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "7:device-mapper-1.02.149-8.el7.x86_64 providing device-mapper is already installed"]} 2019-11-28T21:42:24.447 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:24 +0000 (0:00:00.391) 0:03:54.263 ***** 2019-11-28T21:42:24.496 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-11-28T21:42:24.497 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item={u'block_used': 13034915, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227289569, u'size_available': 930978074624, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966955, u'device': u'/dev/sda1', u'inode_used': 88021, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227289569, "block_size": 4096, "block_total": 240324484, "block_used": 13034915, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966955, "inode_total": 61054976, "inode_used": 88021, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930978074624, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}} 2019-11-28T21:42:24.535 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:24 +0000 (0:00:00.087) 0:03:54.351 ***** 2019-11-28T21:42:24.542 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2019-11-28T21:42:24.543 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "7:device-mapper-1.02.149-8.el7.x86_64 providing device-mapper is already installed"]} 2019-11-28T21:42:24.583 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:24 +0000 (0:00:00.047) 0:03:54.399 ***** 2019-11-28T21:42:24.642 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-11-28T21:42:24.642 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item={u'block_used': 13034912, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227289572, u'size_available': 930978086912, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966955, u'device': u'/dev/sda1', u'inode_used': 88021, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227289572, "block_size": 4096, "block_total": 240324484, "block_used": 13034912, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966955, "inode_total": 61054976, "inode_used": 88021, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930978086912, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}} 2019-11-28T21:42:24.680 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:24 +0000 (0:00:00.097) 0:03:54.496 ***** 2019-11-28T21:42:24.853 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2019-11-28T21:42:24.854 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.011000", "end": "2019-11-28 21:42:24.828590", "rc": 0, "start": "2019-11-28 21:42:24.817590", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T21:42:24.891 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:24 +0000 (0:00:00.211) 0:03:54.707 ***** 2019-11-28T21:42:24.939 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2019-11-28T21:42:24.941 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'block_used': 13034915, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227289569, u'size_available': 930978074624, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966955, u'device': u'/dev/sda1', u'inode_used': 88021, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227289569, "block_size": 4096, "block_total": 240324484, "block_used": 13034915, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966955, "inode_total": 61054976, "inode_used": 88021, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930978074624, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:24.978 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:24 +0000 (0:00:00.086) 0:03:54.794 ***** 2019-11-28T21:42:24.984 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2019-11-28T21:42:24.985 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.008940", "end": "2019-11-28 21:42:24.927253", "rc": 0, "start": "2019-11-28 21:42:24.918313", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T21:42:25.021 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:25 +0000 (0:00:00.043) 0:03:54.838 ***** 2019-11-28T21:42:25.027 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2019-11-28T21:42:25.065 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:25 +0000 (0:00:00.043) 0:03:54.881 ***** 2019-11-28T21:42:25.071 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2019-11-28T21:42:25.072 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'block_used': 13034912, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227289572, u'size_available': 930978086912, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966955, u'device': u'/dev/sda1', u'inode_used': 88021, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227289572, "block_size": 4096, "block_total": 240324484, "block_used": 13034912, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966955, "inode_total": 61054976, "inode_used": 88021, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930978086912, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:25.112 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:25 +0000 (0:00:00.047) 0:03:54.929 ***** 2019-11-28T21:42:25.119 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-11-28T21:42:25.120 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XFAY', u'wwn-0x5000c50092924e9d'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XFAY', u'wwn': u'0x5000c50092924e9d', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XFAY-part1', u'wwn-0x5000c50092924e9d-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFAY", "wwn-0x5000c50092924e9d"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFAY-part1", "wwn-0x5000c50092924e9d-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XFAY", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-11-28T21:42:25.122 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c50092924e9d"}}, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:25.132 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2019-11-28T21:42:25.168 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:25 +0000 (0:00:00.055) 0:03:54.984 ***** 2019-11-28T21:42:25.215 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-11-28T21:42:25.216 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QD01', u'wwn-0x5000c50091e03265'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5QD01', u'wwn': u'0x5000c50091e03265', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QD01-part1', u'wwn-0x5000c50091e03265-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QD01", "wwn-0x5000c50091e03265"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QD01-part1", "wwn-0x5000c50091e03265-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QD01", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-11-28T21:42:25.218 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c50091e03265"}}, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:26.977 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-lMyjlu-13JR-Ywhd-ACRd-4HIE-JIYQ-kerPPp', u'nvme-INTEL_SSDPEDMD400G4_CVFT6242001S400BGN', u'nvme-nvme.8086-43564654363234323030315334303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.546403", "end": "2019-11-28 21:42:26.940156", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-lMyjlu-13JR-Ywhd-ACRd-4HIE-JIYQ-kerPPp", "nvme-INTEL_SSDPEDMD400G4_CVFT6242001S400BGN", "nvme-nvme.8086-43564654363234323030315334303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 21:42:25.393753", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2019-11-28T21:42:26.979 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-28T21:42:27.041 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-7GKU9c-Z7Xs-0HJD-j4UD-J7Ei-grvG-ub021a', u'nvme-INTEL_SSDPEDMD400G4_PHFT620400SB400BGN', u'nvme-nvme.8086-50484654363230343030534234303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.512061", "end": "2019-11-28 21:42:27.000434", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-7GKU9c-Z7Xs-0HJD-j4UD-J7Ei-grvG-ub021a", "nvme-INTEL_SSDPEDMD400G4_PHFT620400SB400BGN", "nvme-nvme.8086-50484654363230343030534234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 21:42:25.488373", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2019-11-28T21:42:27.043 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-28T21:42:28.354 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-0QHtF0clRIm5uU200st4kBlAM5JPPk5YQ3Qp80M49Wuv3YcRyhV9hhLOH7b5f8OW'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.065209", "end": "2019-11-28 21:42:28.324454", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-0QHtF0clRIm5uU200st4kBlAM5JPPk5YQ3Qp80M49Wuv3YcRyhV9hhLOH7b5f8OW"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 21:42:27.259245", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-28T21:42:28.418 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-6akurvXzGZv4gfmvYHNENk0LNQWQCDbp1tWAxx2wpDg1brM1TV0OHWY3FZC6EYOE'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.066169", "end": "2019-11-28 21:42:28.385264", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-6akurvXzGZv4gfmvYHNENk0LNQWQCDbp1tWAxx2wpDg1brM1TV0OHWY3FZC6EYOE"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 21:42:27.319095", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-28T21:42:29.748 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-0QHtF0clRIm5uU200st4kBlAM5JPPk5Y9ty8dEE56Oa84scY5mzd7Mqf8hYwt1Fz'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.063169", "end": "2019-11-28 21:42:29.708148", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-0QHtF0clRIm5uU200st4kBlAM5JPPk5Y9ty8dEE56Oa84scY5mzd7Mqf8hYwt1Fz"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 21:42:28.644979", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-28T21:42:29.793 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-6akurvXzGZv4gfmvYHNENk0LNQWQCDbpdPjZ3kG2s2Dw8kHm1hdPhfOMiSq0lcnf'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.069977", "end": "2019-11-28 21:42:29.752397", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-6akurvXzGZv4gfmvYHNENk0LNQWQCDbpdPjZ3kG2s2Dw8kHm1hdPhfOMiSq0lcnf"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 21:42:28.682420", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-28T21:42:31.088 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-0QHtF0clRIm5uU200st4kBlAM5JPPk5YGBLYx5QIUueS8Nbes3IIftuGT0ZsXAuV'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.048957", "end": "2019-11-28 21:42:31.050269", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-0QHtF0clRIm5uU200st4kBlAM5JPPk5YGBLYx5QIUueS8Nbes3IIftuGT0ZsXAuV"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 21:42:30.001312", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-28T21:42:31.153 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-6akurvXzGZv4gfmvYHNENk0LNQWQCDbpjK4yoijtY3lKEOsf4AifGCEM07RtNwf0'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.058918", "end": "2019-11-28 21:42:31.119608", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-6akurvXzGZv4gfmvYHNENk0LNQWQCDbpjK4yoijtY3lKEOsf4AifGCEM07RtNwf0"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 21:42:30.060690", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-28T21:42:32.446 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-0QHtF0clRIm5uU200st4kBlAM5JPPk5YT1whwvYopHpd1heFyuaI335Fy0tOc8Kk'], u'uuids': [u'2000ef70-1a5c-458a-84da-1b720a5151be']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.069335", "end": "2019-11-28 21:42:32.416894", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-0QHtF0clRIm5uU200st4kBlAM5JPPk5YT1whwvYopHpd1heFyuaI335Fy0tOc8Kk"], "labels": [], "masters": [], "uuids": ["2000ef70-1a5c-458a-84da-1b720a5151be"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 21:42:31.347559", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-28T21:42:32.516 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-6akurvXzGZv4gfmvYHNENk0LNQWQCDbphKzRKqivInNWtUtHw6uuQRTplHnb7Ys2'], u'uuids': [u'b790bba2-3037-4100-b20d-6af144f2cbdc']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.067696", "end": "2019-11-28 21:42:32.485747", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-6akurvXzGZv4gfmvYHNENk0LNQWQCDbphKzRKqivInNWtUtHw6uuQRTplHnb7Ys2"], "labels": [], "masters": [], "uuids": ["b790bba2-3037-4100-b20d-6af144f2cbdc"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 21:42:31.418051", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-28T21:42:33.807 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-0QHtF0clRIm5uU200st4kBlAM5JPPk5YrnbSneAqKCwodJZa6OOGeX6MkKdvcpw6'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.055573", "end": "2019-11-28 21:42:33.775619", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-0QHtF0clRIm5uU200st4kBlAM5JPPk5YrnbSneAqKCwodJZa6OOGeX6MkKdvcpw6"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 21:42:32.720046", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-28T21:42:33.854 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:33 +0000 (0:00:08.686) 0:04:03.670 ***** 2019-11-28T21:42:33.903 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-6akurvXzGZv4gfmvYHNENk0LNQWQCDbpG8tSWWsiBzLu2C6OakGY9fE0Ocqh0TTm'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.053874", "end": "2019-11-28 21:42:33.861845", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-6akurvXzGZv4gfmvYHNENk0LNQWQCDbpG8tSWWsiBzLu2C6OakGY9fE0Ocqh0TTm"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 21:42:32.807971", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-28T21:42:33.905 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-11-28T21:42:33.907 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XFAY', u'wwn-0x5000c50092924e9d'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XFAY', u'wwn': u'0x5000c50092924e9d', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XFAY-part1', u'wwn-0x5000c50092924e9d-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFAY", "wwn-0x5000c50092924e9d"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFAY-part1", "wwn-0x5000c50092924e9d-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XFAY", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-11-28T21:42:33.909 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c50092924e9d"}}, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:33.915 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-11-28T21:42:33.954 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:33 +0000 (0:00:00.100) 0:04:03.770 ***** 2019-11-28T21:42:33.991 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-11-28T21:42:33.992 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QD01', u'wwn-0x5000c50091e03265'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5QD01', u'wwn': u'0x5000c50091e03265', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QD01-part1', u'wwn-0x5000c50091e03265-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QD01", "wwn-0x5000c50091e03265"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QD01-part1", "wwn-0x5000c50091e03265-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QD01", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-11-28T21:42:33.994 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c50091e03265"}}, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:34.256 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-lMyjlu-13JR-Ywhd-ACRd-4HIE-JIYQ-kerPPp', u'nvme-INTEL_SSDPEDMD400G4_CVFT6242001S400BGN', u'nvme-nvme.8086-43564654363234323030315334303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.062784", "end": "2019-11-28 21:42:34.223050", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-lMyjlu-13JR-Ywhd-ACRd-4HIE-JIYQ-kerPPp", "nvme-INTEL_SSDPEDMD400G4_CVFT6242001S400BGN", "nvme-nvme.8086-43564654363234323030315334303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 21:42:34.160266", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) co 2019-11-28T21:42:34.257 INFO:teuthology.task.ansible.out:pied, 0.0569812 s, 2.0 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.0569812 s, 2.0 GB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T21:42:34.402 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-7GKU9c-Z7Xs-0HJD-j4UD-J7Ei-grvG-ub021a', u'nvme-INTEL_SSDPEDMD400G4_PHFT620400SB400BGN', u'nvme-nvme.8086-50484654363230343030534234303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.087957", "end": "2019-11-28 21:42:34.366973", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-7GKU9c-Z7Xs-0HJD-j4UD-J7Ei-grvG-ub021a", "nvme-INTEL_SSDPEDMD400G4_PHFT620400SB400BGN", "nvme-nvme.8086-50484654363230343030534234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 21:42:34.279016", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) co 2019-11-28T21:42:34.404 INFO:teuthology.task.ansible.out:pied, 0.0813327 s, 1.4 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.0813327 s, 1.4 GB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T21:42:34.697 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-0QHtF0clRIm5uU200st4kBlAM5JPPk5YQ3Qp80M49Wuv3YcRyhV9hhLOH7b5f8OW'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.196874", "end": "2019-11-28 21:42:34.669390", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-0QHtF0clRIm5uU200st4kBlAM5JPPk5YQ3Qp80M49Wuv3YcRyhV9hhLOH7b5f8OW"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 21:42:34.472516", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.190653 s, 605 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.190653 s, 605 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T21:42:34.883 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-6akurvXzGZv4gfmvYHNENk0LNQWQCDbp1tWAxx2wpDg1brM1TV0OHWY3FZC6EYOE'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.200257", "end": "2019-11-28 21:42:34.847715", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-6akurvXzGZv4gfmvYHNENk0LNQWQCDbp1tWAxx2wpDg1brM1TV0OHWY3FZC6EYOE"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 21:42:34.647458", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.193813 s, 595 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.193813 s, 595 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T21:42:35.195 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-0QHtF0clRIm5uU200st4kBlAM5JPPk5Y9ty8dEE56Oa84scY5mzd7Mqf8hYwt1Fz'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.198955", "end": "2019-11-28 21:42:35.157947", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-0QHtF0clRIm5uU200st4kBlAM5JPPk5Y9ty8dEE56Oa84scY5mzd7Mqf8hYwt1Fz"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 21:42:34.958992", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.192476 s, 599 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.192476 s, 599 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T21:42:35.343 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-6akurvXzGZv4gfmvYHNENk0LNQWQCDbpdPjZ3kG2s2Dw8kHm1hdPhfOMiSq0lcnf'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.199321", "end": "2019-11-28 21:42:35.307687", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-6akurvXzGZv4gfmvYHNENk0LNQWQCDbpdPjZ3kG2s2Dw8kHm1hdPhfOMiSq0lcnf"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 21:42:35.108366", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.193202 s, 597 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.193202 s, 597 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T21:42:35.635 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-0QHtF0clRIm5uU200st4kBlAM5JPPk5YGBLYx5QIUueS8Nbes3IIftuGT0ZsXAuV'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.173475", "end": "2019-11-28 21:42:35.600737", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-0QHtF0clRIm5uU200st4kBlAM5JPPk5YGBLYx5QIUueS8Nbes3IIftuGT0ZsXAuV"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 21:42:35.427262", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.167671 s, 688 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.167671 s, 688 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T21:42:35.832 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-6akurvXzGZv4gfmvYHNENk0LNQWQCDbpjK4yoijtY3lKEOsf4AifGCEM07RtNwf0'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.172964", "end": "2019-11-28 21:42:35.801960", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-6akurvXzGZv4gfmvYHNENk0LNQWQCDbpjK4yoijtY3lKEOsf4AifGCEM07RtNwf0"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 21:42:35.628996", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.166615 s, 692 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.166615 s, 692 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T21:42:36.103 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-0QHtF0clRIm5uU200st4kBlAM5JPPk5YT1whwvYopHpd1heFyuaI335Fy0tOc8Kk'], u'uuids': [u'2000ef70-1a5c-458a-84da-1b720a5151be']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.183529", "end": "2019-11-28 21:42:36.069038", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-0QHtF0clRIm5uU200st4kBlAM5JPPk5YT1whwvYopHpd1heFyuaI335Fy0tOc8Kk"], "labels": [], "masters": [], "uuids": ["2000ef70-1a5c-458a-84da-1b720a5151be"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 21:42:35.885509", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.177922 s, 648 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.177922 s, 648 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T21:42:36.344 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-6akurvXzGZv4gfmvYHNENk0LNQWQCDbphKzRKqivInNWtUtHw6uuQRTplHnb7Ys2'], u'uuids': [u'b790bba2-3037-4100-b20d-6af144f2cbdc']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.210971", "end": "2019-11-28 21:42:36.308776", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-6akurvXzGZv4gfmvYHNENk0LNQWQCDbphKzRKqivInNWtUtHw6uuQRTplHnb7Ys2"], "labels": [], "masters": [], "uuids": ["b790bba2-3037-4100-b20d-6af144 2019-11-28T21:42:36.346 INFO:teuthology.task.ansible.out:f2cbdc"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 21:42:36.097805", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.204479 s, 564 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.204479 s, 564 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T21:42:36.586 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-0QHtF0clRIm5uU200st4kBlAM5JPPk5YrnbSneAqKCwodJZa6OOGeX6MkKdvcpw6'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.181580", "end": "2019-11-28 21:42:36.546752", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-0QHtF0clRIm5uU200st4kBlAM5JPPk5YrnbSneAqKCwodJZa6OOGeX6MkKdvcpw6"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 21:42:36.365172", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.175724 s, 656 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.175724 s, 656 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T21:42:36.623 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:36 +0000 (0:00:02.668) 0:04:06.439 ***** 2019-11-28T21:42:36.849 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-6akurvXzGZv4gfmvYHNENk0LNQWQCDbpG8tSWWsiBzLu2C6OakGY9fE0Ocqh0TTm'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.195280", "end": "2019-11-28 21:42:36.802036", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-6akurvXzGZv4gfmvYHNENk0LNQWQCDbpG8tSWWsiBzLu2C6OakGY9fE0Ocqh0TTm"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-28 21:42:36.606756", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.188521 s, 612 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.188521 s, 612 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-28T21:42:36.886 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:36 +0000 (0:00:00.262) 0:04:06.702 ***** 2019-11-28T21:42:37.017 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2019-11-28T21:42:37.019 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.087404", "end": "2019-11-28 21:42:36.980683", "rc": 0, "start": "2019-11-28 21:42:36.893279", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T21:42:37.059 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:37 +0000 (0:00:00.172) 0:04:06.875 ***** 2019-11-28T21:42:37.275 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.080316", "end": "2019-11-28 21:42:37.235934", "rc": 0, "start": "2019-11-28 21:42:37.155618", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T21:42:37.315 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:37 +0000 (0:00:00.256) 0:04:07.131 ***** 2019-11-28T21:42:37.436 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2019-11-28T21:42:37.437 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.054046", "end": "2019-11-28 21:42:37.402084", "rc": 0, "start": "2019-11-28 21:42:37.348038", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T21:42:37.476 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:37 +0000 (0:00:00.160) 0:04:07.292 ***** 2019-11-28T21:42:37.502 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2019-11-28T21:42:37.548 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:37 +0000 (0:00:00.071) 0:04:07.364 ***** 2019-11-28T21:42:37.574 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2019-11-28T21:42:37.575 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:37.619 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:37 +0000 (0:00:00.070) 0:04:07.434 ***** 2019-11-28T21:42:37.660 INFO:teuthology.task.ansible.out: 2019-11-28T21:42:37.661 INFO:teuthology.task.ansible.out:TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:37.700 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:37 +0000 (0:00:00.081) 0:04:07.516 ***** 2019-11-28T21:42:37.705 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2019-11-28T21:42:37.707 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.060602", "end": "2019-11-28 21:42:37.639396", "rc": 0, "start": "2019-11-28 21:42:37.578794", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T21:42:37.750 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:37 +0000 (0:00:00.050) 0:04:07.566 ***** 2019-11-28T21:42:37.756 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-11-28T21:42:37.757 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:37.806 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:37 +0000 (0:00:00.056) 0:04:07.622 ***** 2019-11-28T21:42:37.812 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2019-11-28T21:42:37.856 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:37 +0000 (0:00:00.049) 0:04:07.672 ***** 2019-11-28T21:42:37.862 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2019-11-28T21:42:37.864 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:37.906 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:37 +0000 (0:00:00.050) 0:04:07.722 ***** 2019-11-28T21:42:37.913 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:37.960 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:37 +0000 (0:00:00.050) 0:04:07.773 ***** 2019-11-28T21:42:37.984 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2019-11-28T21:42:37.986 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:38.031 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:38 +0000 (0:00:00.073) 0:04:07.847 ***** 2019-11-28T21:42:38.057 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-11-28T21:42:38.059 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:38.101 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:38 +0000 (0:00:00.069) 0:04:07.917 ***** 2019-11-28T21:42:38.127 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2019-11-28T21:42:38.129 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:38.171 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:38 +0000 (0:00:00.070) 0:04:07.987 ***** 2019-11-28T21:42:38.221 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2019-11-28T21:42:38.222 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-28T21:42:38.264 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:38 +0000 (0:00:00.092) 0:04:08.080 ***** 2019-11-28T21:42:38.301 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-11-28T21:42:38.302 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={u'block_used': 13034915, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227289569, u'size_available': 930978074624, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966955, u'device': u'/dev/sda1', u'inode_used': 88021, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227289569, "block_size": 4096, "block_total": 240324484, "block_used": 13034915, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966955, "inode_total": 61054976, "inode_used": 88021, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930978074624, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:38.344 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:38 +0000 (0:00:00.080) 0:04:08.160 ***** 2019-11-28T21:42:38.385 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2019-11-28T21:42:38.387 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:38.431 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:38 +0000 (0:00:00.087) 0:04:08.248 ***** 2019-11-28T21:42:38.459 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-28T21:42:38.461 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:38.505 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:38 +0000 (0:00:00.073) 0:04:08.321 ***** 2019-11-28T21:42:38.510 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2019-11-28T21:42:38.511 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-28T21:42:38.569 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:38 +0000 (0:00:00.064) 0:04:08.385 ***** 2019-11-28T21:42:38.576 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-28T21:42:38.578 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:38.618 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:38 +0000 (0:00:00.048) 0:04:08.434 ***** 2019-11-28T21:42:38.622 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-11-28T21:42:38.623 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={u'block_used': 13034912, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227289572, u'size_available': 930978086912, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966955, u'device': u'/dev/sda1', u'inode_used': 88021, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227289572, "block_size": 4096, "block_total": 240324484, "block_used": 13034912, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966955, "inode_total": 61054976, "inode_used": 88021, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930978086912, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:38.663 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:38 +0000 (0:00:00.044) 0:04:08.479 ***** 2019-11-28T21:42:38.668 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2019-11-28T21:42:38.670 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:38.706 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:38 +0000 (0:00:00.043) 0:04:08.522 ***** 2019-11-28T21:42:38.716 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:38.748 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:38 +0000 (0:00:00.042) 0:04:08.564 ***** 2019-11-28T21:42:38.754 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2019-11-28T21:42:38.757 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:38.794 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:38 +0000 (0:00:00.045) 0:04:08.610 ***** 2019-11-28T21:42:38.799 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-28T21:42:38.799 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:38.837 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:38 +0000 (0:00:00.043) 0:04:08.653 ***** 2019-11-28T21:42:38.843 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2019-11-28T21:42:38.845 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:38.882 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:38 +0000 (0:00:00.044) 0:04:08.698 ***** 2019-11-28T21:42:38.888 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-28T21:42:38.890 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:38.926 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:38 +0000 (0:00:00.044) 0:04:08.743 ***** 2019-11-28T21:42:38.963 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2019-11-28T21:42:38.965 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:39.001 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:38 +0000 (0:00:00.074) 0:04:08.818 ***** 2019-11-28T21:42:39.028 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2019-11-28T21:42:39.030 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:39.066 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:39 +0000 (0:00:00.064) 0:04:08.882 ***** 2019-11-28T21:42:39.092 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2019-11-28T21:42:39.094 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:39.133 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:39 +0000 (0:00:00.067) 0:04:08.949 ***** 2019-11-28T21:42:39.691 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2019-11-28T21:42:39.693 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} changed: [smithi074.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2019-11-28T21:42:39.741 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:39 +0000 (0:00:00.595) 0:04:09.545 ***** 2019-11-28T21:42:39.760 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:39 +0000 (0:00:00.032) 0:04:09.577 ***** 2019-11-28T21:42:40.491 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-11-28T21:42:40.493 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} changed: [smithi141.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-28T21:42:40.938 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-28T21:42:40.990 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-28T21:42:41.383 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-28T21:42:41.457 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-28T21:42:41.833 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-28T21:42:41.960 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-28T21:42:42.300 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-28T21:42:42.359 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:42 +0000 (0:00:02.598) 0:04:12.175 ***** 2019-11-28T21:42:42.430 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-28T21:42:42.470 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:42 +0000 (0:00:00.110) 0:04:12.286 ***** 2019-11-28T21:42:42.694 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-11-28T21:42:42.696 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2019-11-28T21:42:42.746 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:42 +0000 (0:00:00.276) 0:04:12.562 ***** 2019-11-28T21:42:42.794 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-11-28T21:42:42.795 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:42.797 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [smithi141.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2019-11-28T21:42:42.834 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:42 +0000 (0:00:00.088) 0:04:12.650 ***** 2019-11-28T21:42:42.881 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-11-28T21:42:42.882 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:43.102 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-28T21:42:43.207 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-28T21:42:43.398 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-28T21:42:43.525 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-28T21:42:43.702 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-28T21:42:43.839 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-28T21:42:43.998 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-28T21:42:44.039 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:44 +0000 (0:00:01.204) 0:04:13.855 ***** 2019-11-28T21:42:44.041 INFO:teuthology.task.ansible.out: 2019-11-28T21:42:44.151 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-28T21:42:44.194 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:44 +0000 (0:00:00.154) 0:04:14.010 ***** 2019-11-28T21:42:44.334 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2019-11-28T21:42:44.334 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-28T21:42:44.373 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:44 +0000 (0:00:00.179) 0:04:14.189 ***** 2019-11-28T21:42:44.410 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2019-11-28T21:42:44.412 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2019-11-28T21:42:44.450 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:44 +0000 (0:00:00.077) 0:04:14.267 ***** 2019-11-28T21:42:44.529 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2019-11-28T21:42:44.531 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-28T21:42:44.569 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:44 +0000 (0:00:00.118) 0:04:14.385 ***** 2019-11-28T21:42:44.606 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2019-11-28T21:42:44.608 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2019-11-28T21:42:44.643 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:44 +0000 (0:00:00.074) 0:04:14.459 ***** 2019-11-28T21:42:45.170 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2019-11-28T21:42:45.172 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => {"changed": true} changed: [smithi074.front.sepia.ceph.com] => {"changed": true} 2019-11-28T21:42:45.216 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:45 +0000 (0:00:00.572) 0:04:15.032 ***** 2019-11-28T21:42:45.258 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:45 +0000 (0:00:00.042) 0:04:15.074 ***** 2019-11-28T21:42:45.959 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2019-11-28T21:42:45.960 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} changed: [smithi074.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2019-11-28T21:42:46.002 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:45 +0000 (0:00:00.743) 0:04:15.818 ***** 2019-11-28T21:42:46.041 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:46 +0000 (0:00:00.038) 0:04:15.857 ***** 2019-11-28T21:42:46.047 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2019-11-28T21:42:46.048 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:46.090 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:46 +0000 (0:00:00.049) 0:04:15.907 ***** 2019-11-28T21:42:46.097 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:46.156 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:46 +0000 (0:00:00.065) 0:04:15.972 ***** 2019-11-28T21:42:46.163 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2019-11-28T21:42:46.164 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:46.204 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:46 +0000 (0:00:00.047) 0:04:16.020 ***** 2019-11-28T21:42:46.211 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:46.250 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:46 +0000 (0:00:00.045) 0:04:16.066 ***** 2019-11-28T21:42:46.259 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2019-11-28T21:42:46.259 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:46.304 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:46 +0000 (0:00:00.053) 0:04:16.120 ***** 2019-11-28T21:42:46.310 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:46.352 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:46 +0000 (0:00:00.047) 0:04:16.168 ***** 2019-11-28T21:42:46.357 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2019-11-28T21:42:46.358 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:46.404 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:46 +0000 (0:00:00.052) 0:04:16.220 ***** 2019-11-28T21:42:46.411 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:46.453 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:46 +0000 (0:00:00.049) 0:04:16.269 ***** 2019-11-28T21:42:46.459 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2019-11-28T21:42:46.461 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:46.501 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:46 +0000 (0:00:00.048) 0:04:16.318 ***** 2019-11-28T21:42:46.511 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:46.551 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:46 +0000 (0:00:00.049) 0:04:16.367 ***** 2019-11-28T21:42:46.557 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2019-11-28T21:42:46.558 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:46.595 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:46 +0000 (0:00:00.044) 0:04:16.411 ***** 2019-11-28T21:42:46.602 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:46.640 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:46 +0000 (0:00:00.045) 0:04:16.457 ***** 2019-11-28T21:42:46.646 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2019-11-28T21:42:46.647 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:46.685 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:46 +0000 (0:00:00.044) 0:04:16.501 ***** 2019-11-28T21:42:46.692 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:46.730 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:46 +0000 (0:00:00.044) 0:04:16.546 ***** 2019-11-28T21:42:47.196 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2019-11-28T21:42:47.197 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["ntp-4.2.6p5-28.el7.centos.x86_64 providing ntp is already installed"]} ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["ntp-4.2.6p5-28.el7.centos.x86_64 providing ntp is already installed"]} 2019-11-28T21:42:47.240 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:47 +0000 (0:00:00.510) 0:04:17.056 ***** 2019-11-28T21:42:47.279 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:47 +0000 (0:00:00.038) 0:04:17.095 ***** 2019-11-28T21:42:47.284 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2019-11-28T21:42:47.284 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:47.331 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:47 +0000 (0:00:00.052) 0:04:17.147 ***** 2019-11-28T21:42:47.340 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:47.383 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:47 +0000 (0:00:00.052) 0:04:17.200 ***** 2019-11-28T21:42:47.390 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2019-11-28T21:42:47.390 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:47.432 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:47 +0000 (0:00:00.048) 0:04:17.248 ***** 2019-11-28T21:42:47.441 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:47.482 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:47 +0000 (0:00:00.049) 0:04:17.298 ***** 2019-11-28T21:42:48.356 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "secontext": "system_u:object_r:net_conf_t:s0", "size": 2767, "state": "file", "uid": 0} 2019-11-28T21:42:48.397 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:48 +0000 (0:00:00.914) 0:04:18.213 ***** 2019-11-28T21:42:48.404 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "secontext": "system_u:object_r:net_conf_t:s0", "size": 2767, "state": "file", "uid": 0} 2019-11-28T21:42:48.445 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:48 +0000 (0:00:00.048) 0:04:18.262 ***** 2019-11-28T21:42:48.457 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:48.492 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:48 +0000 (0:00:00.046) 0:04:18.308 ***** 2019-11-28T21:42:48.498 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:48.538 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:48 +0000 (0:00:00.046) 0:04:18.354 ***** 2019-11-28T21:42:48.981 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2019-11-28T21:42:49.071 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => {"changed": true, "enabled": true, "name": "ntpd", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "sntp.service systemd-journald.socket syslog.target basic.target -.mount tmp.mount ntpdate.service system.slice", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target multi-user.target chronyd.service", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConflictedBy": "chronyd.service", "Conflicts": "shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "EnvironmentFile": "/etc/sysconfig/ntpd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/ntpd ; argv[]=/usr/sbin/ntpd -u ntp:ntp $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/ntpd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "ntpd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "1844674407370955161 2019-11-28T21:42:49.073 INFO:teuthology.task.ansible.out:5", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127510", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127510", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "ntpd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec 2019-11-28T21:42:49.074 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} Thursday 28 November 2019 21:42:49 +0000 (0:00:00.486) 0:04:18.841 ***** changed: [smithi141.front.sepia.ceph.com] => {"changed": true, "enabled": true, "name": "ntpd", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "syslog.target system.slice tmp.mount -.mount sntp.service basic.target ntpdate.service systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "chronyd.service shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConflictedBy": "chronyd.service", "Conflicts": "shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "EnvironmentFile": "/etc/sysconfig/ntpd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/ntpd ; argv[]=/usr/sbin/ntpd -u ntp:ntp $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/ntpd.service", "GuessMainPID": "yes", "IOSc 2019-11-28T21:42:49.076 INFO:teuthology.task.ansible.out:heduling": "0", "Id": "ntpd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "ntpd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "S 2019-11-28T21:42:49.077 INFO:teuthology.task.ansible.out:yslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-11-28T21:42:49.106 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:49 +0000 (0:00:00.081) 0:04:18.922 ***** 2019-11-28T21:42:49.942 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2019-11-28T21:42:49.943 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["python2-pip-8.1.2-10.el7.noarch providing python-pip is already installed"]} 2019-11-28T21:42:49.990 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:49 +0000 (0:00:00.883) 0:04:19.806 ***** 2019-11-28T21:42:49.996 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["python2-pip-8.1.2-10.el7.noarch providing python-pip is already installed"]} 2019-11-28T21:42:50.037 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:50 +0000 (0:00:00.046) 0:04:19.853 ***** 2019-11-28T21:42:50.042 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2019-11-28T21:42:50.043 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:50.083 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:50 +0000 (0:00:00.046) 0:04:19.900 ***** 2019-11-28T21:42:50.090 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:50.130 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:50 +0000 (0:00:00.046) 0:04:19.946 ***** 2019-11-28T21:42:50.416 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2019-11-28T21:42:50.416 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2019-11-28T21:42:50.453 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:50 +0000 (0:00:00.323) 0:04:20.269 ***** 2019-11-28T21:42:50.459 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2019-11-28T21:42:50.498 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:50 +0000 (0:00:00.045) 0:04:20.314 ***** 2019-11-28T21:42:51.372 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2019-11-28T21:42:51.373 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2019-11-28T21:42:51.422 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:51 +0000 (0:00:00.923) 0:04:21.238 ***** 2019-11-28T21:42:51.429 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2019-11-28T21:42:51.469 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:51 +0000 (0:00:00.046) 0:04:21.284 ***** 2019-11-28T21:42:53.207 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "You are using pip version 8.1.2, however version 19.3.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n", "stderr_lines": ["You are using pip version 8.1.2, however version 19.3.1 is available.", "You should consider upgrading via the 'pip install --upgrade pip' command."], "stdout": "Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages\nRequirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)\nRequirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages", "Requirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)", "Requirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2019-11-28T21:42:53.243 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:53 +0000 (0:00:01.774) 0:04:23.059 ***** 2019-11-28T21:42:53.244 INFO:teuthology.task.ansible.out: 2019-11-28T21:42:53.271 INFO:teuthology.task.ansible.out: 2019-11-28T21:42:53.272 INFO:teuthology.task.ansible.out:TASK [testnode : Purge resolvconf] ********************************************* skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:53.312 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:53 +0000 (0:00:00.069) 0:04:23.128 ***** 2019-11-28T21:42:53.327 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2019-11-28T21:42:53.328 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "You are using pip version 8.1.2, however version 19.3.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n", "stderr_lines": ["You are using pip version 8.1.2, however version 19.3.1 is available.", "You should consider upgrading via the 'pip install --upgrade pip' command."], "stdout": "Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages\nRequirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)\nRequirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages", "Requirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)", "Requirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2019-11-28T21:42:53.365 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:53 +0000 (0:00:00.052) 0:04:23.181 ***** 2019-11-28T21:42:53.371 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2019-11-28T21:42:53.373 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2019-11-28T21:42:53.411 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:53 +0000 (0:00:00.046) 0:04:23.227 ***** 2019-11-28T21:42:53.416 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2019-11-28T21:42:53.418 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:53.458 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:53 +0000 (0:00:00.046) 0:04:23.274 ***** 2019-11-28T21:42:53.485 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2019-11-28T21:42:53.486 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2019-11-28T21:42:53.523 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:53 +0000 (0:00:00.065) 0:04:23.339 ***** 2019-11-28T21:42:53.733 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** ok: [smithi141.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2019-11-28T21:42:53.769 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:53 +0000 (0:00:00.245) 0:04:23.585 ***** 2019-11-28T21:42:53.797 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2019-11-28T21:42:53.798 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:53.833 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:53 +0000 (0:00:00.064) 0:04:23.650 ***** 2019-11-28T21:42:53.839 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2019-11-28T21:42:53.840 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2019-11-28T21:42:53.880 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:53 +0000 (0:00:00.046) 0:04:23.696 ***** 2019-11-28T21:42:53.886 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2019-11-28T21:42:53.886 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2019-11-28T21:42:53.928 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:53 +0000 (0:00:00.048) 0:04:23.744 ***** 2019-11-28T21:42:53.934 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2019-11-28T21:42:53.936 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:53.974 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:53 +0000 (0:00:00.045) 0:04:23.790 ***** 2019-11-28T21:42:53.980 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2019-11-28T21:42:53.981 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:54.026 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:54 +0000 (0:00:00.052) 0:04:23.843 ***** 2019-11-28T21:42:54.032 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2019-11-28T21:42:54.041 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2019-11-28T21:42:54.077 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:54 +0000 (0:00:00.050) 0:04:23.893 ***** 2019-11-28T21:42:54.104 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2019-11-28T21:42:54.107 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:54.144 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:54 +0000 (0:00:00.067) 0:04:23.961 ***** 2019-11-28T21:42:54.323 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2019-11-28T21:42:54.324 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2019-11-28T21:42:54.363 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:54 +0000 (0:00:00.218) 0:04:24.179 ***** 2019-11-28T21:42:54.452 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2019-11-28T21:42:54.490 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:54 +0000 (0:00:00.127) 0:04:24.306 ***** 2019-11-28T21:42:54.673 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2019-11-28T21:42:54.674 INFO:teuthology.task.ansible.out:changed: [smithi141.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2019-11-28T21:42:54.718 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:54 +0000 (0:00:00.228) 0:04:24.534 ***** 2019-11-28T21:42:54.751 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:54.785 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:54 +0000 (0:00:00.066) 0:04:24.601 ***** 2019-11-28T21:42:54.801 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2019-11-28T21:42:54.802 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2019-11-28T21:42:54.849 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:54 +0000 (0:00:00.064) 0:04:24.666 ***** 2019-11-28T21:42:54.855 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2019-11-28T21:42:54.856 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2019-11-28T21:42:54.857 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi141.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2019-11-28T21:42:54.859 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi141.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2019-11-28T21:42:54.898 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:54 +0000 (0:00:00.048) 0:04:24.714 ***** 2019-11-28T21:42:54.903 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2019-11-28T21:42:54.904 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:54.951 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:54 +0000 (0:00:00.053) 0:04:24.767 ***** 2019-11-28T21:42:54.958 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2019-11-28T21:42:54.959 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:54.961 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:54.962 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi141.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:54.964 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:55.006 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:55 +0000 (0:00:00.054) 0:04:24.822 ***** 2019-11-28T21:42:55.012 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2019-11-28T21:42:55.012 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2019-11-28T21:42:55.014 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi074.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2019-11-28T21:42:55.016 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi074.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2019-11-28T21:42:55.054 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:55 +0000 (0:00:00.048) 0:04:24.870 ***** 2019-11-28T21:42:55.060 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-28T21:42:55.061 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:55.108 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:55 +0000 (0:00:00.053) 0:04:24.924 ***** 2019-11-28T21:42:55.113 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2019-11-28T21:42:55.114 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:55.116 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:55.117 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi074.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:55.118 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:55.159 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:55 +0000 (0:00:00.050) 0:04:24.975 ***** 2019-11-28T21:42:55.165 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2019-11-28T21:42:55.167 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:55.204 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:55 +0000 (0:00:00.045) 0:04:25.020 ***** 2019-11-28T21:42:55.209 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-28T21:42:55.213 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:55.251 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:55 +0000 (0:00:00.046) 0:04:25.067 ***** 2019-11-28T21:42:55.257 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2019-11-28T21:42:55.259 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:55.299 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:55 +0000 (0:00:00.047) 0:04:25.115 ***** 2019-11-28T21:42:55.304 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2019-11-28T21:42:55.305 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:55.350 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:55 +0000 (0:00:00.046) 0:04:25.161 ***** 2019-11-28T21:42:55.353 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:55.389 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:55 +0000 (0:00:00.044) 0:04:25.206 ***** 2019-11-28T21:42:55.395 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2019-11-28T21:42:55.395 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:55.442 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:55 +0000 (0:00:00.045) 0:04:25.252 ***** TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:55.482 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:55 +0000 (0:00:00.046) 0:04:25.298 ***** 2019-11-28T21:42:55.488 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2019-11-28T21:42:55.490 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:55.526 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:55 +0000 (0:00:00.044) 0:04:25.343 ***** 2019-11-28T21:42:55.532 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-11-28T21:42:55.534 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:55.574 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:55 +0000 (0:00:00.047) 0:04:25.390 ***** 2019-11-28T21:42:55.579 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2019-11-28T21:42:55.581 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:55.620 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:55 +0000 (0:00:00.045) 0:04:25.436 ***** 2019-11-28T21:42:55.626 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2019-11-28T21:42:55.627 INFO:teuthology.task.ansible.out:skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:55.674 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:55 +0000 (0:00:00.053) 0:04:25.490 ***** 2019-11-28T21:42:55.685 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:55.728 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:55 +0000 (0:00:00.048) 0:04:25.538 ***** 2019-11-28T21:42:55.730 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi141.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:55.770 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:55 +0000 (0:00:00.048) 0:04:25.586 ***** 2019-11-28T21:42:55.780 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:55.820 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:55 +0000 (0:00:00.048) 0:04:25.634 ***** 2019-11-28T21:42:55.847 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-11-28T21:42:55.848 INFO:teuthology.task.ansible.out:skipping: [smithi074.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-28T21:42:55.888 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:55 +0000 (0:00:00.070) 0:04:25.704 ***** 2019-11-28T21:42:56.122 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-11-28T21:42:56.130 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.016842", "end": "2019-11-28 21:42:56.081914", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2019-11-28 21:42:56.065072", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T21:42:56.226 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.012912", "end": "2019-11-28 21:42:56.182306", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2019-11-28 21:42:56.169394", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T21:42:56.443 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.007060", "end": "2019-11-28 21:42:56.401262", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2019-11-28 21:42:56.394202", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T21:42:56.517 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006893", "end": "2019-11-28 21:42:56.477379", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2019-11-28 21:42:56.470486", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T21:42:56.755 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.006980", "end": "2019-11-28 21:42:56.713244", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2019-11-28 21:42:56.706264", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2019-11-28T21:42:56.832 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.006238", "end": "2019-11-28 21:42:56.791398", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2019-11-28 21:42:56.785160", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2019-11-28T21:42:57.080 INFO:teuthology.task.ansible.out:ok: [smithi141.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.030648", "end": "2019-11-28 21:42:57.037609", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2019-11-28 21:42:57.006961", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T21:42:57.118 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:57 +0000 (0:00:01.228) 0:04:26.933 ***** 2019-11-28T21:42:57.124 INFO:teuthology.task.ansible.out:ok: [smithi074.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.032389", "end": "2019-11-28 21:42:57.077276", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2019-11-28 21:42:57.044887", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-28T21:42:57.165 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:57 +0000 (0:00:00.047) 0:04:26.981 ***** 2019-11-28T21:42:57.171 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2019-11-28T21:42:57.208 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:57 +0000 (0:00:00.043) 0:04:27.024 ***** 2019-11-28T21:42:57.252 INFO:teuthology.task.ansible.out:Thursday 28 November 2019 21:42:57 +0000 (0:00:00.044) 0:04:27.068 ***** 2019-11-28T21:42:57.530 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** changed: [smithi141.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2019-11-28T21:42:57.579 INFO:teuthology.task.ansible.out:changed: [smithi074.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2019-11-28T21:42:57.696 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2019-11-28T21:42:57.699 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2019-11-28T21:42:57.701 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2019-11-28T21:42:57.702 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* smithi074.front.sepia.ceph.com : ok=121 changed=39 unreachable=0 failed=0 skipped=159 rescued=0 ignored=3 smithi141.front.sepia.ceph.com : ok=121 changed=39 unreachable=0 failed=0 skipped=159 rescued=0 ignored=3 Thursday 28 November 2019 21:42:57 +0000 (0:00:00.448) 0:04:27.517 ***** =============================================================================== users : Create all admin users with sudo access. ----------------------- 39.47s users : Update authorized_keys using the keys repo --------------------- 38.12s testnode : Install packages -------------------------------------------- 18.10s common : Update yum cache ---------------------------------------------- 13.41s users : Remove revoked users -------------------------------------------- 8.79s testnode : Zap all non-root disks --------------------------------------- 8.69s testnode : Ensure ceph packages are not present. ------------------------ 8.52s common : nrpe - Remove SELinux policy package --------------------------- 5.94s 2019-11-28T21:42:57.704 INFO:teuthology.task.ansible.out:common : nrpe - Load SELinux policy package ----------------------------- 5.79s Gathering Facts --------------------------------------------------------- 3.36s common : nrpe - Set SELinux boolean nagios_run_sudo true ---------------- 2.87s ansible-managed : Add authorized keys for the ansible user. ------------- 2.77s testnode : Blow away lingering OSD data and FSIDs ----------------------- 2.67s testnode : Create logical volume(s) ------------------------------------- 2.60s users : Update authorized_keys for each user with literal keys ---------- 2.56s common : Make sure smartmontools is installed --------------------------- 2.27s common : Configure local epel mirrorlists ------------------------------- 2.14s common : Configure epel repos in /etc/yum.repos.d/ ---------------------- 1.92s testnode : Install packages via pip ------------------------------------- 1.78s testnode : Ensure ceph dependency packages are not present. ------------- 1.73s 2019-11-28T21:42:57.959 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi074.front.sepia.ceph.com'), Remote(name='ubuntu@smithi141.front.sepia.ceph.com')] 2019-11-28T21:42:57.961 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T21:42:57.962 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi074.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:42:58.067 INFO:teuthology.orchestra.run.smithi074:> true 2019-11-28T21:42:58.438 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-28T21:42:58.438 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi141.front.sepia.ceph.com', 'timeout': 60} 2019-11-28T21:42:58.581 INFO:teuthology.orchestra.run.smithi141:> true 2019-11-28T21:42:58.933 INFO:teuthology.run_tasks:Running task clock... 2019-11-28T21:42:58.951 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2019-11-28T21:42:58.952 INFO:teuthology.orchestra.run.smithi074:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2019-11-28T21:42:59.082 INFO:teuthology.orchestra.run.smithi074.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2019-11-28T21:43:09.161 INFO:teuthology.orchestra.run.smithi074.stdout:ntpd: time slew -0.001400s 2019-11-28T21:43:09.199 INFO:teuthology.orchestra.run.smithi074.stderr:Failed to start ntp.service: Unit not found. 2019-11-28T21:43:09.307 INFO:teuthology.orchestra.run.smithi074.stdout: remote refid st t when poll reach delay offset jitter 2019-11-28T21:43:09.307 INFO:teuthology.orchestra.run.smithi074.stdout:============================================================================== 2019-11-28T21:43:09.307 INFO:teuthology.orchestra.run.smithi074.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-28T21:43:09.307 INFO:teuthology.orchestra.run.smithi074.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-28T21:43:09.308 INFO:teuthology.orchestra.run.smithi074.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-28T21:43:09.308 INFO:teuthology.orchestra.run.smithi074.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-28T21:43:09.309 INFO:teuthology.orchestra.run.smithi141:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2019-11-28T21:43:09.451 INFO:teuthology.orchestra.run.smithi141.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2019-11-28T21:43:19.535 INFO:teuthology.orchestra.run.smithi141.stdout:ntpd: time slew -0.001656s 2019-11-28T21:43:20.029 INFO:teuthology.orchestra.run.smithi141.stderr:Failed to start ntp.service: Unit not found. 2019-11-28T21:43:20.030 INFO:teuthology.orchestra.run.smithi141.stdout: remote refid st t when poll reach delay offset jitter 2019-11-28T21:43:20.030 INFO:teuthology.orchestra.run.smithi141.stdout:============================================================================== 2019-11-28T21:43:20.030 INFO:teuthology.orchestra.run.smithi141.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-28T21:43:20.030 INFO:teuthology.orchestra.run.smithi141.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-28T21:43:20.030 INFO:teuthology.orchestra.run.smithi141.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-28T21:43:20.030 INFO:teuthology.orchestra.run.smithi141.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-28T21:43:20.031 INFO:teuthology.run_tasks:Running task install... 2019-11-28T21:43:20.040 DEBUG:teuthology.task.install:project ceph 2019-11-28T21:43:20.040 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'notcmalloc', 'sha1': '00732956b62306ff37a7f7c81af9db807aae2dc8'}} 2019-11-28T21:43:20.041 DEBUG:teuthology.task.install:config {'flavor': 'notcmalloc', 'sha1': '00732956b62306ff37a7f7c81af9db807aae2dc8'} 2019-11-28T21:43:20.041 INFO:teuthology.task.install:Using flavor: notcmalloc 2019-11-28T21:43:20.045 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-daemon', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python-ceph', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-daemon', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-cloud', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-ssh', 'ceph-fuse', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python-ceph', 'rbd-fuse']} 2019-11-28T21:43:20.045 INFO:teuthology.task.install:extra packages: [] 2019-11-28T21:43:20.045 INFO:teuthology.orchestra.run.smithi074:> sudo lsb_release -is 2019-11-28T21:43:20.203 INFO:teuthology.orchestra.run.smithi074.stdout:CentOS 2019-11-28T21:43:20.205 DEBUG:teuthology.misc:System to be installed: CentOS 2019-11-28T21:43:20.205 INFO:teuthology.orchestra.run.smithi141:> sudo lsb_release -is 2019-11-28T21:43:20.206 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '00732956b62306ff37a7f7c81af9db807aae2dc8', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': [], 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': [], 'flavor': 'notcmalloc', 'extras': None} 2019-11-28T21:43:20.206 INFO:teuthology.orchestra.run.smithi074:> sudo lsb_release -is 2019-11-28T21:43:20.347 INFO:teuthology.orchestra.run.smithi074.stdout:CentOS 2019-11-28T21:43:20.349 DEBUG:teuthology.misc:System to be installed: CentOS 2019-11-28T21:43:20.349 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&sha1=00732956b62306ff37a7f7c81af9db807aae2dc8 2019-11-28T21:43:20.364 INFO:teuthology.orchestra.run.smithi141.stdout:CentOS 2019-11-28T21:43:20.366 DEBUG:teuthology.misc:System to be installed: CentOS 2019-11-28T21:43:20.367 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '00732956b62306ff37a7f7c81af9db807aae2dc8', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': [], 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': [], 'flavor': 'notcmalloc', 'extras': None} 2019-11-28T21:43:20.367 INFO:teuthology.orchestra.run.smithi141:> sudo lsb_release -is 2019-11-28T21:43:20.502 INFO:teuthology.orchestra.run.smithi141.stdout:CentOS 2019-11-28T21:43:20.504 DEBUG:teuthology.misc:System to be installed: CentOS 2019-11-28T21:43:20.505 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&sha1=00732956b62306ff37a7f7c81af9db807aae2dc8 2019-11-28T21:43:20.510 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mkogan-testing/00732956b62306ff37a7f7c81af9db807aae2dc8/centos/7/flavors/notcmalloc/ 2019-11-28T21:43:20.510 INFO:teuthology.task.install.rpm:Package version is 15.0.0-7725.g0073295 2019-11-28T21:43:20.642 INFO:teuthology.orchestra.run.smithi074:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2019-11-28T21:43:20.659 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mkogan-testing/00732956b62306ff37a7f7c81af9db807aae2dc8/centos/7/flavors/notcmalloc/ 2019-11-28T21:43:20.659 INFO:teuthology.task.install.rpm:Package version is 15.0.0-7725.g0073295 2019-11-28T21:43:20.763 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-daemon, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-cloud, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-ssh, ceph-fuse, libcephfs2, libcephfs-devel, librados2, librbd1, python-ceph, rbd-fuse on remote rpm x86_64 2019-11-28T21:43:20.763 INFO:teuthology.orchestra.run.smithi074:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/00732956b62306ff37a7f7c81af9db807aae2dc8/;g' /etc/yum.repos.d/ceph.repo ; fi 2019-11-28T21:43:20.773 INFO:teuthology.orchestra.run.smithi141:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2019-11-28T21:43:20.877 INFO:teuthology.orchestra.run.smithi074:> test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2019-11-28T21:43:20.897 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-daemon, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-cloud, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-ssh, ceph-fuse, libcephfs2, libcephfs-devel, librados2, librbd1, python-ceph, rbd-fuse on remote rpm x86_64 2019-11-28T21:43:20.897 INFO:teuthology.orchestra.run.smithi141:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/00732956b62306ff37a7f7c81af9db807aae2dc8/;g' /etc/yum.repos.d/ceph.repo ; fi 2019-11-28T21:43:20.968 INFO:teuthology.orchestra.run.smithi074:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2019-11-28T21:43:21.005 INFO:teuthology.orchestra.run.smithi141:> test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2019-11-28T21:43:21.046 INFO:teuthology.orchestra.run.smithi074.stdout:check_obsoletes = 1 2019-11-28T21:43:21.048 INFO:teuthology.orchestra.run.smithi074:> sudo yum clean all 2019-11-28T21:43:21.096 INFO:teuthology.orchestra.run.smithi141:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2019-11-28T21:43:21.169 INFO:teuthology.orchestra.run.smithi141.stdout:check_obsoletes = 1 2019-11-28T21:43:21.171 INFO:teuthology.orchestra.run.smithi141:> sudo yum clean all 2019-11-28T21:43:21.221 INFO:teuthology.orchestra.run.smithi074.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:43:21.259 INFO:teuthology.orchestra.run.smithi074.stdout:Cleaning repos: base centos7-fcgi-ceph ceph ceph-noarch ceph-source epel extras 2019-11-28T21:43:21.260 INFO:teuthology.orchestra.run.smithi074.stdout: : lab-extras updates 2019-11-28T21:43:21.304 INFO:teuthology.orchestra.run.smithi074.stdout:Cleaning up list of fastest mirrors 2019-11-28T21:43:21.305 INFO:teuthology.orchestra.run.smithi074.stdout:Other repos take up 1.5 M of disk space (use --verbose for details) 2019-11-28T21:43:21.317 INFO:teuthology.orchestra.run.smithi074:> sudo yum -y install ceph-radosgw 2019-11-28T21:43:21.335 INFO:teuthology.orchestra.run.smithi141.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:43:21.373 INFO:teuthology.orchestra.run.smithi141.stdout:Cleaning repos: base centos7-fcgi-ceph ceph ceph-noarch ceph-source epel extras 2019-11-28T21:43:21.373 INFO:teuthology.orchestra.run.smithi141.stdout: : lab-extras updates 2019-11-28T21:43:21.417 INFO:teuthology.orchestra.run.smithi141.stdout:Cleaning up list of fastest mirrors 2019-11-28T21:43:21.419 INFO:teuthology.orchestra.run.smithi141.stdout:Other repos take up 1.5 M of disk space (use --verbose for details) 2019-11-28T21:43:21.431 INFO:teuthology.orchestra.run.smithi141:> sudo yum -y install ceph-radosgw 2019-11-28T21:43:21.532 INFO:teuthology.orchestra.run.smithi074.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:43:21.572 INFO:teuthology.orchestra.run.smithi074.stdout:Determining fastest mirrors 2019-11-28T21:43:21.634 INFO:teuthology.orchestra.run.smithi141.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:43:21.672 INFO:teuthology.orchestra.run.smithi141.stdout:Determining fastest mirrors 2019-11-28T21:43:22.018 INFO:teuthology.orchestra.run.smithi141.stdout: * base: mirror.cogentco.com 2019-11-28T21:43:22.019 INFO:teuthology.orchestra.run.smithi141.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T21:43:22.022 INFO:teuthology.orchestra.run.smithi141.stdout: * extras: mirror.linux.duke.edu 2019-11-28T21:43:22.023 INFO:teuthology.orchestra.run.smithi141.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-11-28T21:43:22.186 INFO:teuthology.orchestra.run.smithi074.stdout: * base: mirror.cogentco.com 2019-11-28T21:43:22.187 INFO:teuthology.orchestra.run.smithi074.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T21:43:22.188 INFO:teuthology.orchestra.run.smithi074.stdout: * extras: mirror.linux.duke.edu 2019-11-28T21:43:22.188 INFO:teuthology.orchestra.run.smithi074.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-11-28T21:43:30.391 INFO:teuthology.orchestra.run.smithi141.stdout:7 packages excluded due to repository priority protections 2019-11-28T21:43:30.744 INFO:teuthology.orchestra.run.smithi141.stdout:Resolving Dependencies 2019-11-28T21:43:30.746 INFO:teuthology.orchestra.run.smithi141.stdout:--> Running transaction check 2019-11-28T21:43:30.746 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package ceph-radosgw.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:43:30.757 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: librados2 = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:30.868 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: librgw2 = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:30.869 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: ceph-base = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:30.871 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: ceph-selinux = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:30.872 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: librados.so.2(LIBRADOS_14.2.0)(64bit) for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:30.872 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: librdkafka.so.1()(64bit) for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:30.874 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: libceph-common.so.2()(64bit) for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:30.875 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: librabbitmq.so.4()(64bit) for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:30.876 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: liboath.so.0()(64bit) for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:30.877 INFO:teuthology.orchestra.run.smithi141.stdout:--> Running transaction check 2019-11-28T21:43:30.878 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package ceph-base.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:43:30.886 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: libcephfs2 = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:30.887 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: librbd1 = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:30.888 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: ceph-common = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:30.889 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: libleveldb.so.1()(64bit) for package: 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:30.890 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:30.891 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package ceph-selinux.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:43:30.894 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package liboath.x86_64 0:2.6.2-1.el7 will be installed 2019-11-28T21:43:30.895 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package librabbitmq.x86_64 0:0.8.0-2.el7 will be installed 2019-11-28T21:43:30.895 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package librados2.x86_64 1:10.2.5-4.el7 will be updated 2019-11-28T21:43:30.895 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package librados2.x86_64 2:15.0.0-7725.g0073295.el7 will be an update 2019-11-28T21:43:30.898 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package librdkafka.x86_64 0:0.11.5-1.el7 will be installed 2019-11-28T21:43:30.898 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package librgw2.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:43:30.899 INFO:teuthology.orchestra.run.smithi141.stdout:--> Running transaction check 2019-11-28T21:43:30.900 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package ceph-common.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:43:30.904 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: libradosstriper1 = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:30.905 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python-ceph-argparse = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:30.906 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python-cephfs = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:30.907 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python-rbd = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:30.908 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python-rados = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:30.909 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python-rgw = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:30.909 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python-ceph-common = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:30.910 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python-prettytable for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:30.911 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: libradosstriper.so.1()(64bit) for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:30.912 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:30.913 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:30.913 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package leveldb.x86_64 0:1.12.0-11.el7 will be installed 2019-11-28T21:43:30.913 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package libcephfs2.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:43:30.913 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package librbd1.x86_64 1:10.2.5-4.el7 will be updated 2019-11-28T21:43:30.914 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package librbd1.x86_64 2:15.0.0-7725.g0073295.el7 will be an update 2019-11-28T21:43:30.914 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package lttng-ust.x86_64 0:2.4.1-4.el7 will be installed 2019-11-28T21:43:30.915 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-11-28T21:43:30.916 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-11-28T21:43:30.917 INFO:teuthology.orchestra.run.smithi141.stdout:--> Running transaction check 2019-11-28T21:43:30.917 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package libbabeltrace.x86_64 0:1.2.4-3.el7 will be installed 2019-11-28T21:43:30.918 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package libradosstriper1.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:43:30.919 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python-ceph-argparse.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:43:30.919 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python-ceph-common.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:43:30.919 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python-cephfs.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:43:30.920 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python-prettytable.noarch 0:0.7.2-3.el7 will be installed 2019-11-28T21:43:30.920 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python-rados.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:43:30.921 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python-rbd.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:43:30.921 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python-rgw.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:43:30.921 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package userspace-rcu.x86_64 0:0.7.16-1.el7 will be installed 2019-11-28T21:43:31.784 INFO:teuthology.orchestra.run.smithi141.stdout:--> Finished Dependency Resolution 2019-11-28T21:43:31.868 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:43:31.869 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies Resolved 2019-11-28T21:43:31.872 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:43:31.872 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:43:31.872 INFO:teuthology.orchestra.run.smithi141.stdout: Package Arch Version Repository 2019-11-28T21:43:31.872 INFO:teuthology.orchestra.run.smithi141.stdout: Size 2019-11-28T21:43:31.872 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:43:31.873 INFO:teuthology.orchestra.run.smithi141.stdout:Installing: 2019-11-28T21:43:31.873 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-radosgw x86_64 2:15.0.0-7725.g0073295.el7 ceph 6.2 M 2019-11-28T21:43:31.873 INFO:teuthology.orchestra.run.smithi141.stdout:Installing for dependencies: 2019-11-28T21:43:31.873 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-base x86_64 2:15.0.0-7725.g0073295.el7 ceph 5.6 M 2019-11-28T21:43:31.873 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-common x86_64 2:15.0.0-7725.g0073295.el7 ceph 19 M 2019-11-28T21:43:31.873 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-selinux x86_64 2:15.0.0-7725.g0073295.el7 ceph 20 k 2019-11-28T21:43:31.874 INFO:teuthology.orchestra.run.smithi141.stdout: leveldb x86_64 1.12.0-11.el7 epel 161 k 2019-11-28T21:43:31.874 INFO:teuthology.orchestra.run.smithi141.stdout: libbabeltrace x86_64 1.2.4-3.el7 epel 147 k 2019-11-28T21:43:31.874 INFO:teuthology.orchestra.run.smithi141.stdout: libcephfs2 x86_64 2:15.0.0-7725.g0073295.el7 ceph 489 k 2019-11-28T21:43:31.874 INFO:teuthology.orchestra.run.smithi141.stdout: liboath x86_64 2.6.2-1.el7 epel 51 k 2019-11-28T21:43:31.874 INFO:teuthology.orchestra.run.smithi141.stdout: librabbitmq x86_64 0.8.0-2.el7 base 37 k 2019-11-28T21:43:31.874 INFO:teuthology.orchestra.run.smithi141.stdout: libradosstriper1 x86_64 2:15.0.0-7725.g0073295.el7 ceph 374 k 2019-11-28T21:43:31.874 INFO:teuthology.orchestra.run.smithi141.stdout: librdkafka x86_64 0.11.5-1.el7 epel 368 k 2019-11-28T21:43:31.875 INFO:teuthology.orchestra.run.smithi141.stdout: librgw2 x86_64 2:15.0.0-7725.g0073295.el7 ceph 5.4 M 2019-11-28T21:43:31.875 INFO:teuthology.orchestra.run.smithi141.stdout: lttng-ust x86_64 2.4.1-4.el7 epel 176 k 2019-11-28T21:43:31.875 INFO:teuthology.orchestra.run.smithi141.stdout: python-ceph-argparse x86_64 2:15.0.0-7725.g0073295.el7 ceph 35 k 2019-11-28T21:43:31.875 INFO:teuthology.orchestra.run.smithi141.stdout: python-ceph-common x86_64 2:15.0.0-7725.g0073295.el7 ceph 42 k 2019-11-28T21:43:31.875 INFO:teuthology.orchestra.run.smithi141.stdout: python-cephfs x86_64 2:15.0.0-7725.g0073295.el7 ceph 102 k 2019-11-28T21:43:31.875 INFO:teuthology.orchestra.run.smithi141.stdout: python-prettytable noarch 0.7.2-3.el7 base 37 k 2019-11-28T21:43:31.875 INFO:teuthology.orchestra.run.smithi141.stdout: python-rados x86_64 2:15.0.0-7725.g0073295.el7 ceph 209 k 2019-11-28T21:43:31.875 INFO:teuthology.orchestra.run.smithi141.stdout: python-rbd x86_64 2:15.0.0-7725.g0073295.el7 ceph 199 k 2019-11-28T21:43:31.876 INFO:teuthology.orchestra.run.smithi141.stdout: python-rgw x86_64 2:15.0.0-7725.g0073295.el7 ceph 77 k 2019-11-28T21:43:31.876 INFO:teuthology.orchestra.run.smithi141.stdout: userspace-rcu x86_64 0.7.16-1.el7 epel 73 k 2019-11-28T21:43:31.876 INFO:teuthology.orchestra.run.smithi141.stdout:Updating for dependencies: 2019-11-28T21:43:31.877 INFO:teuthology.orchestra.run.smithi141.stdout: librados2 x86_64 2:15.0.0-7725.g0073295.el7 ceph 3.5 M 2019-11-28T21:43:31.877 INFO:teuthology.orchestra.run.smithi141.stdout: librbd1 x86_64 2:15.0.0-7725.g0073295.el7 ceph 1.8 M 2019-11-28T21:43:31.877 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:43:31.877 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction Summary 2019-11-28T21:43:31.877 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:43:31.877 INFO:teuthology.orchestra.run.smithi141.stdout:Install 1 Package (+20 Dependent packages) 2019-11-28T21:43:31.877 INFO:teuthology.orchestra.run.smithi141.stdout:Upgrade ( 2 Dependent packages) 2019-11-28T21:43:31.878 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:43:31.878 INFO:teuthology.orchestra.run.smithi141.stdout:Total download size: 45 M 2019-11-28T21:43:31.878 INFO:teuthology.orchestra.run.smithi141.stdout:Downloading packages: 2019-11-28T21:43:31.878 INFO:teuthology.orchestra.run.smithi141.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-11-28T21:43:32.311 INFO:teuthology.orchestra.run.smithi074.stdout:7 packages excluded due to repository priority protections 2019-11-28T21:43:32.666 INFO:teuthology.orchestra.run.smithi074.stdout:Resolving Dependencies 2019-11-28T21:43:32.666 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:43:32.666 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package ceph-radosgw.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:43:32.678 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: librados2 = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:32.788 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: librgw2 = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:32.789 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: ceph-base = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:32.791 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: ceph-selinux = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:32.792 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: librados.so.2(LIBRADOS_14.2.0)(64bit) for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:32.793 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: librdkafka.so.1()(64bit) for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:32.795 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: libceph-common.so.2()(64bit) for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:32.795 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: librabbitmq.so.4()(64bit) for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:32.796 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: liboath.so.0()(64bit) for package: 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:32.798 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:43:32.798 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package ceph-base.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:43:32.806 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: libcephfs2 = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:32.807 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: librbd1 = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:32.808 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: ceph-common = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:32.810 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: libleveldb.so.1()(64bit) for package: 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:32.810 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:32.811 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package ceph-selinux.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:43:32.814 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package liboath.x86_64 0:2.6.2-1.el7 will be installed 2019-11-28T21:43:32.814 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package librabbitmq.x86_64 0:0.8.0-2.el7 will be installed 2019-11-28T21:43:32.815 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package librados2.x86_64 1:10.2.5-4.el7 will be updated 2019-11-28T21:43:32.815 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package librados2.x86_64 2:15.0.0-7725.g0073295.el7 will be an update 2019-11-28T21:43:32.817 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package librdkafka.x86_64 0:0.11.5-1.el7 will be installed 2019-11-28T21:43:32.818 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package librgw2.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:43:32.819 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:43:32.819 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package ceph-common.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:43:32.823 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: libradosstriper1 = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:32.824 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python-ceph-argparse = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:32.825 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python-cephfs = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:32.826 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python-rbd = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:32.827 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python-rados = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:32.828 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python-rgw = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:32.829 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python-ceph-common = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:32.830 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python-prettytable for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:32.831 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: libradosstriper.so.1()(64bit) for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:32.831 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:32.832 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:43:32.832 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package leveldb.x86_64 0:1.12.0-11.el7 will be installed 2019-11-28T21:43:32.832 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package libcephfs2.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:43:32.833 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package librbd1.x86_64 1:10.2.5-4.el7 will be updated 2019-11-28T21:43:32.833 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package librbd1.x86_64 2:15.0.0-7725.g0073295.el7 will be an update 2019-11-28T21:43:32.834 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package lttng-ust.x86_64 0:2.4.1-4.el7 will be installed 2019-11-28T21:43:32.834 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-11-28T21:43:32.836 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-11-28T21:43:32.836 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:43:32.836 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package libbabeltrace.x86_64 0:1.2.4-3.el7 will be installed 2019-11-28T21:43:32.837 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package libradosstriper1.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:43:32.838 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python-ceph-argparse.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:43:32.838 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python-ceph-common.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:43:32.838 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python-cephfs.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:43:32.839 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python-prettytable.noarch 0:0.7.2-3.el7 will be installed 2019-11-28T21:43:32.840 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python-rados.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:43:32.840 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python-rbd.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:43:32.840 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python-rgw.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:43:32.841 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package userspace-rcu.x86_64 0:0.7.16-1.el7 will be installed 2019-11-28T21:43:33.691 INFO:teuthology.orchestra.run.smithi074.stdout:--> Finished Dependency Resolution 2019-11-28T21:43:33.774 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:43:33.775 INFO:teuthology.orchestra.run.smithi074.stdout:Dependencies Resolved 2019-11-28T21:43:33.778 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:43:33.778 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:43:33.778 INFO:teuthology.orchestra.run.smithi074.stdout: Package Arch Version Repository 2019-11-28T21:43:33.778 INFO:teuthology.orchestra.run.smithi074.stdout: Size 2019-11-28T21:43:33.778 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:43:33.779 INFO:teuthology.orchestra.run.smithi074.stdout:Installing: 2019-11-28T21:43:33.779 INFO:teuthology.orchestra.run.smithi074.stdout: ceph-radosgw x86_64 2:15.0.0-7725.g0073295.el7 ceph 6.2 M 2019-11-28T21:43:33.779 INFO:teuthology.orchestra.run.smithi074.stdout:Installing for dependencies: 2019-11-28T21:43:33.779 INFO:teuthology.orchestra.run.smithi074.stdout: ceph-base x86_64 2:15.0.0-7725.g0073295.el7 ceph 5.6 M 2019-11-28T21:43:33.779 INFO:teuthology.orchestra.run.smithi074.stdout: ceph-common x86_64 2:15.0.0-7725.g0073295.el7 ceph 19 M 2019-11-28T21:43:33.779 INFO:teuthology.orchestra.run.smithi074.stdout: ceph-selinux x86_64 2:15.0.0-7725.g0073295.el7 ceph 20 k 2019-11-28T21:43:33.779 INFO:teuthology.orchestra.run.smithi074.stdout: leveldb x86_64 1.12.0-11.el7 epel 161 k 2019-11-28T21:43:33.780 INFO:teuthology.orchestra.run.smithi074.stdout: libbabeltrace x86_64 1.2.4-3.el7 epel 147 k 2019-11-28T21:43:33.780 INFO:teuthology.orchestra.run.smithi074.stdout: libcephfs2 x86_64 2:15.0.0-7725.g0073295.el7 ceph 489 k 2019-11-28T21:43:33.780 INFO:teuthology.orchestra.run.smithi074.stdout: liboath x86_64 2.6.2-1.el7 epel 51 k 2019-11-28T21:43:33.780 INFO:teuthology.orchestra.run.smithi074.stdout: librabbitmq x86_64 0.8.0-2.el7 base 37 k 2019-11-28T21:43:33.780 INFO:teuthology.orchestra.run.smithi074.stdout: libradosstriper1 x86_64 2:15.0.0-7725.g0073295.el7 ceph 374 k 2019-11-28T21:43:33.780 INFO:teuthology.orchestra.run.smithi074.stdout: librdkafka x86_64 0.11.5-1.el7 epel 368 k 2019-11-28T21:43:33.780 INFO:teuthology.orchestra.run.smithi074.stdout: librgw2 x86_64 2:15.0.0-7725.g0073295.el7 ceph 5.4 M 2019-11-28T21:43:33.781 INFO:teuthology.orchestra.run.smithi074.stdout: lttng-ust x86_64 2.4.1-4.el7 epel 176 k 2019-11-28T21:43:33.781 INFO:teuthology.orchestra.run.smithi074.stdout: python-ceph-argparse x86_64 2:15.0.0-7725.g0073295.el7 ceph 35 k 2019-11-28T21:43:33.781 INFO:teuthology.orchestra.run.smithi074.stdout: python-ceph-common x86_64 2:15.0.0-7725.g0073295.el7 ceph 42 k 2019-11-28T21:43:33.781 INFO:teuthology.orchestra.run.smithi074.stdout: python-cephfs x86_64 2:15.0.0-7725.g0073295.el7 ceph 102 k 2019-11-28T21:43:33.781 INFO:teuthology.orchestra.run.smithi074.stdout: python-prettytable noarch 0.7.2-3.el7 base 37 k 2019-11-28T21:43:33.781 INFO:teuthology.orchestra.run.smithi074.stdout: python-rados x86_64 2:15.0.0-7725.g0073295.el7 ceph 209 k 2019-11-28T21:43:33.782 INFO:teuthology.orchestra.run.smithi074.stdout: python-rbd x86_64 2:15.0.0-7725.g0073295.el7 ceph 199 k 2019-11-28T21:43:33.782 INFO:teuthology.orchestra.run.smithi074.stdout: python-rgw x86_64 2:15.0.0-7725.g0073295.el7 ceph 77 k 2019-11-28T21:43:33.782 INFO:teuthology.orchestra.run.smithi074.stdout: userspace-rcu x86_64 0.7.16-1.el7 epel 73 k 2019-11-28T21:43:33.782 INFO:teuthology.orchestra.run.smithi074.stdout:Updating for dependencies: 2019-11-28T21:43:33.782 INFO:teuthology.orchestra.run.smithi074.stdout: librados2 x86_64 2:15.0.0-7725.g0073295.el7 ceph 3.5 M 2019-11-28T21:43:33.782 INFO:teuthology.orchestra.run.smithi074.stdout: librbd1 x86_64 2:15.0.0-7725.g0073295.el7 ceph 1.8 M 2019-11-28T21:43:33.782 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:43:33.783 INFO:teuthology.orchestra.run.smithi074.stdout:Transaction Summary 2019-11-28T21:43:33.783 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:43:33.783 INFO:teuthology.orchestra.run.smithi074.stdout:Install 1 Package (+20 Dependent packages) 2019-11-28T21:43:33.783 INFO:teuthology.orchestra.run.smithi074.stdout:Upgrade ( 2 Dependent packages) 2019-11-28T21:43:33.783 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:43:33.783 INFO:teuthology.orchestra.run.smithi074.stdout:Total download size: 45 M 2019-11-28T21:43:33.783 INFO:teuthology.orchestra.run.smithi074.stdout:Downloading packages: 2019-11-28T21:43:33.784 INFO:teuthology.orchestra.run.smithi074.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-11-28T21:43:34.153 INFO:teuthology.orchestra.run.smithi141.stdout:-------------------------------------------------------------------------------- 2019-11-28T21:43:34.153 INFO:teuthology.orchestra.run.smithi141.stdout:Total 20 MB/s | 45 MB 00:02 2019-11-28T21:43:34.170 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction check 2019-11-28T21:43:34.243 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction test 2019-11-28T21:43:34.509 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction test succeeded 2019-11-28T21:43:34.510 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction 2019-11-28T21:43:35.217 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : liboath-2.6.2-1.el7.x86_64 1/25 2019-11-28T21:43:35.577 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : librabbitmq-0.8.0-2.el7.x86_64 2/25 2019-11-28T21:43:35.853 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : librdkafka-0.11.5-1.el7.x86_64 3/25 2019-11-28T21:43:36.085 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : 2:python-ceph-argparse-15.0.0-7725.g0073295.el7.x86_64 4/25 2019-11-28T21:43:36.403 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : leveldb-1.12.0-11.el7.x86_64 5/25 2019-11-28T21:43:36.441 INFO:teuthology.orchestra.run.smithi074.stdout:-------------------------------------------------------------------------------- 2019-11-28T21:43:36.441 INFO:teuthology.orchestra.run.smithi074.stdout:Total 17 MB/s | 45 MB 00:02 2019-11-28T21:43:36.457 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction check 2019-11-28T21:43:36.528 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction test 2019-11-28T21:43:36.676 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python-prettytable-0.7.2-3.el7.noarch 6/25 2019-11-28T21:43:36.769 INFO:teuthology.orchestra.run.smithi074.stdout:Transaction test succeeded 2019-11-28T21:43:36.774 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction 2019-11-28T21:43:36.996 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : libbabeltrace-1.2.4-3.el7.x86_64 7/25 2019-11-28T21:43:37.292 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : 2:python-ceph-common-15.0.0-7725.g0073295.el7.x86_64 8/25 2019-11-28T21:43:37.448 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : liboath-2.6.2-1.el7.x86_64 1/25 2019-11-28T21:43:37.664 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : userspace-rcu-0.7.16-1.el7.x86_64 9/25 2019-11-28T21:43:37.844 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : librabbitmq-0.8.0-2.el7.x86_64 2/25 2019-11-28T21:43:38.152 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : librdkafka-0.11.5-1.el7.x86_64 3/25 2019-11-28T21:43:38.390 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : lttng-ust-2.4.1-4.el7.x86_64 10/25 2019-11-28T21:43:38.425 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : 2:python-ceph-argparse-15.0.0-7725.g0073295.el7.x86_64 4/25 2019-11-28T21:43:38.728 INFO:teuthology.orchestra.run.smithi141.stdout: Updating : 2:librados2-15.0.0-7725.g0073295.el7.x86_64 11/25 2019-11-28T21:43:38.744 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : leveldb-1.12.0-11.el7.x86_64 5/25 2019-11-28T21:43:39.042 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : python-prettytable-0.7.2-3.el7.noarch 6/25 2019-11-28T21:43:39.381 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : libbabeltrace-1.2.4-3.el7.x86_64 7/25 2019-11-28T21:43:39.647 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : 2:python-rados-15.0.0-7725.g0073295.el7.x86_64 12/25 2019-11-28T21:43:39.664 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : 2:python-ceph-common-15.0.0-7725.g0073295.el7.x86_64 8/25 2019-11-28T21:43:40.015 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : 2:librgw2-15.0.0-7725.g0073295.el7.x86_64 13/25 2019-11-28T21:43:40.027 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : userspace-rcu-0.7.16-1.el7.x86_64 9/25 2019-11-28T21:43:40.559 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : 2:libcephfs2-15.0.0-7725.g0073295.el7.x86_64 14/25 2019-11-28T21:43:40.817 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : lttng-ust-2.4.1-4.el7.x86_64 10/25 2019-11-28T21:43:40.914 INFO:teuthology.orchestra.run.smithi141.stdout: Updating : 2:librbd1-15.0.0-7725.g0073295.el7.x86_64 15/25 2019-11-28T21:43:41.177 INFO:teuthology.orchestra.run.smithi074.stdout: Updating : 2:librados2-15.0.0-7725.g0073295.el7.x86_64 11/25 2019-11-28T21:43:41.185 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : 2:python-rbd-15.0.0-7725.g0073295.el7.x86_64 16/25 2019-11-28T21:43:41.428 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : 2:python-cephfs-15.0.0-7725.g0073295.el7.x86_64 17/25 2019-11-28T21:43:41.733 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : 2:python-rgw-15.0.0-7725.g0073295.el7.x86_64 18/25 2019-11-28T21:43:42.067 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : 2:python-rados-15.0.0-7725.g0073295.el7.x86_64 12/25 2019-11-28T21:43:42.494 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : 2:librgw2-15.0.0-7725.g0073295.el7.x86_64 13/25 2019-11-28T21:43:43.055 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : 2:libcephfs2-15.0.0-7725.g0073295.el7.x86_64 14/25 2019-11-28T21:43:43.417 INFO:teuthology.orchestra.run.smithi074.stdout: Updating : 2:librbd1-15.0.0-7725.g0073295.el7.x86_64 15/25 2019-11-28T21:43:43.694 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : 2:python-rbd-15.0.0-7725.g0073295.el7.x86_64 16/25 2019-11-28T21:43:43.910 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : 2:python-cephfs-15.0.0-7725.g0073295.el7.x86_64 17/25 2019-11-28T21:43:44.125 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : 2:libradosstriper1-15.0.0-7725.g0073295.el7.x86_64 19/25 2019-11-28T21:43:44.250 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : 2:python-rgw-15.0.0-7725.g0073295.el7.x86_64 18/25 2019-11-28T21:43:45.266 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 20/25 2019-11-28T21:43:45.761 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 21/25 2019-11-28T21:43:46.688 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : 2:libradosstriper1-15.0.0-7725.g0073295.el7.x86_64 19/25 2019-11-28T21:43:47.819 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 20/25 2019-11-28T21:43:48.364 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 21/25 2019-11-28T21:43:55.079 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : 2:ceph-selinux-15.0.0-7725.g0073295.el7.x86_64 22/25 2019-11-28T21:43:55.477 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 23/25 2019-11-28T21:43:55.738 INFO:teuthology.orchestra.run.smithi141.stdout: Cleanup : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-11-28T21:43:56.048 INFO:teuthology.orchestra.run.smithi141.stdout: Cleanup : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-11-28T21:43:56.174 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : liboath-2.6.2-1.el7.x86_64 1/25 2019-11-28T21:43:56.291 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : 2:python-rgw-15.0.0-7725.g0073295.el7.x86_64 2/25 2019-11-28T21:43:56.391 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : leveldb-1.12.0-11.el7.x86_64 3/25 2019-11-28T21:43:56.475 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : 2:librgw2-15.0.0-7725.g0073295.el7.x86_64 4/25 2019-11-28T21:43:56.584 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 5/25 2019-11-28T21:43:56.659 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : userspace-rcu-0.7.16-1.el7.x86_64 6/25 2019-11-28T21:43:56.780 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : 2:python-ceph-argparse-15.0.0-7725.g0073295.el7.x86_64 7/25 2019-11-28T21:43:56.885 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : 2:python-ceph-common-15.0.0-7725.g0073295.el7.x86_64 8/25 2019-11-28T21:43:56.986 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : libbabeltrace-1.2.4-3.el7.x86_64 9/25 2019-11-28T21:43:57.103 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : 2:libradosstriper1-15.0.0-7725.g0073295.el7.x86_64 10/25 2019-11-28T21:43:57.203 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : librdkafka-0.11.5-1.el7.x86_64 11/25 2019-11-28T21:43:57.304 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : 2:python-cephfs-15.0.0-7725.g0073295.el7.x86_64 12/25 2019-11-28T21:43:57.413 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : lttng-ust-2.4.1-4.el7.x86_64 13/25 2019-11-28T21:43:57.530 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : 2:librados2-15.0.0-7725.g0073295.el7.x86_64 14/25 2019-11-28T21:43:57.656 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : 2:ceph-selinux-15.0.0-7725.g0073295.el7.x86_64 15/25 2019-11-28T21:43:57.657 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : 2:ceph-selinux-15.0.0-7725.g0073295.el7.x86_64 22/25 2019-11-28T21:43:57.790 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python-prettytable-0.7.2-3.el7.noarch 16/25 2019-11-28T21:43:57.900 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : 2:libcephfs2-15.0.0-7725.g0073295.el7.x86_64 17/25 2019-11-28T21:43:57.982 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : 2:python-rbd-15.0.0-7725.g0073295.el7.x86_64 18/25 2019-11-28T21:43:58.020 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 23/25 2019-11-28T21:43:58.075 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : 2:librbd1-15.0.0-7725.g0073295.el7.x86_64 19/25 2019-11-28T21:43:58.167 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 20/25 2019-11-28T21:43:58.234 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : 2:python-rados-15.0.0-7725.g0073295.el7.x86_64 21/25 2019-11-28T21:43:58.309 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 22/25 2019-11-28T21:43:58.401 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : librabbitmq-0.8.0-2.el7.x86_64 23/25 2019-11-28T21:43:58.403 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-11-28T21:43:58.474 INFO:teuthology.orchestra.run.smithi074.stdout: Cleanup : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-11-28T21:43:58.770 INFO:teuthology.orchestra.run.smithi074.stdout: Cleanup : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-11-28T21:43:58.883 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : liboath-2.6.2-1.el7.x86_64 1/25 2019-11-28T21:43:58.992 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : 2:python-rgw-15.0.0-7725.g0073295.el7.x86_64 2/25 2019-11-28T21:43:59.093 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : leveldb-1.12.0-11.el7.x86_64 3/25 2019-11-28T21:43:59.194 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : 2:librgw2-15.0.0-7725.g0073295.el7.x86_64 4/25 2019-11-28T21:43:59.327 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : 2:ceph-radosgw-15.0.0-7725.g0073295.el7.x86_64 5/25 2019-11-28T21:43:59.436 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : userspace-rcu-0.7.16-1.el7.x86_64 6/25 2019-11-28T21:43:59.545 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : 2:python-ceph-argparse-15.0.0-7725.g0073295.el7.x86_64 7/25 2019-11-28T21:43:59.609 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-11-28T21:43:59.610 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:43:59.610 INFO:teuthology.orchestra.run.smithi141.stdout:Installed: 2019-11-28T21:43:59.610 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-radosgw.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:43:59.610 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:43:59.610 INFO:teuthology.orchestra.run.smithi141.stdout:Dependency Installed: 2019-11-28T21:43:59.610 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-base.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:43:59.611 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-common.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:43:59.611 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-selinux.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:43:59.611 INFO:teuthology.orchestra.run.smithi141.stdout: leveldb.x86_64 0:1.12.0-11.el7 2019-11-28T21:43:59.611 INFO:teuthology.orchestra.run.smithi141.stdout: libbabeltrace.x86_64 0:1.2.4-3.el7 2019-11-28T21:43:59.611 INFO:teuthology.orchestra.run.smithi141.stdout: libcephfs2.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:43:59.611 INFO:teuthology.orchestra.run.smithi141.stdout: liboath.x86_64 0:2.6.2-1.el7 2019-11-28T21:43:59.611 INFO:teuthology.orchestra.run.smithi141.stdout: librabbitmq.x86_64 0:0.8.0-2.el7 2019-11-28T21:43:59.611 INFO:teuthology.orchestra.run.smithi141.stdout: libradosstriper1.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:43:59.612 INFO:teuthology.orchestra.run.smithi141.stdout: librdkafka.x86_64 0:0.11.5-1.el7 2019-11-28T21:43:59.612 INFO:teuthology.orchestra.run.smithi141.stdout: librgw2.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:43:59.612 INFO:teuthology.orchestra.run.smithi141.stdout: lttng-ust.x86_64 0:2.4.1-4.el7 2019-11-28T21:43:59.612 INFO:teuthology.orchestra.run.smithi141.stdout: python-ceph-argparse.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:43:59.612 INFO:teuthology.orchestra.run.smithi141.stdout: python-ceph-common.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:43:59.612 INFO:teuthology.orchestra.run.smithi141.stdout: python-cephfs.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:43:59.612 INFO:teuthology.orchestra.run.smithi141.stdout: python-prettytable.noarch 0:0.7.2-3.el7 2019-11-28T21:43:59.613 INFO:teuthology.orchestra.run.smithi141.stdout: python-rados.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:43:59.613 INFO:teuthology.orchestra.run.smithi141.stdout: python-rbd.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:43:59.613 INFO:teuthology.orchestra.run.smithi141.stdout: python-rgw.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:43:59.613 INFO:teuthology.orchestra.run.smithi141.stdout: userspace-rcu.x86_64 0:0.7.16-1.el7 2019-11-28T21:43:59.613 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:43:59.613 INFO:teuthology.orchestra.run.smithi141.stdout:Dependency Updated: 2019-11-28T21:43:59.613 INFO:teuthology.orchestra.run.smithi141.stdout: librados2.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:43:59.614 INFO:teuthology.orchestra.run.smithi141.stdout: librbd1.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:43:59.614 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:43:59.614 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2019-11-28T21:43:59.670 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : 2:python-ceph-common-15.0.0-7725.g0073295.el7.x86_64 8/25 2019-11-28T21:43:59.745 INFO:teuthology.orchestra.run.smithi141:> sudo yum -y install ceph-test 2019-11-28T21:43:59.796 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : libbabeltrace-1.2.4-3.el7.x86_64 9/25 2019-11-28T21:43:59.921 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : 2:libradosstriper1-15.0.0-7725.g0073295.el7.x86_64 10/25 2019-11-28T21:44:00.011 INFO:teuthology.orchestra.run.smithi141.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:44:00.049 INFO:teuthology.orchestra.run.smithi141.stdout:Loading mirror speeds from cached hostfile 2019-11-28T21:44:00.050 INFO:teuthology.orchestra.run.smithi141.stdout: * base: mirror.cogentco.com 2019-11-28T21:44:00.051 INFO:teuthology.orchestra.run.smithi141.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T21:44:00.051 INFO:teuthology.orchestra.run.smithi141.stdout: * extras: mirror.linux.duke.edu 2019-11-28T21:44:00.051 INFO:teuthology.orchestra.run.smithi141.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-11-28T21:44:00.059 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : librdkafka-0.11.5-1.el7.x86_64 11/25 2019-11-28T21:44:00.173 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : 2:python-cephfs-15.0.0-7725.g0073295.el7.x86_64 12/25 2019-11-28T21:44:00.282 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : lttng-ust-2.4.1-4.el7.x86_64 13/25 2019-11-28T21:44:00.407 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : 2:librados2-15.0.0-7725.g0073295.el7.x86_64 14/25 2019-11-28T21:44:00.516 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : 2:ceph-selinux-15.0.0-7725.g0073295.el7.x86_64 15/25 2019-11-28T21:44:00.616 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : python-prettytable-0.7.2-3.el7.noarch 16/25 2019-11-28T21:44:00.699 INFO:teuthology.orchestra.run.smithi141.stdout:7 packages excluded due to repository priority protections 2019-11-28T21:44:00.717 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : 2:libcephfs2-15.0.0-7725.g0073295.el7.x86_64 17/25 2019-11-28T21:44:00.801 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : 2:python-rbd-15.0.0-7725.g0073295.el7.x86_64 18/25 2019-11-28T21:44:00.893 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : 2:librbd1-15.0.0-7725.g0073295.el7.x86_64 19/25 2019-11-28T21:44:01.026 INFO:teuthology.orchestra.run.smithi141.stdout:Resolving Dependencies 2019-11-28T21:44:01.027 INFO:teuthology.orchestra.run.smithi141.stdout:--> Running transaction check 2019-11-28T21:44:01.027 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package ceph-test.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:44:01.044 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: xmlstarlet for package: 2:ceph-test-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:44:01.052 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : 2:ceph-common-15.0.0-7725.g0073295.el7.x86_64 20/25 2019-11-28T21:44:01.074 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: jq for package: 2:ceph-test-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:44:01.075 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: socat for package: 2:ceph-test-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:44:01.076 INFO:teuthology.orchestra.run.smithi141.stdout:--> Running transaction check 2019-11-28T21:44:01.076 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package jq.x86_64 0:1.5-1.el7 will be installed 2019-11-28T21:44:01.077 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: libonig.so.2()(64bit) for package: jq-1.5-1.el7.x86_64 2019-11-28T21:44:01.078 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package socat.x86_64 0:1.7.3.2-2.el7 will be installed 2019-11-28T21:44:01.079 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be installed 2019-11-28T21:44:01.082 INFO:teuthology.orchestra.run.smithi141.stdout:--> Running transaction check 2019-11-28T21:44:01.082 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package oniguruma.x86_64 0:5.9.5-3.el7 will be installed 2019-11-28T21:44:01.153 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : 2:python-rados-15.0.0-7725.g0073295.el7.x86_64 21/25 2019-11-28T21:44:01.253 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : 2:ceph-base-15.0.0-7725.g0073295.el7.x86_64 22/25 2019-11-28T21:44:01.379 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : librabbitmq-0.8.0-2.el7.x86_64 23/25 2019-11-28T21:44:01.380 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-11-28T21:44:01.441 INFO:teuthology.orchestra.run.smithi141.stdout:--> Finished Dependency Resolution 2019-11-28T21:44:01.665 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:01.665 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies Resolved 2019-11-28T21:44:01.666 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:01.666 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:44:01.666 INFO:teuthology.orchestra.run.smithi141.stdout: Package Arch Version Repository 2019-11-28T21:44:01.666 INFO:teuthology.orchestra.run.smithi141.stdout: Size 2019-11-28T21:44:01.666 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:44:01.666 INFO:teuthology.orchestra.run.smithi141.stdout:Installing: 2019-11-28T21:44:01.667 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-test x86_64 2:15.0.0-7725.g0073295.el7 ceph 38 M 2019-11-28T21:44:01.667 INFO:teuthology.orchestra.run.smithi141.stdout:Installing for dependencies: 2019-11-28T21:44:01.667 INFO:teuthology.orchestra.run.smithi141.stdout: jq x86_64 1.5-1.el7 epel 153 k 2019-11-28T21:44:01.667 INFO:teuthology.orchestra.run.smithi141.stdout: oniguruma x86_64 5.9.5-3.el7 epel 129 k 2019-11-28T21:44:01.667 INFO:teuthology.orchestra.run.smithi141.stdout: socat x86_64 1.7.3.2-2.el7 base 290 k 2019-11-28T21:44:01.667 INFO:teuthology.orchestra.run.smithi141.stdout: xmlstarlet x86_64 1.6.1-1.el7 epel 62 k 2019-11-28T21:44:01.667 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:01.667 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction Summary 2019-11-28T21:44:01.668 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:44:01.668 INFO:teuthology.orchestra.run.smithi141.stdout:Install 1 Package (+4 Dependent packages) 2019-11-28T21:44:01.668 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:01.668 INFO:teuthology.orchestra.run.smithi141.stdout:Total download size: 38 M 2019-11-28T21:44:01.669 INFO:teuthology.orchestra.run.smithi141.stdout:Installed size: 134 M 2019-11-28T21:44:01.669 INFO:teuthology.orchestra.run.smithi141.stdout:Downloading packages: 2019-11-28T21:44:01.761 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-11-28T21:44:01.761 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:01.761 INFO:teuthology.orchestra.run.smithi074.stdout:Installed: 2019-11-28T21:44:01.761 INFO:teuthology.orchestra.run.smithi074.stdout: ceph-radosgw.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:44:01.761 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:01.762 INFO:teuthology.orchestra.run.smithi074.stdout:Dependency Installed: 2019-11-28T21:44:01.762 INFO:teuthology.orchestra.run.smithi074.stdout: ceph-base.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:44:01.762 INFO:teuthology.orchestra.run.smithi074.stdout: ceph-common.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:44:01.762 INFO:teuthology.orchestra.run.smithi074.stdout: ceph-selinux.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:44:01.762 INFO:teuthology.orchestra.run.smithi074.stdout: leveldb.x86_64 0:1.12.0-11.el7 2019-11-28T21:44:01.762 INFO:teuthology.orchestra.run.smithi074.stdout: libbabeltrace.x86_64 0:1.2.4-3.el7 2019-11-28T21:44:01.763 INFO:teuthology.orchestra.run.smithi074.stdout: libcephfs2.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:44:01.763 INFO:teuthology.orchestra.run.smithi074.stdout: liboath.x86_64 0:2.6.2-1.el7 2019-11-28T21:44:01.763 INFO:teuthology.orchestra.run.smithi074.stdout: librabbitmq.x86_64 0:0.8.0-2.el7 2019-11-28T21:44:01.763 INFO:teuthology.orchestra.run.smithi074.stdout: libradosstriper1.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:44:01.763 INFO:teuthology.orchestra.run.smithi074.stdout: librdkafka.x86_64 0:0.11.5-1.el7 2019-11-28T21:44:01.763 INFO:teuthology.orchestra.run.smithi074.stdout: librgw2.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:44:01.763 INFO:teuthology.orchestra.run.smithi074.stdout: lttng-ust.x86_64 0:2.4.1-4.el7 2019-11-28T21:44:01.763 INFO:teuthology.orchestra.run.smithi074.stdout: python-ceph-argparse.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:44:01.764 INFO:teuthology.orchestra.run.smithi074.stdout: python-ceph-common.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:44:01.764 INFO:teuthology.orchestra.run.smithi074.stdout: python-cephfs.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:44:01.764 INFO:teuthology.orchestra.run.smithi074.stdout: python-prettytable.noarch 0:0.7.2-3.el7 2019-11-28T21:44:01.764 INFO:teuthology.orchestra.run.smithi074.stdout: python-rados.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:44:01.764 INFO:teuthology.orchestra.run.smithi074.stdout: python-rbd.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:44:01.764 INFO:teuthology.orchestra.run.smithi074.stdout: python-rgw.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:44:01.764 INFO:teuthology.orchestra.run.smithi074.stdout: userspace-rcu.x86_64 0:0.7.16-1.el7 2019-11-28T21:44:01.765 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:01.765 INFO:teuthology.orchestra.run.smithi074.stdout:Dependency Updated: 2019-11-28T21:44:01.765 INFO:teuthology.orchestra.run.smithi074.stdout: librados2.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:44:01.765 INFO:teuthology.orchestra.run.smithi074.stdout: librbd1.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:44:01.765 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:01.765 INFO:teuthology.orchestra.run.smithi074.stdout:Complete! 2019-11-28T21:44:01.876 INFO:teuthology.orchestra.run.smithi074:> sudo yum -y install ceph-test 2019-11-28T21:44:02.158 INFO:teuthology.orchestra.run.smithi074.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:44:02.198 INFO:teuthology.orchestra.run.smithi074.stdout:Loading mirror speeds from cached hostfile 2019-11-28T21:44:02.199 INFO:teuthology.orchestra.run.smithi074.stdout: * base: mirror.cogentco.com 2019-11-28T21:44:02.200 INFO:teuthology.orchestra.run.smithi074.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T21:44:02.200 INFO:teuthology.orchestra.run.smithi074.stdout: * extras: mirror.linux.duke.edu 2019-11-28T21:44:02.200 INFO:teuthology.orchestra.run.smithi074.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-11-28T21:44:02.842 INFO:teuthology.orchestra.run.smithi074.stdout:7 packages excluded due to repository priority protections 2019-11-28T21:44:03.166 INFO:teuthology.orchestra.run.smithi074.stdout:Resolving Dependencies 2019-11-28T21:44:03.167 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:44:03.167 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package ceph-test.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:44:03.184 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: xmlstarlet for package: 2:ceph-test-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:44:03.242 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: jq for package: 2:ceph-test-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:44:03.243 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: socat for package: 2:ceph-test-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:44:03.245 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:44:03.245 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package jq.x86_64 0:1.5-1.el7 will be installed 2019-11-28T21:44:03.246 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: libonig.so.2()(64bit) for package: jq-1.5-1.el7.x86_64 2019-11-28T21:44:03.247 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package socat.x86_64 0:1.7.3.2-2.el7 will be installed 2019-11-28T21:44:03.250 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be installed 2019-11-28T21:44:03.254 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:44:03.254 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package oniguruma.x86_64 0:5.9.5-3.el7 will be installed 2019-11-28T21:44:03.625 INFO:teuthology.orchestra.run.smithi074.stdout:--> Finished Dependency Resolution 2019-11-28T21:44:03.649 INFO:teuthology.orchestra.run.smithi141.stdout:-------------------------------------------------------------------------------- 2019-11-28T21:44:03.650 INFO:teuthology.orchestra.run.smithi141.stdout:Total 19 MB/s | 38 MB 00:01 2019-11-28T21:44:03.652 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction check 2019-11-28T21:44:03.670 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction test 2019-11-28T21:44:03.751 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction test succeeded 2019-11-28T21:44:03.751 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction 2019-11-28T21:44:03.844 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:03.844 INFO:teuthology.orchestra.run.smithi074.stdout:Dependencies Resolved 2019-11-28T21:44:03.845 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:03.845 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:44:03.845 INFO:teuthology.orchestra.run.smithi074.stdout: Package Arch Version Repository 2019-11-28T21:44:03.845 INFO:teuthology.orchestra.run.smithi074.stdout: Size 2019-11-28T21:44:03.845 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:44:03.845 INFO:teuthology.orchestra.run.smithi074.stdout:Installing: 2019-11-28T21:44:03.845 INFO:teuthology.orchestra.run.smithi074.stdout: ceph-test x86_64 2:15.0.0-7725.g0073295.el7 ceph 38 M 2019-11-28T21:44:03.846 INFO:teuthology.orchestra.run.smithi074.stdout:Installing for dependencies: 2019-11-28T21:44:03.846 INFO:teuthology.orchestra.run.smithi074.stdout: jq x86_64 1.5-1.el7 epel 153 k 2019-11-28T21:44:03.846 INFO:teuthology.orchestra.run.smithi074.stdout: oniguruma x86_64 5.9.5-3.el7 epel 129 k 2019-11-28T21:44:03.846 INFO:teuthology.orchestra.run.smithi074.stdout: socat x86_64 1.7.3.2-2.el7 base 290 k 2019-11-28T21:44:03.846 INFO:teuthology.orchestra.run.smithi074.stdout: xmlstarlet x86_64 1.6.1-1.el7 epel 62 k 2019-11-28T21:44:03.846 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:03.846 INFO:teuthology.orchestra.run.smithi074.stdout:Transaction Summary 2019-11-28T21:44:03.847 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:44:03.847 INFO:teuthology.orchestra.run.smithi074.stdout:Install 1 Package (+4 Dependent packages) 2019-11-28T21:44:03.847 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:03.847 INFO:teuthology.orchestra.run.smithi074.stdout:Total download size: 38 M 2019-11-28T21:44:03.848 INFO:teuthology.orchestra.run.smithi074.stdout:Installed size: 134 M 2019-11-28T21:44:03.848 INFO:teuthology.orchestra.run.smithi074.stdout:Downloading packages: 2019-11-28T21:44:04.464 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : xmlstarlet-1.6.1-1.el7.x86_64 1/5 2019-11-28T21:44:04.764 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : socat-1.7.3.2-2.el7.x86_64 2/5 2019-11-28T21:44:05.051 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : oniguruma-5.9.5-3.el7.x86_64 3/5 2019-11-28T21:44:07.861 INFO:teuthology.orchestra.run.smithi074.stdout:-------------------------------------------------------------------------------- 2019-11-28T21:44:07.862 INFO:teuthology.orchestra.run.smithi074.stdout:Total 9.5 MB/s | 38 MB 00:04 2019-11-28T21:44:07.865 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction check 2019-11-28T21:44:07.888 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction test 2019-11-28T21:44:07.945 INFO:teuthology.orchestra.run.smithi074.stdout:Transaction test succeeded 2019-11-28T21:44:07.945 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction 2019-11-28T21:44:08.646 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : xmlstarlet-1.6.1-1.el7.x86_64 1/5 2019-11-28T21:44:08.892 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : socat-1.7.3.2-2.el7.x86_64 2/5 2019-11-28T21:44:09.012 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : jq-1.5-1.el7.x86_64 4/5 2019-11-28T21:44:09.194 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : oniguruma-5.9.5-3.el7.x86_64 3/5 2019-11-28T21:44:09.587 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : 2:ceph-test-15.0.0-7725.g0073295.el7.x86_64 5/5 2019-11-28T21:44:09.701 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : oniguruma-5.9.5-3.el7.x86_64 1/5 2019-11-28T21:44:09.813 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : socat-1.7.3.2-2.el7.x86_64 2/5 2019-11-28T21:44:09.918 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : 2:ceph-test-15.0.0-7725.g0073295.el7.x86_64 3/5 2019-11-28T21:44:10.027 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : jq-1.5-1.el7.x86_64 4/5 2019-11-28T21:44:10.537 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : xmlstarlet-1.6.1-1.el7.x86_64 5/5 2019-11-28T21:44:10.538 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:10.538 INFO:teuthology.orchestra.run.smithi141.stdout:Installed: 2019-11-28T21:44:10.538 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-test.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:44:10.538 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:10.538 INFO:teuthology.orchestra.run.smithi141.stdout:Dependency Installed: 2019-11-28T21:44:10.538 INFO:teuthology.orchestra.run.smithi141.stdout: jq.x86_64 0:1.5-1.el7 oniguruma.x86_64 0:5.9.5-3.el7 2019-11-28T21:44:10.538 INFO:teuthology.orchestra.run.smithi141.stdout: socat.x86_64 0:1.7.3.2-2.el7 xmlstarlet.x86_64 0:1.6.1-1.el7 2019-11-28T21:44:10.539 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:10.539 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2019-11-28T21:44:10.664 INFO:teuthology.orchestra.run.smithi141:> sudo yum -y install ceph 2019-11-28T21:44:10.864 INFO:teuthology.orchestra.run.smithi141.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:44:10.902 INFO:teuthology.orchestra.run.smithi141.stdout:Loading mirror speeds from cached hostfile 2019-11-28T21:44:10.904 INFO:teuthology.orchestra.run.smithi141.stdout: * base: mirror.cogentco.com 2019-11-28T21:44:10.904 INFO:teuthology.orchestra.run.smithi141.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T21:44:10.904 INFO:teuthology.orchestra.run.smithi141.stdout: * extras: mirror.linux.duke.edu 2019-11-28T21:44:10.904 INFO:teuthology.orchestra.run.smithi141.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-11-28T21:44:11.508 INFO:teuthology.orchestra.run.smithi141.stdout:7 packages excluded due to repository priority protections 2019-11-28T21:44:11.834 INFO:teuthology.orchestra.run.smithi141.stdout:Resolving Dependencies 2019-11-28T21:44:11.834 INFO:teuthology.orchestra.run.smithi141.stdout:--> Running transaction check 2019-11-28T21:44:11.834 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package ceph.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:44:11.836 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: ceph-osd = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:44:11.866 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: ceph-mds = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:44:11.867 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: ceph-mgr = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:44:11.868 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: ceph-mon = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:44:11.869 INFO:teuthology.orchestra.run.smithi141.stdout:--> Running transaction check 2019-11-28T21:44:11.869 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package ceph-mds.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:44:11.879 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package ceph-mgr.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:44:11.881 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: pyOpenSSL for package: 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:44:11.882 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python-requests for package: 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:44:11.884 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python-werkzeug for package: 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:44:11.885 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python-cherrypy for package: 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:44:11.886 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python-bcrypt for package: 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:44:11.887 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python-pecan for package: 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:44:11.888 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package ceph-mon.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:44:11.890 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package ceph-osd.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:44:11.895 INFO:teuthology.orchestra.run.smithi141.stdout:--> Running transaction check 2019-11-28T21:44:11.895 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package pyOpenSSL.x86_64 0:0.13.1-4.el7 will be installed 2019-11-28T21:44:11.895 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python-cherrypy.noarch 0:3.2.2-4.el7 will be installed 2019-11-28T21:44:11.897 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python-pecan.noarch 0:0.4.5-2.el7 will be installed 2019-11-28T21:44:11.897 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python-mako >= 0.4.0 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-28T21:44:11.898 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python-simplegeneric >= 0.8 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-28T21:44:11.899 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python-webob >= 1.2 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-28T21:44:11.900 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python-webtest >= 1.3.1 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-28T21:44:11.900 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python-singledispatch for package: python-pecan-0.4.5-2.el7.noarch 2019-11-28T21:44:11.901 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python-requests.noarch 0:2.6.0-7.el7_7 will be installed 2019-11-28T21:44:11.902 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python-urllib3 >= 1.10.2-1 for package: python-requests-2.6.0-7.el7_7.noarch 2019-11-28T21:44:11.903 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python-werkzeug.noarch 0:0.9.1-2.el7 will be installed 2019-11-28T21:44:11.903 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python2-bcrypt.x86_64 0:3.1.6-2.el7 will be installed 2019-11-28T21:44:11.903 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python2-six for package: python2-bcrypt-3.1.6-2.el7.x86_64 2019-11-28T21:44:11.904 INFO:teuthology.orchestra.run.smithi141.stdout:--> Running transaction check 2019-11-28T21:44:11.905 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python-mako.noarch 0:0.8.1-2.el7 will be installed 2019-11-28T21:44:11.905 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python-markupsafe for package: python-mako-0.8.1-2.el7.noarch 2019-11-28T21:44:11.905 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python-beaker for package: python-mako-0.8.1-2.el7.noarch 2019-11-28T21:44:11.906 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python-simplegeneric.noarch 0:0.8-7.el7 will be installed 2019-11-28T21:44:11.907 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python-singledispatch.noarch 0:3.4.0.2-2.el7 will be installed 2019-11-28T21:44:11.907 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python-urllib3.noarch 0:1.10.2-7.el7 will be installed 2019-11-28T21:44:11.908 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python-webob.noarch 0:1.2.3-7.el7 will be installed 2019-11-28T21:44:11.909 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python-webtest.noarch 0:1.3.4-6.el7 will be installed 2019-11-28T21:44:11.909 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python2-six.noarch 0:1.9.0-0.el7 will be installed 2019-11-28T21:44:11.909 INFO:teuthology.orchestra.run.smithi141.stdout:--> Running transaction check 2019-11-28T21:44:11.909 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python-beaker.noarch 0:1.5.4-10.el7 will be installed 2019-11-28T21:44:11.909 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python-paste for package: python-beaker-1.5.4-10.el7.noarch 2019-11-28T21:44:11.909 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python-markupsafe.x86_64 0:0.11-10.el7 will be installed 2019-11-28T21:44:11.909 INFO:teuthology.orchestra.run.smithi141.stdout:--> Running transaction check 2019-11-28T21:44:11.910 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 will be installed 2019-11-28T21:44:11.910 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python-tempita for package: python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 2019-11-28T21:44:11.910 INFO:teuthology.orchestra.run.smithi141.stdout:--> Running transaction check 2019-11-28T21:44:11.910 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python-tempita.noarch 0:0.5.1-6.el7 will be installed 2019-11-28T21:44:12.269 INFO:teuthology.orchestra.run.smithi141.stdout:--> Finished Dependency Resolution 2019-11-28T21:44:12.492 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:12.493 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies Resolved 2019-11-28T21:44:12.495 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:12.495 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:44:12.496 INFO:teuthology.orchestra.run.smithi141.stdout: Package Arch Version Repository 2019-11-28T21:44:12.496 INFO:teuthology.orchestra.run.smithi141.stdout: Size 2019-11-28T21:44:12.496 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:44:12.496 INFO:teuthology.orchestra.run.smithi141.stdout:Installing: 2019-11-28T21:44:12.496 INFO:teuthology.orchestra.run.smithi141.stdout: ceph x86_64 2:15.0.0-7725.g0073295.el7 ceph 2.0 k 2019-11-28T21:44:12.496 INFO:teuthology.orchestra.run.smithi141.stdout:Installing for dependencies: 2019-11-28T21:44:12.496 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mds x86_64 2:15.0.0-7725.g0073295.el7 ceph 1.9 M 2019-11-28T21:44:12.497 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr x86_64 2:15.0.0-7725.g0073295.el7 ceph 1.7 M 2019-11-28T21:44:12.497 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mon x86_64 2:15.0.0-7725.g0073295.el7 ceph 4.3 M 2019-11-28T21:44:12.497 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-osd x86_64 2:15.0.0-7725.g0073295.el7 ceph 16 M 2019-11-28T21:44:12.497 INFO:teuthology.orchestra.run.smithi141.stdout: pyOpenSSL x86_64 0.13.1-4.el7 base 135 k 2019-11-28T21:44:12.497 INFO:teuthology.orchestra.run.smithi141.stdout: python-beaker noarch 1.5.4-10.el7 base 80 k 2019-11-28T21:44:12.497 INFO:teuthology.orchestra.run.smithi141.stdout: python-cherrypy noarch 3.2.2-4.el7 base 422 k 2019-11-28T21:44:12.497 INFO:teuthology.orchestra.run.smithi141.stdout: python-mako noarch 0.8.1-2.el7 base 307 k 2019-11-28T21:44:12.498 INFO:teuthology.orchestra.run.smithi141.stdout: python-markupsafe x86_64 0.11-10.el7 base 25 k 2019-11-28T21:44:12.498 INFO:teuthology.orchestra.run.smithi141.stdout: python-paste noarch 1.7.5.1-9.20111221hg1498.el7 base 866 k 2019-11-28T21:44:12.498 INFO:teuthology.orchestra.run.smithi141.stdout: python-pecan noarch 0.4.5-2.el7 epel 255 k 2019-11-28T21:44:12.498 INFO:teuthology.orchestra.run.smithi141.stdout: python-requests noarch 2.6.0-7.el7_7 updates 95 k 2019-11-28T21:44:12.498 INFO:teuthology.orchestra.run.smithi141.stdout: python-simplegeneric noarch 0.8-7.el7 epel 12 k 2019-11-28T21:44:12.498 INFO:teuthology.orchestra.run.smithi141.stdout: python-singledispatch noarch 3.4.0.2-2.el7 epel 18 k 2019-11-28T21:44:12.498 INFO:teuthology.orchestra.run.smithi141.stdout: python-tempita noarch 0.5.1-6.el7 base 33 k 2019-11-28T21:44:12.499 INFO:teuthology.orchestra.run.smithi141.stdout: python-urllib3 noarch 1.10.2-7.el7 base 103 k 2019-11-28T21:44:12.499 INFO:teuthology.orchestra.run.smithi141.stdout: python-webob noarch 1.2.3-7.el7 base 202 k 2019-11-28T21:44:12.499 INFO:teuthology.orchestra.run.smithi141.stdout: python-webtest noarch 1.3.4-6.el7 base 102 k 2019-11-28T21:44:12.499 INFO:teuthology.orchestra.run.smithi141.stdout: python-werkzeug noarch 0.9.1-2.el7 extras 562 k 2019-11-28T21:44:12.499 INFO:teuthology.orchestra.run.smithi141.stdout: python2-bcrypt x86_64 3.1.6-2.el7 epel 39 k 2019-11-28T21:44:12.499 INFO:teuthology.orchestra.run.smithi141.stdout: python2-six noarch 1.9.0-0.el7 epel 2.9 k 2019-11-28T21:44:12.499 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:12.499 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction Summary 2019-11-28T21:44:12.500 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:44:12.500 INFO:teuthology.orchestra.run.smithi141.stdout:Install 1 Package (+21 Dependent packages) 2019-11-28T21:44:12.500 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:12.500 INFO:teuthology.orchestra.run.smithi141.stdout:Total download size: 28 M 2019-11-28T21:44:12.501 INFO:teuthology.orchestra.run.smithi141.stdout:Installed size: 87 M 2019-11-28T21:44:12.501 INFO:teuthology.orchestra.run.smithi141.stdout:Downloading packages: 2019-11-28T21:44:13.186 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : jq-1.5-1.el7.x86_64 4/5 2019-11-28T21:44:13.849 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : 2:ceph-test-15.0.0-7725.g0073295.el7.x86_64 5/5 2019-11-28T21:44:13.968 INFO:teuthology.orchestra.run.smithi141.stdout:-------------------------------------------------------------------------------- 2019-11-28T21:44:13.969 INFO:teuthology.orchestra.run.smithi141.stdout:Total 19 MB/s | 28 MB 00:01 2019-11-28T21:44:13.979 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : oniguruma-5.9.5-3.el7.x86_64 1/5 2019-11-28T21:44:13.995 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction check 2019-11-28T21:44:14.043 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction test 2019-11-28T21:44:14.088 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : socat-1.7.3.2-2.el7.x86_64 2/5 2019-11-28T21:44:14.213 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : 2:ceph-test-15.0.0-7725.g0073295.el7.x86_64 3/5 2019-11-28T21:44:14.297 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : jq-1.5-1.el7.x86_64 4/5 2019-11-28T21:44:14.680 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction test succeeded 2019-11-28T21:44:14.680 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction 2019-11-28T21:44:14.774 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : xmlstarlet-1.6.1-1.el7.x86_64 5/5 2019-11-28T21:44:14.774 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:14.774 INFO:teuthology.orchestra.run.smithi074.stdout:Installed: 2019-11-28T21:44:14.774 INFO:teuthology.orchestra.run.smithi074.stdout: ceph-test.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:44:14.774 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:14.774 INFO:teuthology.orchestra.run.smithi074.stdout:Dependency Installed: 2019-11-28T21:44:14.774 INFO:teuthology.orchestra.run.smithi074.stdout: jq.x86_64 0:1.5-1.el7 oniguruma.x86_64 0:5.9.5-3.el7 2019-11-28T21:44:14.775 INFO:teuthology.orchestra.run.smithi074.stdout: socat.x86_64 0:1.7.3.2-2.el7 xmlstarlet.x86_64 0:1.6.1-1.el7 2019-11-28T21:44:14.775 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:14.775 INFO:teuthology.orchestra.run.smithi074.stdout:Complete! 2019-11-28T21:44:14.894 INFO:teuthology.orchestra.run.smithi074:> sudo yum -y install ceph 2019-11-28T21:44:15.141 INFO:teuthology.orchestra.run.smithi074.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:44:15.182 INFO:teuthology.orchestra.run.smithi074.stdout:Loading mirror speeds from cached hostfile 2019-11-28T21:44:15.183 INFO:teuthology.orchestra.run.smithi074.stdout: * base: mirror.cogentco.com 2019-11-28T21:44:15.183 INFO:teuthology.orchestra.run.smithi074.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T21:44:15.184 INFO:teuthology.orchestra.run.smithi074.stdout: * extras: mirror.linux.duke.edu 2019-11-28T21:44:15.184 INFO:teuthology.orchestra.run.smithi074.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-11-28T21:44:15.763 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python-webob-1.2.3-7.el7.noarch 1/22 2019-11-28T21:44:15.773 INFO:teuthology.orchestra.run.smithi074.stdout:7 packages excluded due to repository priority protections 2019-11-28T21:44:16.055 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : pyOpenSSL-0.13.1-4.el7.x86_64 2/22 2019-11-28T21:44:16.094 INFO:teuthology.orchestra.run.smithi074.stdout:Resolving Dependencies 2019-11-28T21:44:16.095 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:44:16.095 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package ceph.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:44:16.097 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: ceph-osd = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:44:16.126 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: ceph-mds = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:44:16.127 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: ceph-mgr = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:44:16.129 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: ceph-mon = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:44:16.130 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:44:16.130 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package ceph-mds.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:44:16.140 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package ceph-mgr.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:44:16.142 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: pyOpenSSL for package: 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:44:16.143 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python-requests for package: 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:44:16.145 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python-werkzeug for package: 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:44:16.146 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python-cherrypy for package: 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:44:16.147 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python-bcrypt for package: 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:44:16.148 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python-pecan for package: 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:44:16.149 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package ceph-mon.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:44:16.152 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package ceph-osd.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:44:16.156 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:44:16.156 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package pyOpenSSL.x86_64 0:0.13.1-4.el7 will be installed 2019-11-28T21:44:16.157 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python-cherrypy.noarch 0:3.2.2-4.el7 will be installed 2019-11-28T21:44:16.158 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python-pecan.noarch 0:0.4.5-2.el7 will be installed 2019-11-28T21:44:16.158 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python-mako >= 0.4.0 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-28T21:44:16.159 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python-simplegeneric >= 0.8 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-28T21:44:16.160 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python-webob >= 1.2 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-28T21:44:16.161 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python-webtest >= 1.3.1 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-28T21:44:16.162 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python-singledispatch for package: python-pecan-0.4.5-2.el7.noarch 2019-11-28T21:44:16.163 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python-requests.noarch 0:2.6.0-7.el7_7 will be installed 2019-11-28T21:44:16.163 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python-urllib3 >= 1.10.2-1 for package: python-requests-2.6.0-7.el7_7.noarch 2019-11-28T21:44:16.164 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python-werkzeug.noarch 0:0.9.1-2.el7 will be installed 2019-11-28T21:44:16.164 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python2-bcrypt.x86_64 0:3.1.6-2.el7 will be installed 2019-11-28T21:44:16.165 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python2-six for package: python2-bcrypt-3.1.6-2.el7.x86_64 2019-11-28T21:44:16.166 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:44:16.166 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python-mako.noarch 0:0.8.1-2.el7 will be installed 2019-11-28T21:44:16.166 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python-markupsafe for package: python-mako-0.8.1-2.el7.noarch 2019-11-28T21:44:16.167 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python-beaker for package: python-mako-0.8.1-2.el7.noarch 2019-11-28T21:44:16.168 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python-simplegeneric.noarch 0:0.8-7.el7 will be installed 2019-11-28T21:44:16.168 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python-singledispatch.noarch 0:3.4.0.2-2.el7 will be installed 2019-11-28T21:44:16.168 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python-urllib3.noarch 0:1.10.2-7.el7 will be installed 2019-11-28T21:44:16.181 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python-webob.noarch 0:1.2.3-7.el7 will be installed 2019-11-28T21:44:16.181 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python-webtest.noarch 0:1.3.4-6.el7 will be installed 2019-11-28T21:44:16.181 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python2-six.noarch 0:1.9.0-0.el7 will be installed 2019-11-28T21:44:16.181 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:44:16.181 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python-beaker.noarch 0:1.5.4-10.el7 will be installed 2019-11-28T21:44:16.181 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python-paste for package: python-beaker-1.5.4-10.el7.noarch 2019-11-28T21:44:16.181 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python-markupsafe.x86_64 0:0.11-10.el7 will be installed 2019-11-28T21:44:16.182 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:44:16.182 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 will be installed 2019-11-28T21:44:16.182 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python-tempita for package: python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 2019-11-28T21:44:16.182 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:44:16.182 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python-tempita.noarch 0:0.5.1-6.el7 will be installed 2019-11-28T21:44:16.531 INFO:teuthology.orchestra.run.smithi074.stdout:--> Finished Dependency Resolution 2019-11-28T21:44:16.750 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:16.750 INFO:teuthology.orchestra.run.smithi074.stdout:Dependencies Resolved 2019-11-28T21:44:16.753 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:16.753 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:44:16.754 INFO:teuthology.orchestra.run.smithi074.stdout: Package Arch Version Repository 2019-11-28T21:44:16.754 INFO:teuthology.orchestra.run.smithi074.stdout: Size 2019-11-28T21:44:16.754 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:44:16.754 INFO:teuthology.orchestra.run.smithi074.stdout:Installing: 2019-11-28T21:44:16.754 INFO:teuthology.orchestra.run.smithi074.stdout: ceph x86_64 2:15.0.0-7725.g0073295.el7 ceph 2.0 k 2019-11-28T21:44:16.754 INFO:teuthology.orchestra.run.smithi074.stdout:Installing for dependencies: 2019-11-28T21:44:16.754 INFO:teuthology.orchestra.run.smithi074.stdout: ceph-mds x86_64 2:15.0.0-7725.g0073295.el7 ceph 1.9 M 2019-11-28T21:44:16.755 INFO:teuthology.orchestra.run.smithi074.stdout: ceph-mgr x86_64 2:15.0.0-7725.g0073295.el7 ceph 1.7 M 2019-11-28T21:44:16.755 INFO:teuthology.orchestra.run.smithi074.stdout: ceph-mon x86_64 2:15.0.0-7725.g0073295.el7 ceph 4.3 M 2019-11-28T21:44:16.755 INFO:teuthology.orchestra.run.smithi074.stdout: ceph-osd x86_64 2:15.0.0-7725.g0073295.el7 ceph 16 M 2019-11-28T21:44:16.755 INFO:teuthology.orchestra.run.smithi074.stdout: pyOpenSSL x86_64 0.13.1-4.el7 base 135 k 2019-11-28T21:44:16.755 INFO:teuthology.orchestra.run.smithi074.stdout: python-beaker noarch 1.5.4-10.el7 base 80 k 2019-11-28T21:44:16.755 INFO:teuthology.orchestra.run.smithi074.stdout: python-cherrypy noarch 3.2.2-4.el7 base 422 k 2019-11-28T21:44:16.755 INFO:teuthology.orchestra.run.smithi074.stdout: python-mako noarch 0.8.1-2.el7 base 307 k 2019-11-28T21:44:16.756 INFO:teuthology.orchestra.run.smithi074.stdout: python-markupsafe x86_64 0.11-10.el7 base 25 k 2019-11-28T21:44:16.756 INFO:teuthology.orchestra.run.smithi074.stdout: python-paste noarch 1.7.5.1-9.20111221hg1498.el7 base 866 k 2019-11-28T21:44:16.756 INFO:teuthology.orchestra.run.smithi074.stdout: python-pecan noarch 0.4.5-2.el7 epel 255 k 2019-11-28T21:44:16.756 INFO:teuthology.orchestra.run.smithi074.stdout: python-requests noarch 2.6.0-7.el7_7 updates 95 k 2019-11-28T21:44:16.756 INFO:teuthology.orchestra.run.smithi074.stdout: python-simplegeneric noarch 0.8-7.el7 epel 12 k 2019-11-28T21:44:16.756 INFO:teuthology.orchestra.run.smithi074.stdout: python-singledispatch noarch 3.4.0.2-2.el7 epel 18 k 2019-11-28T21:44:16.756 INFO:teuthology.orchestra.run.smithi074.stdout: python-tempita noarch 0.5.1-6.el7 base 33 k 2019-11-28T21:44:16.757 INFO:teuthology.orchestra.run.smithi074.stdout: python-urllib3 noarch 1.10.2-7.el7 base 103 k 2019-11-28T21:44:16.757 INFO:teuthology.orchestra.run.smithi074.stdout: python-webob noarch 1.2.3-7.el7 base 202 k 2019-11-28T21:44:16.757 INFO:teuthology.orchestra.run.smithi074.stdout: python-webtest noarch 1.3.4-6.el7 base 102 k 2019-11-28T21:44:16.757 INFO:teuthology.orchestra.run.smithi074.stdout: python-werkzeug noarch 0.9.1-2.el7 extras 562 k 2019-11-28T21:44:16.757 INFO:teuthology.orchestra.run.smithi074.stdout: python2-bcrypt x86_64 3.1.6-2.el7 epel 39 k 2019-11-28T21:44:16.757 INFO:teuthology.orchestra.run.smithi074.stdout: python2-six noarch 1.9.0-0.el7 epel 2.9 k 2019-11-28T21:44:16.757 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:16.758 INFO:teuthology.orchestra.run.smithi074.stdout:Transaction Summary 2019-11-28T21:44:16.758 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:44:16.758 INFO:teuthology.orchestra.run.smithi074.stdout:Install 1 Package (+21 Dependent packages) 2019-11-28T21:44:16.758 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:16.759 INFO:teuthology.orchestra.run.smithi074.stdout:Total download size: 28 M 2019-11-28T21:44:16.759 INFO:teuthology.orchestra.run.smithi074.stdout:Installed size: 87 M 2019-11-28T21:44:16.759 INFO:teuthology.orchestra.run.smithi074.stdout:Downloading packages: 2019-11-28T21:44:16.808 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python-webtest-1.3.4-6.el7.noarch 3/22 2019-11-28T21:44:17.190 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : 2:ceph-mon-15.0.0-7725.g0073295.el7.x86_64 4/22 2019-11-28T21:44:17.681 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python-tempita-0.5.1-6.el7.noarch 5/22 2019-11-28T21:44:18.066 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 6/22 2019-11-28T21:44:18.202 INFO:teuthology.orchestra.run.smithi074.stdout:-------------------------------------------------------------------------------- 2019-11-28T21:44:18.203 INFO:teuthology.orchestra.run.smithi074.stdout:Total 19 MB/s | 28 MB 00:01 2019-11-28T21:44:18.215 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction check 2019-11-28T21:44:18.241 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction test 2019-11-28T21:44:18.485 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python-beaker-1.5.4-10.el7.noarch 7/22 2019-11-28T21:44:18.909 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python-cherrypy-3.2.2-4.el7.noarch 8/22 2019-11-28T21:44:18.914 INFO:teuthology.orchestra.run.smithi074.stdout:Transaction test succeeded 2019-11-28T21:44:18.914 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction 2019-11-28T21:44:20.057 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : python-webob-1.2.3-7.el7.noarch 1/22 2019-11-28T21:44:20.374 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : pyOpenSSL-0.13.1-4.el7.x86_64 2/22 2019-11-28T21:44:21.104 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python-werkzeug-0.9.1-2.el7.noarch 9/22 2019-11-28T21:44:21.151 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : python-webtest-1.3.4-6.el7.noarch 3/22 2019-11-28T21:44:21.533 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : 2:ceph-osd-15.0.0-7725.g0073295.el7.x86_64 10/22 2019-11-28T21:44:21.570 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : 2:ceph-mon-15.0.0-7725.g0073295.el7.x86_64 4/22 2019-11-28T21:44:21.909 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python-markupsafe-0.11-10.el7.x86_64 11/22 2019-11-28T21:44:22.023 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : python-tempita-0.5.1-6.el7.noarch 5/22 2019-11-28T21:44:22.197 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python-mako-0.8.1-2.el7.noarch 12/22 2019-11-28T21:44:22.349 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 6/22 2019-11-28T21:44:22.702 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python-singledispatch-3.4.0.2-2.el7.noarch 13/22 2019-11-28T21:44:22.805 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : python-beaker-1.5.4-10.el7.noarch 7/22 2019-11-28T21:44:23.134 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : 2:ceph-mds-15.0.0-7725.g0073295.el7.x86_64 14/22 2019-11-28T21:44:23.300 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : python-cherrypy-3.2.2-4.el7.noarch 8/22 2019-11-28T21:44:23.457 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python-urllib3-1.10.2-7.el7.noarch 15/22 2019-11-28T21:44:23.739 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python-requests-2.6.0-7.el7_7.noarch 16/22 2019-11-28T21:44:23.935 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python2-six-1.9.0-0.el7.noarch 17/22 2019-11-28T21:44:24.183 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python2-bcrypt-3.1.6-2.el7.x86_64 18/22 2019-11-28T21:44:24.564 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python-simplegeneric-0.8-7.el7.noarch 19/22 2019-11-28T21:44:25.231 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python-pecan-0.4.5-2.el7.noarch 20/22 2019-11-28T21:44:25.290 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : python-werkzeug-0.9.1-2.el7.noarch 9/22 2019-11-28T21:44:25.672 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 21/22 2019-11-28T21:44:25.715 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : 2:ceph-osd-15.0.0-7725.g0073295.el7.x86_64 10/22 2019-11-28T21:44:25.942 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : 2:ceph-15.0.0-7725.g0073295.el7.x86_64 22/22 2019-11-28T21:44:26.028 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python-simplegeneric-0.8-7.el7.noarch 1/22 2019-11-28T21:44:26.101 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : python-markupsafe-0.11-10.el7.x86_64 11/22 2019-11-28T21:44:26.103 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python2-six-1.9.0-0.el7.noarch 2/22 2019-11-28T21:44:26.204 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : pyOpenSSL-0.13.1-4.el7.x86_64 3/22 2019-11-28T21:44:26.279 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python2-bcrypt-3.1.6-2.el7.x86_64 4/22 2019-11-28T21:44:26.397 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : 2:ceph-15.0.0-7725.g0073295.el7.x86_64 5/22 2019-11-28T21:44:26.400 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : python-mako-0.8.1-2.el7.noarch 12/22 2019-11-28T21:44:26.497 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python-urllib3-1.10.2-7.el7.noarch 6/22 2019-11-28T21:44:26.589 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python-mako-0.8.1-2.el7.noarch 7/22 2019-11-28T21:44:26.706 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : 2:ceph-mds-15.0.0-7725.g0073295.el7.x86_64 8/22 2019-11-28T21:44:26.815 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python-requests-2.6.0-7.el7_7.noarch 9/22 2019-11-28T21:44:26.925 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : python-singledispatch-3.4.0.2-2.el7.noarch 13/22 2019-11-28T21:44:26.940 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python-pecan-0.4.5-2.el7.noarch 10/22 2019-11-28T21:44:27.066 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python-singledispatch-3.4.0.2-2.el7.noarch 11/22 2019-11-28T21:44:27.175 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python-markupsafe-0.11-10.el7.x86_64 12/22 2019-11-28T21:44:27.317 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 13/22 2019-11-28T21:44:27.346 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : 2:ceph-mds-15.0.0-7725.g0073295.el7.x86_64 14/22 2019-11-28T21:44:27.434 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 14/22 2019-11-28T21:44:27.560 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python-webob-1.2.3-7.el7.noarch 15/22 2019-11-28T21:44:27.652 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : python-urllib3-1.10.2-7.el7.noarch 15/22 2019-11-28T21:44:27.685 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : 2:ceph-osd-15.0.0-7725.g0073295.el7.x86_64 16/22 2019-11-28T21:44:27.777 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python-werkzeug-0.9.1-2.el7.noarch 17/22 2019-11-28T21:44:27.861 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python-cherrypy-3.2.2-4.el7.noarch 18/22 2019-11-28T21:44:27.925 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : python-requests-2.6.0-7.el7_7.noarch 16/22 2019-11-28T21:44:27.970 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python-beaker-1.5.4-10.el7.noarch 19/22 2019-11-28T21:44:28.062 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python-tempita-0.5.1-6.el7.noarch 20/22 2019-11-28T21:44:28.120 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : python2-six-1.9.0-0.el7.noarch 17/22 2019-11-28T21:44:28.154 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : 2:ceph-mon-15.0.0-7725.g0073295.el7.x86_64 21/22 2019-11-28T21:44:28.385 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : python2-bcrypt-3.1.6-2.el7.x86_64 18/22 2019-11-28T21:44:28.590 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python-webtest-1.3.4-6.el7.noarch 22/22 2019-11-28T21:44:28.590 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:28.590 INFO:teuthology.orchestra.run.smithi141.stdout:Installed: 2019-11-28T21:44:28.590 INFO:teuthology.orchestra.run.smithi141.stdout: ceph.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:44:28.590 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:28.591 INFO:teuthology.orchestra.run.smithi141.stdout:Dependency Installed: 2019-11-28T21:44:28.591 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mds.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:44:28.591 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:44:28.591 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mon.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:44:28.591 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-osd.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:44:28.591 INFO:teuthology.orchestra.run.smithi141.stdout: pyOpenSSL.x86_64 0:0.13.1-4.el7 2019-11-28T21:44:28.591 INFO:teuthology.orchestra.run.smithi141.stdout: python-beaker.noarch 0:1.5.4-10.el7 2019-11-28T21:44:28.591 INFO:teuthology.orchestra.run.smithi141.stdout: python-cherrypy.noarch 0:3.2.2-4.el7 2019-11-28T21:44:28.592 INFO:teuthology.orchestra.run.smithi141.stdout: python-mako.noarch 0:0.8.1-2.el7 2019-11-28T21:44:28.592 INFO:teuthology.orchestra.run.smithi141.stdout: python-markupsafe.x86_64 0:0.11-10.el7 2019-11-28T21:44:28.592 INFO:teuthology.orchestra.run.smithi141.stdout: python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 2019-11-28T21:44:28.592 INFO:teuthology.orchestra.run.smithi141.stdout: python-pecan.noarch 0:0.4.5-2.el7 2019-11-28T21:44:28.592 INFO:teuthology.orchestra.run.smithi141.stdout: python-requests.noarch 0:2.6.0-7.el7_7 2019-11-28T21:44:28.592 INFO:teuthology.orchestra.run.smithi141.stdout: python-simplegeneric.noarch 0:0.8-7.el7 2019-11-28T21:44:28.592 INFO:teuthology.orchestra.run.smithi141.stdout: python-singledispatch.noarch 0:3.4.0.2-2.el7 2019-11-28T21:44:28.593 INFO:teuthology.orchestra.run.smithi141.stdout: python-tempita.noarch 0:0.5.1-6.el7 2019-11-28T21:44:28.593 INFO:teuthology.orchestra.run.smithi141.stdout: python-urllib3.noarch 0:1.10.2-7.el7 2019-11-28T21:44:28.593 INFO:teuthology.orchestra.run.smithi141.stdout: python-webob.noarch 0:1.2.3-7.el7 2019-11-28T21:44:28.593 INFO:teuthology.orchestra.run.smithi141.stdout: python-webtest.noarch 0:1.3.4-6.el7 2019-11-28T21:44:28.593 INFO:teuthology.orchestra.run.smithi141.stdout: python-werkzeug.noarch 0:0.9.1-2.el7 2019-11-28T21:44:28.593 INFO:teuthology.orchestra.run.smithi141.stdout: python2-bcrypt.x86_64 0:3.1.6-2.el7 2019-11-28T21:44:28.593 INFO:teuthology.orchestra.run.smithi141.stdout: python2-six.noarch 0:1.9.0-0.el7 2019-11-28T21:44:28.593 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:28.594 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2019-11-28T21:44:28.709 INFO:teuthology.orchestra.run.smithi141:> sudo yum -y install ceph-daemon 2019-11-28T21:44:28.984 INFO:teuthology.orchestra.run.smithi141.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:44:28.985 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : python-simplegeneric-0.8-7.el7.noarch 19/22 2019-11-28T21:44:29.026 INFO:teuthology.orchestra.run.smithi141.stdout:Loading mirror speeds from cached hostfile 2019-11-28T21:44:29.027 INFO:teuthology.orchestra.run.smithi141.stdout: * base: mirror.cogentco.com 2019-11-28T21:44:29.027 INFO:teuthology.orchestra.run.smithi141.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T21:44:29.027 INFO:teuthology.orchestra.run.smithi141.stdout: * extras: mirror.linux.duke.edu 2019-11-28T21:44:29.028 INFO:teuthology.orchestra.run.smithi141.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-11-28T21:44:29.683 INFO:teuthology.orchestra.run.smithi141.stdout:7 packages excluded due to repository priority protections 2019-11-28T21:44:29.717 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : python-pecan-0.4.5-2.el7.noarch 20/22 2019-11-28T21:44:30.013 INFO:teuthology.orchestra.run.smithi141.stdout:Resolving Dependencies 2019-11-28T21:44:30.014 INFO:teuthology.orchestra.run.smithi141.stdout:--> Running transaction check 2019-11-28T21:44:30.014 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package ceph-daemon.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:44:30.116 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 21/22 2019-11-28T21:44:30.336 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : 2:ceph-15.0.0-7725.g0073295.el7.x86_64 22/22 2019-11-28T21:44:30.380 INFO:teuthology.orchestra.run.smithi141.stdout:--> Finished Dependency Resolution 2019-11-28T21:44:30.423 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : python-simplegeneric-0.8-7.el7.noarch 1/22 2019-11-28T21:44:30.557 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : python2-six-1.9.0-0.el7.noarch 2/22 2019-11-28T21:44:30.606 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:30.606 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies Resolved 2019-11-28T21:44:30.607 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:30.607 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:44:30.607 INFO:teuthology.orchestra.run.smithi141.stdout: Package Arch Version Repository 2019-11-28T21:44:30.607 INFO:teuthology.orchestra.run.smithi141.stdout: Size 2019-11-28T21:44:30.607 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:44:30.608 INFO:teuthology.orchestra.run.smithi141.stdout:Installing: 2019-11-28T21:44:30.608 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-daemon x86_64 2:15.0.0-7725.g0073295.el7 ceph 17 k 2019-11-28T21:44:30.608 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:30.608 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction Summary 2019-11-28T21:44:30.608 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:44:30.609 INFO:teuthology.orchestra.run.smithi141.stdout:Install 1 Package 2019-11-28T21:44:30.609 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:30.609 INFO:teuthology.orchestra.run.smithi141.stdout:Total download size: 17 k 2019-11-28T21:44:30.609 INFO:teuthology.orchestra.run.smithi141.stdout:Installed size: 67 k 2019-11-28T21:44:30.609 INFO:teuthology.orchestra.run.smithi141.stdout:Downloading packages: 2019-11-28T21:44:30.674 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : pyOpenSSL-0.13.1-4.el7.x86_64 3/22 2019-11-28T21:44:30.783 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : python2-bcrypt-3.1.6-2.el7.x86_64 4/22 2019-11-28T21:44:30.900 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : 2:ceph-15.0.0-7725.g0073295.el7.x86_64 5/22 2019-11-28T21:44:30.933 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction check 2019-11-28T21:44:30.941 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction test 2019-11-28T21:44:30.943 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction test succeeded 2019-11-28T21:44:30.943 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction 2019-11-28T21:44:31.009 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : python-urllib3-1.10.2-7.el7.noarch 6/22 2019-11-28T21:44:31.109 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : python-mako-0.8.1-2.el7.noarch 7/22 2019-11-28T21:44:31.235 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : 2:ceph-mds-15.0.0-7725.g0073295.el7.x86_64 8/22 2019-11-28T21:44:31.385 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : python-requests-2.6.0-7.el7_7.noarch 9/22 2019-11-28T21:44:31.511 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : python-pecan-0.4.5-2.el7.noarch 10/22 2019-11-28T21:44:31.644 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : python-singledispatch-3.4.0.2-2.el7.noarch 11/22 2019-11-28T21:44:31.770 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : python-markupsafe-0.11-10.el7.x86_64 12/22 2019-11-28T21:44:31.773 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : 2:ceph-daemon-15.0.0-7725.g0073295.el7.x86_64 1/1 2019-11-28T21:44:31.879 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 13/22 2019-11-28T21:44:31.979 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 14/22 2019-11-28T21:44:32.088 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : python-webob-1.2.3-7.el7.noarch 15/22 2019-11-28T21:44:32.162 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : 2:ceph-daemon-15.0.0-7725.g0073295.el7.x86_64 1/1 2019-11-28T21:44:32.162 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:32.162 INFO:teuthology.orchestra.run.smithi141.stdout:Installed: 2019-11-28T21:44:32.162 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-daemon.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:44:32.163 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:32.163 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2019-11-28T21:44:32.214 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : 2:ceph-osd-15.0.0-7725.g0073295.el7.x86_64 16/22 2019-11-28T21:44:32.293 INFO:teuthology.orchestra.run.smithi141:> sudo yum -y install ceph-mgr 2019-11-28T21:44:32.314 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : python-werkzeug-0.9.1-2.el7.noarch 17/22 2019-11-28T21:44:32.415 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : python-cherrypy-3.2.2-4.el7.noarch 18/22 2019-11-28T21:44:32.515 INFO:teuthology.orchestra.run.smithi141.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:44:32.549 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : python-beaker-1.5.4-10.el7.noarch 19/22 2019-11-28T21:44:32.552 INFO:teuthology.orchestra.run.smithi141.stdout:Loading mirror speeds from cached hostfile 2019-11-28T21:44:32.553 INFO:teuthology.orchestra.run.smithi141.stdout: * base: mirror.cogentco.com 2019-11-28T21:44:32.554 INFO:teuthology.orchestra.run.smithi141.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T21:44:32.554 INFO:teuthology.orchestra.run.smithi141.stdout: * extras: mirror.linux.duke.edu 2019-11-28T21:44:32.554 INFO:teuthology.orchestra.run.smithi141.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-11-28T21:44:32.657 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : python-tempita-0.5.1-6.el7.noarch 20/22 2019-11-28T21:44:32.766 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : 2:ceph-mon-15.0.0-7725.g0073295.el7.x86_64 21/22 2019-11-28T21:44:33.177 INFO:teuthology.orchestra.run.smithi141.stdout:7 packages excluded due to repository priority protections 2019-11-28T21:44:33.287 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : python-webtest-1.3.4-6.el7.noarch 22/22 2019-11-28T21:44:33.287 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:33.287 INFO:teuthology.orchestra.run.smithi074.stdout:Installed: 2019-11-28T21:44:33.287 INFO:teuthology.orchestra.run.smithi074.stdout: ceph.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:44:33.287 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:33.287 INFO:teuthology.orchestra.run.smithi074.stdout:Dependency Installed: 2019-11-28T21:44:33.288 INFO:teuthology.orchestra.run.smithi074.stdout: ceph-mds.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:44:33.288 INFO:teuthology.orchestra.run.smithi074.stdout: ceph-mgr.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:44:33.288 INFO:teuthology.orchestra.run.smithi074.stdout: ceph-mon.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:44:33.288 INFO:teuthology.orchestra.run.smithi074.stdout: ceph-osd.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:44:33.288 INFO:teuthology.orchestra.run.smithi074.stdout: pyOpenSSL.x86_64 0:0.13.1-4.el7 2019-11-28T21:44:33.288 INFO:teuthology.orchestra.run.smithi074.stdout: python-beaker.noarch 0:1.5.4-10.el7 2019-11-28T21:44:33.288 INFO:teuthology.orchestra.run.smithi074.stdout: python-cherrypy.noarch 0:3.2.2-4.el7 2019-11-28T21:44:33.289 INFO:teuthology.orchestra.run.smithi074.stdout: python-mako.noarch 0:0.8.1-2.el7 2019-11-28T21:44:33.289 INFO:teuthology.orchestra.run.smithi074.stdout: python-markupsafe.x86_64 0:0.11-10.el7 2019-11-28T21:44:33.289 INFO:teuthology.orchestra.run.smithi074.stdout: python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 2019-11-28T21:44:33.289 INFO:teuthology.orchestra.run.smithi074.stdout: python-pecan.noarch 0:0.4.5-2.el7 2019-11-28T21:44:33.289 INFO:teuthology.orchestra.run.smithi074.stdout: python-requests.noarch 0:2.6.0-7.el7_7 2019-11-28T21:44:33.289 INFO:teuthology.orchestra.run.smithi074.stdout: python-simplegeneric.noarch 0:0.8-7.el7 2019-11-28T21:44:33.289 INFO:teuthology.orchestra.run.smithi074.stdout: python-singledispatch.noarch 0:3.4.0.2-2.el7 2019-11-28T21:44:33.290 INFO:teuthology.orchestra.run.smithi074.stdout: python-tempita.noarch 0:0.5.1-6.el7 2019-11-28T21:44:33.290 INFO:teuthology.orchestra.run.smithi074.stdout: python-urllib3.noarch 0:1.10.2-7.el7 2019-11-28T21:44:33.290 INFO:teuthology.orchestra.run.smithi074.stdout: python-webob.noarch 0:1.2.3-7.el7 2019-11-28T21:44:33.290 INFO:teuthology.orchestra.run.smithi074.stdout: python-webtest.noarch 0:1.3.4-6.el7 2019-11-28T21:44:33.290 INFO:teuthology.orchestra.run.smithi074.stdout: python-werkzeug.noarch 0:0.9.1-2.el7 2019-11-28T21:44:33.290 INFO:teuthology.orchestra.run.smithi074.stdout: python2-bcrypt.x86_64 0:3.1.6-2.el7 2019-11-28T21:44:33.290 INFO:teuthology.orchestra.run.smithi074.stdout: python2-six.noarch 0:1.9.0-0.el7 2019-11-28T21:44:33.291 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:33.291 INFO:teuthology.orchestra.run.smithi074.stdout:Complete! 2019-11-28T21:44:33.422 INFO:teuthology.orchestra.run.smithi074:> sudo yum -y install ceph-daemon 2019-11-28T21:44:33.504 INFO:teuthology.orchestra.run.smithi141.stdout:Package 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 already installed and latest version 2019-11-28T21:44:33.504 INFO:teuthology.orchestra.run.smithi141.stdout:Nothing to do 2019-11-28T21:44:33.566 INFO:teuthology.orchestra.run.smithi141:> sudo yum -y install ceph-mgr-dashboard 2019-11-28T21:44:33.734 INFO:teuthology.orchestra.run.smithi074.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:44:33.780 INFO:teuthology.orchestra.run.smithi074.stdout:Loading mirror speeds from cached hostfile 2019-11-28T21:44:33.781 INFO:teuthology.orchestra.run.smithi074.stdout: * base: mirror.cogentco.com 2019-11-28T21:44:33.782 INFO:teuthology.orchestra.run.smithi074.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T21:44:33.782 INFO:teuthology.orchestra.run.smithi074.stdout: * extras: mirror.linux.duke.edu 2019-11-28T21:44:33.783 INFO:teuthology.orchestra.run.smithi074.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-11-28T21:44:33.784 INFO:teuthology.orchestra.run.smithi141.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:44:33.823 INFO:teuthology.orchestra.run.smithi141.stdout:Loading mirror speeds from cached hostfile 2019-11-28T21:44:33.824 INFO:teuthology.orchestra.run.smithi141.stdout: * base: mirror.cogentco.com 2019-11-28T21:44:33.825 INFO:teuthology.orchestra.run.smithi141.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T21:44:33.825 INFO:teuthology.orchestra.run.smithi141.stdout: * extras: mirror.linux.duke.edu 2019-11-28T21:44:33.825 INFO:teuthology.orchestra.run.smithi141.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-11-28T21:44:34.432 INFO:teuthology.orchestra.run.smithi074.stdout:7 packages excluded due to repository priority protections 2019-11-28T21:44:34.482 INFO:teuthology.orchestra.run.smithi141.stdout:7 packages excluded due to repository priority protections 2019-11-28T21:44:34.767 INFO:teuthology.orchestra.run.smithi074.stdout:Resolving Dependencies 2019-11-28T21:44:34.768 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:44:34.768 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package ceph-daemon.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:44:34.809 INFO:teuthology.orchestra.run.smithi141.stdout:Resolving Dependencies 2019-11-28T21:44:34.810 INFO:teuthology.orchestra.run.smithi141.stdout:--> Running transaction check 2019-11-28T21:44:34.810 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package ceph-mgr-dashboard.noarch 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:44:34.813 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: ceph-grafana-dashboards = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-mgr-dashboard-15.0.0-7725.g0073295.el7.noarch 2019-11-28T21:44:34.843 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python-routes for package: 2:ceph-mgr-dashboard-15.0.0-7725.g0073295.el7.noarch 2019-11-28T21:44:34.844 INFO:teuthology.orchestra.run.smithi141.stdout:--> Running transaction check 2019-11-28T21:44:34.844 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package ceph-grafana-dashboards.noarch 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:44:34.844 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python-routes.noarch 0:1.13-2.el7 will be installed 2019-11-28T21:44:34.845 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python-repoze-lru for package: python-routes-1.13-2.el7.noarch 2019-11-28T21:44:34.845 INFO:teuthology.orchestra.run.smithi141.stdout:--> Running transaction check 2019-11-28T21:44:34.846 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python-repoze-lru.noarch 0:0.4-3.el7 will be installed 2019-11-28T21:44:35.134 INFO:teuthology.orchestra.run.smithi074.stdout:--> Finished Dependency Resolution 2019-11-28T21:44:35.211 INFO:teuthology.orchestra.run.smithi141.stdout:--> Finished Dependency Resolution 2019-11-28T21:44:35.357 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:35.357 INFO:teuthology.orchestra.run.smithi074.stdout:Dependencies Resolved 2019-11-28T21:44:35.358 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:35.358 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:44:35.358 INFO:teuthology.orchestra.run.smithi074.stdout: Package Arch Version Repository 2019-11-28T21:44:35.358 INFO:teuthology.orchestra.run.smithi074.stdout: Size 2019-11-28T21:44:35.358 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:44:35.359 INFO:teuthology.orchestra.run.smithi074.stdout:Installing: 2019-11-28T21:44:35.359 INFO:teuthology.orchestra.run.smithi074.stdout: ceph-daemon x86_64 2:15.0.0-7725.g0073295.el7 ceph 17 k 2019-11-28T21:44:35.359 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:35.359 INFO:teuthology.orchestra.run.smithi074.stdout:Transaction Summary 2019-11-28T21:44:35.359 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:44:35.359 INFO:teuthology.orchestra.run.smithi074.stdout:Install 1 Package 2019-11-28T21:44:35.359 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:35.360 INFO:teuthology.orchestra.run.smithi074.stdout:Total download size: 17 k 2019-11-28T21:44:35.360 INFO:teuthology.orchestra.run.smithi074.stdout:Installed size: 67 k 2019-11-28T21:44:35.360 INFO:teuthology.orchestra.run.smithi074.stdout:Downloading packages: 2019-11-28T21:44:35.435 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:35.436 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies Resolved 2019-11-28T21:44:35.437 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:35.437 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:44:35.437 INFO:teuthology.orchestra.run.smithi141.stdout: Package Arch Version Repository Size 2019-11-28T21:44:35.437 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:44:35.437 INFO:teuthology.orchestra.run.smithi141.stdout:Installing: 2019-11-28T21:44:35.437 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-dashboard noarch 2:15.0.0-7725.g0073295.el7 ceph-noarch 3.9 M 2019-11-28T21:44:35.438 INFO:teuthology.orchestra.run.smithi141.stdout:Installing for dependencies: 2019-11-28T21:44:35.438 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-grafana-dashboards noarch 2:15.0.0-7725.g0073295.el7 ceph-noarch 18 k 2019-11-28T21:44:35.438 INFO:teuthology.orchestra.run.smithi141.stdout: python-repoze-lru noarch 0.4-3.el7 epel 13 k 2019-11-28T21:44:35.438 INFO:teuthology.orchestra.run.smithi141.stdout: python-routes noarch 1.13-2.el7 epel 640 k 2019-11-28T21:44:35.438 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:35.438 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction Summary 2019-11-28T21:44:35.438 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:44:35.439 INFO:teuthology.orchestra.run.smithi141.stdout:Install 1 Package (+3 Dependent packages) 2019-11-28T21:44:35.439 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:35.439 INFO:teuthology.orchestra.run.smithi141.stdout:Total download size: 4.5 M 2019-11-28T21:44:35.439 INFO:teuthology.orchestra.run.smithi141.stdout:Installed size: 20 M 2019-11-28T21:44:35.439 INFO:teuthology.orchestra.run.smithi141.stdout:Downloading packages: 2019-11-28T21:44:35.642 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction check 2019-11-28T21:44:35.651 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction test 2019-11-28T21:44:35.652 INFO:teuthology.orchestra.run.smithi074.stdout:Transaction test succeeded 2019-11-28T21:44:35.653 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction 2019-11-28T21:44:36.385 INFO:teuthology.orchestra.run.smithi141.stdout:-------------------------------------------------------------------------------- 2019-11-28T21:44:36.385 INFO:teuthology.orchestra.run.smithi141.stdout:Total 4.8 MB/s | 4.5 MB 00:00 2019-11-28T21:44:36.386 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction check 2019-11-28T21:44:36.390 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction test 2019-11-28T21:44:36.427 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : 2:ceph-daemon-15.0.0-7725.g0073295.el7.x86_64 1/1 2019-11-28T21:44:36.577 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction test succeeded 2019-11-28T21:44:36.577 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction 2019-11-28T21:44:36.891 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : 2:ceph-daemon-15.0.0-7725.g0073295.el7.x86_64 1/1 2019-11-28T21:44:36.891 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:36.891 INFO:teuthology.orchestra.run.smithi074.stdout:Installed: 2019-11-28T21:44:36.891 INFO:teuthology.orchestra.run.smithi074.stdout: ceph-daemon.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:44:36.892 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:36.892 INFO:teuthology.orchestra.run.smithi074.stdout:Complete! 2019-11-28T21:44:37.017 INFO:teuthology.orchestra.run.smithi074:> sudo yum -y install ceph-mgr 2019-11-28T21:44:37.241 INFO:teuthology.orchestra.run.smithi074.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:44:37.256 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : 2:ceph-grafana-dashboards-15.0.0-7725.g0073295.el7.noarch 1/4 2019-11-28T21:44:37.278 INFO:teuthology.orchestra.run.smithi074.stdout:Loading mirror speeds from cached hostfile 2019-11-28T21:44:37.279 INFO:teuthology.orchestra.run.smithi074.stdout: * base: mirror.cogentco.com 2019-11-28T21:44:37.280 INFO:teuthology.orchestra.run.smithi074.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T21:44:37.280 INFO:teuthology.orchestra.run.smithi074.stdout: * extras: mirror.linux.duke.edu 2019-11-28T21:44:37.280 INFO:teuthology.orchestra.run.smithi074.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-11-28T21:44:37.660 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python-repoze-lru-0.4-3.el7.noarch 2/4 2019-11-28T21:44:37.915 INFO:teuthology.orchestra.run.smithi074.stdout:7 packages excluded due to repository priority protections 2019-11-28T21:44:38.235 INFO:teuthology.orchestra.run.smithi074.stdout:Package 2:ceph-mgr-15.0.0-7725.g0073295.el7.x86_64 already installed and latest version 2019-11-28T21:44:38.236 INFO:teuthology.orchestra.run.smithi074.stdout:Nothing to do 2019-11-28T21:44:38.295 INFO:teuthology.orchestra.run.smithi074:> sudo yum -y install ceph-mgr-dashboard 2019-11-28T21:44:38.533 INFO:teuthology.orchestra.run.smithi074.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:44:38.573 INFO:teuthology.orchestra.run.smithi074.stdout:Loading mirror speeds from cached hostfile 2019-11-28T21:44:38.574 INFO:teuthology.orchestra.run.smithi074.stdout: * base: mirror.cogentco.com 2019-11-28T21:44:38.575 INFO:teuthology.orchestra.run.smithi074.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T21:44:38.575 INFO:teuthology.orchestra.run.smithi074.stdout: * extras: mirror.linux.duke.edu 2019-11-28T21:44:38.575 INFO:teuthology.orchestra.run.smithi074.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-11-28T21:44:38.828 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python-routes-1.13-2.el7.noarch 3/4 2019-11-28T21:44:39.206 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : 2:ceph-mgr-dashboard-15.0.0-7725.g0073295.el7.noarch 4/4 2019-11-28T21:44:39.223 INFO:teuthology.orchestra.run.smithi074.stdout:7 packages excluded due to repository priority protections 2019-11-28T21:44:39.555 INFO:teuthology.orchestra.run.smithi074.stdout:Resolving Dependencies 2019-11-28T21:44:39.556 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:44:39.556 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package ceph-mgr-dashboard.noarch 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:44:39.559 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: ceph-grafana-dashboards = 2:15.0.0-7725.g0073295.el7 for package: 2:ceph-mgr-dashboard-15.0.0-7725.g0073295.el7.noarch 2019-11-28T21:44:39.590 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python-routes for package: 2:ceph-mgr-dashboard-15.0.0-7725.g0073295.el7.noarch 2019-11-28T21:44:39.591 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:44:39.591 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package ceph-grafana-dashboards.noarch 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:44:39.591 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python-routes.noarch 0:1.13-2.el7 will be installed 2019-11-28T21:44:39.591 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python-repoze-lru for package: python-routes-1.13-2.el7.noarch 2019-11-28T21:44:39.592 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:44:39.593 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python-repoze-lru.noarch 0:0.4-3.el7 will be installed 2019-11-28T21:44:39.961 INFO:teuthology.orchestra.run.smithi074.stdout:--> Finished Dependency Resolution 2019-11-28T21:44:40.182 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:40.182 INFO:teuthology.orchestra.run.smithi074.stdout:Dependencies Resolved 2019-11-28T21:44:40.183 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:40.183 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:44:40.183 INFO:teuthology.orchestra.run.smithi074.stdout: Package Arch Version Repository Size 2019-11-28T21:44:40.183 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:44:40.184 INFO:teuthology.orchestra.run.smithi074.stdout:Installing: 2019-11-28T21:44:40.184 INFO:teuthology.orchestra.run.smithi074.stdout: ceph-mgr-dashboard noarch 2:15.0.0-7725.g0073295.el7 ceph-noarch 3.9 M 2019-11-28T21:44:40.184 INFO:teuthology.orchestra.run.smithi074.stdout:Installing for dependencies: 2019-11-28T21:44:40.184 INFO:teuthology.orchestra.run.smithi074.stdout: ceph-grafana-dashboards noarch 2:15.0.0-7725.g0073295.el7 ceph-noarch 18 k 2019-11-28T21:44:40.184 INFO:teuthology.orchestra.run.smithi074.stdout: python-repoze-lru noarch 0.4-3.el7 epel 13 k 2019-11-28T21:44:40.184 INFO:teuthology.orchestra.run.smithi074.stdout: python-routes noarch 1.13-2.el7 epel 640 k 2019-11-28T21:44:40.184 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:40.185 INFO:teuthology.orchestra.run.smithi074.stdout:Transaction Summary 2019-11-28T21:44:40.185 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:44:40.185 INFO:teuthology.orchestra.run.smithi074.stdout:Install 1 Package (+3 Dependent packages) 2019-11-28T21:44:40.185 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:40.185 INFO:teuthology.orchestra.run.smithi074.stdout:Total download size: 4.5 M 2019-11-28T21:44:40.185 INFO:teuthology.orchestra.run.smithi074.stdout:Installed size: 20 M 2019-11-28T21:44:40.185 INFO:teuthology.orchestra.run.smithi074.stdout:Downloading packages: 2019-11-28T21:44:40.349 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python-repoze-lru-0.4-3.el7.noarch 1/4 2019-11-28T21:44:40.474 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : 2:ceph-grafana-dashboards-15.0.0-7725.g0073295.el7.noarch 2/4 2019-11-28T21:44:40.575 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : 2:ceph-mgr-dashboard-15.0.0-7725.g0073295.el7.noarch 3/4 2019-11-28T21:44:41.060 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python-routes-1.13-2.el7.noarch 4/4 2019-11-28T21:44:41.060 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:41.061 INFO:teuthology.orchestra.run.smithi141.stdout:Installed: 2019-11-28T21:44:41.061 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-dashboard.noarch 2:15.0.0-7725.g0073295.el7 2019-11-28T21:44:41.061 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:41.061 INFO:teuthology.orchestra.run.smithi141.stdout:Dependency Installed: 2019-11-28T21:44:41.061 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-grafana-dashboards.noarch 2:15.0.0-7725.g0073295.el7 2019-11-28T21:44:41.061 INFO:teuthology.orchestra.run.smithi141.stdout: python-repoze-lru.noarch 0:0.4-3.el7 2019-11-28T21:44:41.061 INFO:teuthology.orchestra.run.smithi141.stdout: python-routes.noarch 0:1.13-2.el7 2019-11-28T21:44:41.062 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:41.062 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2019-11-28T21:44:41.176 INFO:teuthology.orchestra.run.smithi141:> sudo yum -y install ceph-mgr-diskprediction-cloud 2019-11-28T21:44:41.367 INFO:teuthology.orchestra.run.smithi074.stdout:-------------------------------------------------------------------------------- 2019-11-28T21:44:41.368 INFO:teuthology.orchestra.run.smithi074.stdout:Total 3.8 MB/s | 4.5 MB 00:01 2019-11-28T21:44:41.372 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction check 2019-11-28T21:44:41.381 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction test 2019-11-28T21:44:41.430 INFO:teuthology.orchestra.run.smithi141.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:44:41.473 INFO:teuthology.orchestra.run.smithi141.stdout:Loading mirror speeds from cached hostfile 2019-11-28T21:44:41.474 INFO:teuthology.orchestra.run.smithi141.stdout: * base: mirror.cogentco.com 2019-11-28T21:44:41.474 INFO:teuthology.orchestra.run.smithi141.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T21:44:41.475 INFO:teuthology.orchestra.run.smithi141.stdout: * extras: mirror.linux.duke.edu 2019-11-28T21:44:41.475 INFO:teuthology.orchestra.run.smithi141.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-11-28T21:44:41.589 INFO:teuthology.orchestra.run.smithi074.stdout:Transaction test succeeded 2019-11-28T21:44:41.589 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction 2019-11-28T21:44:42.116 INFO:teuthology.orchestra.run.smithi141.stdout:7 packages excluded due to repository priority protections 2019-11-28T21:44:42.254 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : 2:ceph-grafana-dashboards-15.0.0-7725.g0073295.el7.noarch 1/4 2019-11-28T21:44:42.450 INFO:teuthology.orchestra.run.smithi141.stdout:Resolving Dependencies 2019-11-28T21:44:42.450 INFO:teuthology.orchestra.run.smithi141.stdout:--> Running transaction check 2019-11-28T21:44:42.450 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:44:42.673 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : python-repoze-lru-0.4-3.el7.noarch 2/4 2019-11-28T21:44:42.813 INFO:teuthology.orchestra.run.smithi141.stdout:--> Finished Dependency Resolution 2019-11-28T21:44:43.040 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:43.040 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies Resolved 2019-11-28T21:44:43.041 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:43.041 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:44:43.041 INFO:teuthology.orchestra.run.smithi141.stdout: Package Arch Version Repository Size 2019-11-28T21:44:43.042 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:44:43.042 INFO:teuthology.orchestra.run.smithi141.stdout:Installing: 2019-11-28T21:44:43.042 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-diskprediction-cloud 2019-11-28T21:44:43.042 INFO:teuthology.orchestra.run.smithi141.stdout: noarch 2:15.0.0-7725.g0073295.el7 ceph-noarch 82 k 2019-11-28T21:44:43.042 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:43.042 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction Summary 2019-11-28T21:44:43.043 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:44:43.043 INFO:teuthology.orchestra.run.smithi141.stdout:Install 1 Package 2019-11-28T21:44:43.043 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:43.043 INFO:teuthology.orchestra.run.smithi141.stdout:Total download size: 82 k 2019-11-28T21:44:43.043 INFO:teuthology.orchestra.run.smithi141.stdout:Installed size: 411 k 2019-11-28T21:44:43.043 INFO:teuthology.orchestra.run.smithi141.stdout:Downloading packages: 2019-11-28T21:44:43.380 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction check 2019-11-28T21:44:43.382 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction test 2019-11-28T21:44:43.417 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction test succeeded 2019-11-28T21:44:43.418 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction 2019-11-28T21:44:43.787 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : python-routes-1.13-2.el7.noarch 3/4 2019-11-28T21:44:44.032 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : 2:ceph-mgr-diskprediction-cloud-15.0.0-7725.g0073295.el7.n 1/1 2019-11-28T21:44:44.523 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : 2:ceph-mgr-diskprediction-cloud-15.0.0-7725.g0073295.el7.n 1/1 2019-11-28T21:44:44.523 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:44.524 INFO:teuthology.orchestra.run.smithi141.stdout:Installed: 2019-11-28T21:44:44.524 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7725.g0073295.el7 2019-11-28T21:44:44.524 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:44.524 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2019-11-28T21:44:44.652 INFO:teuthology.orchestra.run.smithi141:> sudo yum -y install ceph-mgr-diskprediction-local 2019-11-28T21:44:44.877 INFO:teuthology.orchestra.run.smithi141.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:44:44.893 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : 2:ceph-mgr-dashboard-15.0.0-7725.g0073295.el7.noarch 4/4 2019-11-28T21:44:44.917 INFO:teuthology.orchestra.run.smithi141.stdout:Loading mirror speeds from cached hostfile 2019-11-28T21:44:44.917 INFO:teuthology.orchestra.run.smithi141.stdout: * base: mirror.cogentco.com 2019-11-28T21:44:44.918 INFO:teuthology.orchestra.run.smithi141.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T21:44:44.918 INFO:teuthology.orchestra.run.smithi141.stdout: * extras: mirror.linux.duke.edu 2019-11-28T21:44:44.919 INFO:teuthology.orchestra.run.smithi141.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-11-28T21:44:44.995 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : python-repoze-lru-0.4-3.el7.noarch 1/4 2019-11-28T21:44:45.121 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : 2:ceph-grafana-dashboards-15.0.0-7725.g0073295.el7.noarch 2/4 2019-11-28T21:44:45.213 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : 2:ceph-mgr-dashboard-15.0.0-7725.g0073295.el7.noarch 3/4 2019-11-28T21:44:45.565 INFO:teuthology.orchestra.run.smithi141.stdout:7 packages excluded due to repository priority protections 2019-11-28T21:44:45.698 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : python-routes-1.13-2.el7.noarch 4/4 2019-11-28T21:44:45.698 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:45.698 INFO:teuthology.orchestra.run.smithi074.stdout:Installed: 2019-11-28T21:44:45.698 INFO:teuthology.orchestra.run.smithi074.stdout: ceph-mgr-dashboard.noarch 2:15.0.0-7725.g0073295.el7 2019-11-28T21:44:45.699 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:45.699 INFO:teuthology.orchestra.run.smithi074.stdout:Dependency Installed: 2019-11-28T21:44:45.699 INFO:teuthology.orchestra.run.smithi074.stdout: ceph-grafana-dashboards.noarch 2:15.0.0-7725.g0073295.el7 2019-11-28T21:44:45.699 INFO:teuthology.orchestra.run.smithi074.stdout: python-repoze-lru.noarch 0:0.4-3.el7 2019-11-28T21:44:45.699 INFO:teuthology.orchestra.run.smithi074.stdout: python-routes.noarch 0:1.13-2.el7 2019-11-28T21:44:45.699 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:45.699 INFO:teuthology.orchestra.run.smithi074.stdout:Complete! 2019-11-28T21:44:45.814 INFO:teuthology.orchestra.run.smithi074:> sudo yum -y install ceph-mgr-diskprediction-cloud 2019-11-28T21:44:45.892 INFO:teuthology.orchestra.run.smithi141.stdout:Resolving Dependencies 2019-11-28T21:44:45.893 INFO:teuthology.orchestra.run.smithi141.stdout:--> Running transaction check 2019-11-28T21:44:45.893 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package ceph-mgr-diskprediction-local.noarch 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:44:45.895 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: scipy for package: 2:ceph-mgr-diskprediction-local-15.0.0-7725.g0073295.el7.noarch 2019-11-28T21:44:45.925 INFO:teuthology.orchestra.run.smithi141.stdout:--> Running transaction check 2019-11-28T21:44:45.925 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package scipy.x86_64 0:0.12.1-6.el7 will be installed 2019-11-28T21:44:45.932 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: f2py for package: scipy-0.12.1-6.el7.x86_64 2019-11-28T21:44:45.933 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: libumfpack.so.5()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-11-28T21:44:45.935 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: libamd.so.2()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-11-28T21:44:45.935 INFO:teuthology.orchestra.run.smithi141.stdout:--> Running transaction check 2019-11-28T21:44:45.935 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package numpy-f2py.x86_64 1:1.7.1-13.el7 will be installed 2019-11-28T21:44:45.936 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package suitesparse.x86_64 0:4.0.2-10.el7 will be installed 2019-11-28T21:44:45.937 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: libtbbmalloc.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-11-28T21:44:45.938 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: libtbb.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-11-28T21:44:45.939 INFO:teuthology.orchestra.run.smithi141.stdout:--> Running transaction check 2019-11-28T21:44:45.939 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package tbb.x86_64 0:4.1-9.20130314.el7 will be installed 2019-11-28T21:44:46.084 INFO:teuthology.orchestra.run.smithi074.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:44:46.126 INFO:teuthology.orchestra.run.smithi074.stdout:Loading mirror speeds from cached hostfile 2019-11-28T21:44:46.128 INFO:teuthology.orchestra.run.smithi074.stdout: * base: mirror.cogentco.com 2019-11-28T21:44:46.128 INFO:teuthology.orchestra.run.smithi074.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T21:44:46.128 INFO:teuthology.orchestra.run.smithi074.stdout: * extras: mirror.linux.duke.edu 2019-11-28T21:44:46.129 INFO:teuthology.orchestra.run.smithi074.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-11-28T21:44:46.301 INFO:teuthology.orchestra.run.smithi141.stdout:--> Finished Dependency Resolution 2019-11-28T21:44:46.526 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:46.527 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies Resolved 2019-11-28T21:44:46.528 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:46.528 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:44:46.528 INFO:teuthology.orchestra.run.smithi141.stdout: Package Arch Version Repository Size 2019-11-28T21:44:46.528 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:44:46.529 INFO:teuthology.orchestra.run.smithi141.stdout:Installing: 2019-11-28T21:44:46.529 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-diskprediction-local 2019-11-28T21:44:46.529 INFO:teuthology.orchestra.run.smithi141.stdout: noarch 2:15.0.0-7725.g0073295.el7 ceph-noarch 8.6 M 2019-11-28T21:44:46.529 INFO:teuthology.orchestra.run.smithi141.stdout:Installing for dependencies: 2019-11-28T21:44:46.529 INFO:teuthology.orchestra.run.smithi141.stdout: numpy-f2py x86_64 1:1.7.1-13.el7 base 206 k 2019-11-28T21:44:46.529 INFO:teuthology.orchestra.run.smithi141.stdout: scipy x86_64 0.12.1-6.el7 base 9.3 M 2019-11-28T21:44:46.529 INFO:teuthology.orchestra.run.smithi141.stdout: suitesparse x86_64 4.0.2-10.el7 base 928 k 2019-11-28T21:44:46.530 INFO:teuthology.orchestra.run.smithi141.stdout: tbb x86_64 4.1-9.20130314.el7 base 124 k 2019-11-28T21:44:46.530 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:46.530 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction Summary 2019-11-28T21:44:46.530 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:44:46.530 INFO:teuthology.orchestra.run.smithi141.stdout:Install 1 Package (+4 Dependent packages) 2019-11-28T21:44:46.530 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:46.530 INFO:teuthology.orchestra.run.smithi141.stdout:Total download size: 19 M 2019-11-28T21:44:46.531 INFO:teuthology.orchestra.run.smithi141.stdout:Installed size: 104 M 2019-11-28T21:44:46.531 INFO:teuthology.orchestra.run.smithi141.stdout:Downloading packages: 2019-11-28T21:44:46.765 INFO:teuthology.orchestra.run.smithi074.stdout:7 packages excluded due to repository priority protections 2019-11-28T21:44:47.099 INFO:teuthology.orchestra.run.smithi074.stdout:Resolving Dependencies 2019-11-28T21:44:47.099 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:44:47.099 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:44:47.462 INFO:teuthology.orchestra.run.smithi074.stdout:--> Finished Dependency Resolution 2019-11-28T21:44:47.518 INFO:teuthology.orchestra.run.smithi141.stdout:-------------------------------------------------------------------------------- 2019-11-28T21:44:47.518 INFO:teuthology.orchestra.run.smithi141.stdout:Total 19 MB/s | 19 MB 00:00 2019-11-28T21:44:47.531 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction check 2019-11-28T21:44:47.563 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction test 2019-11-28T21:44:47.686 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:47.686 INFO:teuthology.orchestra.run.smithi074.stdout:Dependencies Resolved 2019-11-28T21:44:47.687 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:47.687 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:44:47.687 INFO:teuthology.orchestra.run.smithi074.stdout: Package Arch Version Repository Size 2019-11-28T21:44:47.687 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:44:47.687 INFO:teuthology.orchestra.run.smithi074.stdout:Installing: 2019-11-28T21:44:47.687 INFO:teuthology.orchestra.run.smithi074.stdout: ceph-mgr-diskprediction-cloud 2019-11-28T21:44:47.687 INFO:teuthology.orchestra.run.smithi074.stdout: noarch 2:15.0.0-7725.g0073295.el7 ceph-noarch 82 k 2019-11-28T21:44:47.688 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:47.688 INFO:teuthology.orchestra.run.smithi074.stdout:Transaction Summary 2019-11-28T21:44:47.688 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:44:47.688 INFO:teuthology.orchestra.run.smithi074.stdout:Install 1 Package 2019-11-28T21:44:47.688 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:47.688 INFO:teuthology.orchestra.run.smithi074.stdout:Total download size: 82 k 2019-11-28T21:44:47.688 INFO:teuthology.orchestra.run.smithi074.stdout:Installed size: 411 k 2019-11-28T21:44:47.689 INFO:teuthology.orchestra.run.smithi074.stdout:Downloading packages: 2019-11-28T21:44:47.713 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction test succeeded 2019-11-28T21:44:47.714 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction 2019-11-28T21:44:48.017 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction check 2019-11-28T21:44:48.021 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction test 2019-11-28T21:44:48.077 INFO:teuthology.orchestra.run.smithi074.stdout:Transaction test succeeded 2019-11-28T21:44:48.077 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction 2019-11-28T21:44:48.508 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : 1:numpy-f2py-1.7.1-13.el7.x86_64 1/5 2019-11-28T21:44:48.753 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : 2:ceph-mgr-diskprediction-cloud-15.0.0-7725.g0073295.el7.n 1/1 2019-11-28T21:44:48.971 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : tbb-4.1-9.20130314.el7.x86_64 2/5 2019-11-28T21:44:49.235 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : 2:ceph-mgr-diskprediction-cloud-15.0.0-7725.g0073295.el7.n 1/1 2019-11-28T21:44:49.235 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:49.236 INFO:teuthology.orchestra.run.smithi074.stdout:Installed: 2019-11-28T21:44:49.236 INFO:teuthology.orchestra.run.smithi074.stdout: ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7725.g0073295.el7 2019-11-28T21:44:49.236 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:49.236 INFO:teuthology.orchestra.run.smithi074.stdout:Complete! 2019-11-28T21:44:49.357 INFO:teuthology.orchestra.run.smithi074:> sudo yum -y install ceph-mgr-diskprediction-local 2019-11-28T21:44:49.583 INFO:teuthology.orchestra.run.smithi074.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:44:49.626 INFO:teuthology.orchestra.run.smithi074.stdout:Loading mirror speeds from cached hostfile 2019-11-28T21:44:49.627 INFO:teuthology.orchestra.run.smithi074.stdout: * base: mirror.cogentco.com 2019-11-28T21:44:49.627 INFO:teuthology.orchestra.run.smithi074.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T21:44:49.627 INFO:teuthology.orchestra.run.smithi074.stdout: * extras: mirror.linux.duke.edu 2019-11-28T21:44:49.628 INFO:teuthology.orchestra.run.smithi074.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-11-28T21:44:50.266 INFO:teuthology.orchestra.run.smithi074.stdout:7 packages excluded due to repository priority protections 2019-11-28T21:44:50.597 INFO:teuthology.orchestra.run.smithi074.stdout:Resolving Dependencies 2019-11-28T21:44:50.597 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:44:50.597 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package ceph-mgr-diskprediction-local.noarch 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:44:50.600 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: scipy for package: 2:ceph-mgr-diskprediction-local-15.0.0-7725.g0073295.el7.noarch 2019-11-28T21:44:50.629 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:44:50.629 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package scipy.x86_64 0:0.12.1-6.el7 will be installed 2019-11-28T21:44:50.636 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: f2py for package: scipy-0.12.1-6.el7.x86_64 2019-11-28T21:44:50.637 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: libumfpack.so.5()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-11-28T21:44:50.639 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: libamd.so.2()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-11-28T21:44:50.639 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:44:50.639 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package numpy-f2py.x86_64 1:1.7.1-13.el7 will be installed 2019-11-28T21:44:50.640 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package suitesparse.x86_64 0:4.0.2-10.el7 will be installed 2019-11-28T21:44:50.641 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: libtbbmalloc.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-11-28T21:44:50.643 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: libtbb.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-11-28T21:44:50.643 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:44:50.643 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package tbb.x86_64 0:4.1-9.20130314.el7 will be installed 2019-11-28T21:44:50.794 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : suitesparse-4.0.2-10.el7.x86_64 3/5 2019-11-28T21:44:51.004 INFO:teuthology.orchestra.run.smithi074.stdout:--> Finished Dependency Resolution 2019-11-28T21:44:51.225 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:51.226 INFO:teuthology.orchestra.run.smithi074.stdout:Dependencies Resolved 2019-11-28T21:44:51.227 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:51.227 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:44:51.227 INFO:teuthology.orchestra.run.smithi074.stdout: Package Arch Version Repository Size 2019-11-28T21:44:51.227 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:44:51.227 INFO:teuthology.orchestra.run.smithi074.stdout:Installing: 2019-11-28T21:44:51.227 INFO:teuthology.orchestra.run.smithi074.stdout: ceph-mgr-diskprediction-local 2019-11-28T21:44:51.228 INFO:teuthology.orchestra.run.smithi074.stdout: noarch 2:15.0.0-7725.g0073295.el7 ceph-noarch 8.6 M 2019-11-28T21:44:51.228 INFO:teuthology.orchestra.run.smithi074.stdout:Installing for dependencies: 2019-11-28T21:44:51.228 INFO:teuthology.orchestra.run.smithi074.stdout: numpy-f2py x86_64 1:1.7.1-13.el7 base 206 k 2019-11-28T21:44:51.228 INFO:teuthology.orchestra.run.smithi074.stdout: scipy x86_64 0.12.1-6.el7 base 9.3 M 2019-11-28T21:44:51.228 INFO:teuthology.orchestra.run.smithi074.stdout: suitesparse x86_64 4.0.2-10.el7 base 928 k 2019-11-28T21:44:51.228 INFO:teuthology.orchestra.run.smithi074.stdout: tbb x86_64 4.1-9.20130314.el7 base 124 k 2019-11-28T21:44:51.228 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:51.228 INFO:teuthology.orchestra.run.smithi074.stdout:Transaction Summary 2019-11-28T21:44:51.229 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:44:51.229 INFO:teuthology.orchestra.run.smithi074.stdout:Install 1 Package (+4 Dependent packages) 2019-11-28T21:44:51.229 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:51.229 INFO:teuthology.orchestra.run.smithi074.stdout:Total download size: 19 M 2019-11-28T21:44:51.229 INFO:teuthology.orchestra.run.smithi074.stdout:Installed size: 104 M 2019-11-28T21:44:51.229 INFO:teuthology.orchestra.run.smithi074.stdout:Downloading packages: 2019-11-28T21:44:52.228 INFO:teuthology.orchestra.run.smithi074.stdout:-------------------------------------------------------------------------------- 2019-11-28T21:44:52.228 INFO:teuthology.orchestra.run.smithi074.stdout:Total 19 MB/s | 19 MB 00:01 2019-11-28T21:44:52.237 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction check 2019-11-28T21:44:52.260 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction test 2019-11-28T21:44:52.398 INFO:teuthology.orchestra.run.smithi074.stdout:Transaction test succeeded 2019-11-28T21:44:52.399 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction 2019-11-28T21:44:52.476 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : scipy-0.12.1-6.el7.x86_64 4/5 2019-11-28T21:44:52.806 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : 2:ceph-mgr-diskprediction-local-15.0.0-7725.g0073295.el7.n 5/5 2019-11-28T21:44:52.911 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : suitesparse-4.0.2-10.el7.x86_64 1/5 2019-11-28T21:44:53.036 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : tbb-4.1-9.20130314.el7.x86_64 2/5 2019-11-28T21:44:53.153 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : scipy-0.12.1-6.el7.x86_64 3/5 2019-11-28T21:44:53.155 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : 1:numpy-f2py-1.7.1-13.el7.x86_64 1/5 2019-11-28T21:44:53.279 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : 1:numpy-f2py-1.7.1-13.el7.x86_64 4/5 2019-11-28T21:44:53.628 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : tbb-4.1-9.20130314.el7.x86_64 2/5 2019-11-28T21:44:53.772 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : 2:ceph-mgr-diskprediction-local-15.0.0-7725.g0073295.el7.n 5/5 2019-11-28T21:44:53.772 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:53.773 INFO:teuthology.orchestra.run.smithi141.stdout:Installed: 2019-11-28T21:44:53.773 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-diskprediction-local.noarch 2:15.0.0-7725.g0073295.el7 2019-11-28T21:44:53.773 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:53.773 INFO:teuthology.orchestra.run.smithi141.stdout:Dependency Installed: 2019-11-28T21:44:53.773 INFO:teuthology.orchestra.run.smithi141.stdout: numpy-f2py.x86_64 1:1.7.1-13.el7 scipy.x86_64 0:0.12.1-6.el7 2019-11-28T21:44:53.773 INFO:teuthology.orchestra.run.smithi141.stdout: suitesparse.x86_64 0:4.0.2-10.el7 tbb.x86_64 0:4.1-9.20130314.el7 2019-11-28T21:44:53.774 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:53.774 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2019-11-28T21:44:53.893 INFO:teuthology.orchestra.run.smithi141:> sudo yum -y install ceph-mgr-rook 2019-11-28T21:44:54.116 INFO:teuthology.orchestra.run.smithi141.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:44:54.155 INFO:teuthology.orchestra.run.smithi141.stdout:Loading mirror speeds from cached hostfile 2019-11-28T21:44:54.156 INFO:teuthology.orchestra.run.smithi141.stdout: * base: mirror.cogentco.com 2019-11-28T21:44:54.157 INFO:teuthology.orchestra.run.smithi141.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T21:44:54.157 INFO:teuthology.orchestra.run.smithi141.stdout: * extras: mirror.linux.duke.edu 2019-11-28T21:44:54.157 INFO:teuthology.orchestra.run.smithi141.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-11-28T21:44:54.808 INFO:teuthology.orchestra.run.smithi141.stdout:7 packages excluded due to repository priority protections 2019-11-28T21:44:55.137 INFO:teuthology.orchestra.run.smithi141.stdout:Resolving Dependencies 2019-11-28T21:44:55.138 INFO:teuthology.orchestra.run.smithi141.stdout:--> Running transaction check 2019-11-28T21:44:55.138 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package ceph-mgr-rook.noarch 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:44:55.139 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python-kubernetes for package: 2:ceph-mgr-rook-15.0.0-7725.g0073295.el7.noarch 2019-11-28T21:44:55.169 INFO:teuthology.orchestra.run.smithi141.stdout:--> Running transaction check 2019-11-28T21:44:55.169 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python2-kubernetes.noarch 0:10.0.1-1.el7 will be installed 2019-11-28T21:44:55.171 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python-certifi for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-28T21:44:55.172 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python-google-auth for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-28T21:44:55.173 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python-requests-oauthlib for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-28T21:44:55.174 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python-websocket-client for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-28T21:44:55.175 INFO:teuthology.orchestra.run.smithi141.stdout:--> Running transaction check 2019-11-28T21:44:55.176 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 will be installed 2019-11-28T21:44:55.176 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python2-certifi.noarch 0:2018.10.15-5.el7 will be installed 2019-11-28T21:44:55.176 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python2-google-auth.noarch 1:1.1.1-5.el7 will be installed 2019-11-28T21:44:55.177 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python-cachetools for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-28T21:44:55.177 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python2-pyasn1-modules for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-28T21:44:55.178 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python2-rsa for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-28T21:44:55.180 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python2-requests-oauthlib.noarch 0:0.8.0-5.el7 will be installed 2019-11-28T21:44:55.180 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python2-oauthlib for package: python2-requests-oauthlib-0.8.0-5.el7.noarch 2019-11-28T21:44:55.181 INFO:teuthology.orchestra.run.smithi141.stdout:--> Running transaction check 2019-11-28T21:44:55.181 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python-cachetools.noarch 0:1.0.3-1.el7 will be installed 2019-11-28T21:44:55.181 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python2-oauthlib.noarch 0:2.0.1-8.el7 will be installed 2019-11-28T21:44:55.182 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python-jwcrypto for package: python2-oauthlib-2.0.1-8.el7.noarch 2019-11-28T21:44:55.182 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python2-pyasn1-modules.noarch 0:0.1.9-7.el7 will be installed 2019-11-28T21:44:55.182 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python2-rsa.noarch 0:3.4.1-1.el7 will be installed 2019-11-28T21:44:55.183 INFO:teuthology.orchestra.run.smithi141.stdout:--> Running transaction check 2019-11-28T21:44:55.183 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python-jwcrypto.noarch 0:0.4.2-1.el7 will be installed 2019-11-28T21:44:55.549 INFO:teuthology.orchestra.run.smithi141.stdout:--> Finished Dependency Resolution 2019-11-28T21:44:55.735 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : suitesparse-4.0.2-10.el7.x86_64 3/5 2019-11-28T21:44:55.775 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:55.776 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies Resolved 2019-11-28T21:44:55.781 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:55.781 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:44:55.781 INFO:teuthology.orchestra.run.smithi141.stdout: Package Arch Version Repository Size 2019-11-28T21:44:55.781 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:44:55.781 INFO:teuthology.orchestra.run.smithi141.stdout:Installing: 2019-11-28T21:44:55.781 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-rook noarch 2:15.0.0-7725.g0073295.el7 ceph-noarch 24 k 2019-11-28T21:44:55.782 INFO:teuthology.orchestra.run.smithi141.stdout:Installing for dependencies: 2019-11-28T21:44:55.782 INFO:teuthology.orchestra.run.smithi141.stdout: python-cachetools noarch 1.0.3-1.el7 epel 22 k 2019-11-28T21:44:55.782 INFO:teuthology.orchestra.run.smithi141.stdout: python-jwcrypto noarch 0.4.2-1.el7 base 57 k 2019-11-28T21:44:55.782 INFO:teuthology.orchestra.run.smithi141.stdout: python-websocket-client noarch 0.56.0-3.git3c25814.el7 extras 66 k 2019-11-28T21:44:55.783 INFO:teuthology.orchestra.run.smithi141.stdout: python2-certifi noarch 2018.10.15-5.el7 epel 12 k 2019-11-28T21:44:55.783 INFO:teuthology.orchestra.run.smithi141.stdout: python2-google-auth noarch 1:1.1.1-5.el7 epel 76 k 2019-11-28T21:44:55.783 INFO:teuthology.orchestra.run.smithi141.stdout: python2-kubernetes noarch 10.0.1-1.el7 epel 1.1 M 2019-11-28T21:44:55.783 INFO:teuthology.orchestra.run.smithi141.stdout: python2-oauthlib noarch 2.0.1-8.el7 base 146 k 2019-11-28T21:44:55.784 INFO:teuthology.orchestra.run.smithi141.stdout: python2-pyasn1-modules noarch 0.1.9-7.el7 base 59 k 2019-11-28T21:44:55.784 INFO:teuthology.orchestra.run.smithi141.stdout: python2-requests-oauthlib noarch 0.8.0-5.el7 base 35 k 2019-11-28T21:44:55.784 INFO:teuthology.orchestra.run.smithi141.stdout: python2-rsa noarch 3.4.1-1.el7 epel 67 k 2019-11-28T21:44:55.784 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:55.784 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction Summary 2019-11-28T21:44:55.784 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:44:55.785 INFO:teuthology.orchestra.run.smithi141.stdout:Install 1 Package (+10 Dependent packages) 2019-11-28T21:44:55.785 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:44:55.785 INFO:teuthology.orchestra.run.smithi141.stdout:Total download size: 1.6 M 2019-11-28T21:44:55.785 INFO:teuthology.orchestra.run.smithi141.stdout:Installed size: 24 M 2019-11-28T21:44:55.785 INFO:teuthology.orchestra.run.smithi141.stdout:Downloading packages: 2019-11-28T21:44:57.437 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : scipy-0.12.1-6.el7.x86_64 4/5 2019-11-28T21:44:57.486 INFO:teuthology.orchestra.run.smithi141.stdout:-------------------------------------------------------------------------------- 2019-11-28T21:44:57.486 INFO:teuthology.orchestra.run.smithi141.stdout:Total 987 kB/s | 1.6 MB 00:01 2019-11-28T21:44:57.502 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction check 2019-11-28T21:44:57.517 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction test 2019-11-28T21:44:57.621 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction test succeeded 2019-11-28T21:44:57.621 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction 2019-11-28T21:44:57.796 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : 2:ceph-mgr-diskprediction-local-15.0.0-7725.g0073295.el7.n 5/5 2019-11-28T21:44:57.883 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : suitesparse-4.0.2-10.el7.x86_64 1/5 2019-11-28T21:44:57.975 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : tbb-4.1-9.20130314.el7.x86_64 2/5 2019-11-28T21:44:58.068 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : scipy-0.12.1-6.el7.x86_64 3/5 2019-11-28T21:44:58.160 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : 1:numpy-f2py-1.7.1-13.el7.x86_64 4/5 2019-11-28T21:44:58.296 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 1/11 2019-11-28T21:44:58.612 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : 2:ceph-mgr-diskprediction-local-15.0.0-7725.g0073295.el7.n 5/5 2019-11-28T21:44:58.612 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:58.612 INFO:teuthology.orchestra.run.smithi074.stdout:Installed: 2019-11-28T21:44:58.612 INFO:teuthology.orchestra.run.smithi074.stdout: ceph-mgr-diskprediction-local.noarch 2:15.0.0-7725.g0073295.el7 2019-11-28T21:44:58.613 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:58.613 INFO:teuthology.orchestra.run.smithi074.stdout:Dependency Installed: 2019-11-28T21:44:58.613 INFO:teuthology.orchestra.run.smithi074.stdout: numpy-f2py.x86_64 1:1.7.1-13.el7 scipy.x86_64 0:0.12.1-6.el7 2019-11-28T21:44:58.613 INFO:teuthology.orchestra.run.smithi074.stdout: suitesparse.x86_64 0:4.0.2-10.el7 tbb.x86_64 0:4.1-9.20130314.el7 2019-11-28T21:44:58.613 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:44:58.613 INFO:teuthology.orchestra.run.smithi074.stdout:Complete! 2019-11-28T21:44:58.665 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python-jwcrypto-0.4.2-1.el7.noarch 2/11 2019-11-28T21:44:58.741 INFO:teuthology.orchestra.run.smithi074:> sudo yum -y install ceph-mgr-rook 2019-11-28T21:44:58.988 INFO:teuthology.orchestra.run.smithi074.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:44:59.007 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python2-oauthlib-2.0.1-8.el7.noarch 3/11 2019-11-28T21:44:59.030 INFO:teuthology.orchestra.run.smithi074.stdout:Loading mirror speeds from cached hostfile 2019-11-28T21:44:59.031 INFO:teuthology.orchestra.run.smithi074.stdout: * base: mirror.cogentco.com 2019-11-28T21:44:59.032 INFO:teuthology.orchestra.run.smithi074.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T21:44:59.032 INFO:teuthology.orchestra.run.smithi074.stdout: * extras: mirror.linux.duke.edu 2019-11-28T21:44:59.033 INFO:teuthology.orchestra.run.smithi074.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-11-28T21:44:59.303 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python2-requests-oauthlib-0.8.0-5.el7.noarch 4/11 2019-11-28T21:44:59.644 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python2-certifi-2018.10.15-5.el7.noarch 5/11 2019-11-28T21:44:59.676 INFO:teuthology.orchestra.run.smithi074.stdout:7 packages excluded due to repository priority protections 2019-11-28T21:45:00.009 INFO:teuthology.orchestra.run.smithi074.stdout:Resolving Dependencies 2019-11-28T21:45:00.010 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:45:00.010 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package ceph-mgr-rook.noarch 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:45:00.011 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python-kubernetes for package: 2:ceph-mgr-rook-15.0.0-7725.g0073295.el7.noarch 2019-11-28T21:45:00.041 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:45:00.041 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python2-kubernetes.noarch 0:10.0.1-1.el7 will be installed 2019-11-28T21:45:00.043 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python-certifi for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-28T21:45:00.044 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python-google-auth for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-28T21:45:00.045 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python-requests-oauthlib for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-28T21:45:00.046 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python-websocket-client for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-28T21:45:00.047 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:45:00.047 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 will be installed 2019-11-28T21:45:00.048 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python2-certifi.noarch 0:2018.10.15-5.el7 will be installed 2019-11-28T21:45:00.048 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python2-google-auth.noarch 1:1.1.1-5.el7 will be installed 2019-11-28T21:45:00.048 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python-cachetools for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-28T21:45:00.049 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python2-pyasn1-modules for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-28T21:45:00.050 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python2-rsa for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-28T21:45:00.051 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python2-requests-oauthlib.noarch 0:0.8.0-5.el7 will be installed 2019-11-28T21:45:00.051 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python2-oauthlib for package: python2-requests-oauthlib-0.8.0-5.el7.noarch 2019-11-28T21:45:00.052 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:45:00.052 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python-cachetools.noarch 0:1.0.3-1.el7 will be installed 2019-11-28T21:45:00.052 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python2-oauthlib.noarch 0:2.0.1-8.el7 will be installed 2019-11-28T21:45:00.053 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python-jwcrypto for package: python2-oauthlib-2.0.1-8.el7.noarch 2019-11-28T21:45:00.054 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python2-pyasn1-modules.noarch 0:0.1.9-7.el7 will be installed 2019-11-28T21:45:00.054 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python2-rsa.noarch 0:3.4.1-1.el7 will be installed 2019-11-28T21:45:00.054 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:45:00.054 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python-jwcrypto.noarch 0:0.4.2-1.el7 will be installed 2019-11-28T21:45:00.090 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python-cachetools-1.0.3-1.el7.noarch 6/11 2019-11-28T21:45:00.417 INFO:teuthology.orchestra.run.smithi074.stdout:--> Finished Dependency Resolution 2019-11-28T21:45:00.459 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python2-rsa-3.4.1-1.el7.noarch 7/11 2019-11-28T21:45:00.640 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:45:00.640 INFO:teuthology.orchestra.run.smithi074.stdout:Dependencies Resolved 2019-11-28T21:45:00.642 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:45:00.642 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:45:00.642 INFO:teuthology.orchestra.run.smithi074.stdout: Package Arch Version Repository Size 2019-11-28T21:45:00.642 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:45:00.642 INFO:teuthology.orchestra.run.smithi074.stdout:Installing: 2019-11-28T21:45:00.642 INFO:teuthology.orchestra.run.smithi074.stdout: ceph-mgr-rook noarch 2:15.0.0-7725.g0073295.el7 ceph-noarch 24 k 2019-11-28T21:45:00.643 INFO:teuthology.orchestra.run.smithi074.stdout:Installing for dependencies: 2019-11-28T21:45:00.643 INFO:teuthology.orchestra.run.smithi074.stdout: python-cachetools noarch 1.0.3-1.el7 epel 22 k 2019-11-28T21:45:00.643 INFO:teuthology.orchestra.run.smithi074.stdout: python-jwcrypto noarch 0.4.2-1.el7 base 57 k 2019-11-28T21:45:00.643 INFO:teuthology.orchestra.run.smithi074.stdout: python-websocket-client noarch 0.56.0-3.git3c25814.el7 extras 66 k 2019-11-28T21:45:00.643 INFO:teuthology.orchestra.run.smithi074.stdout: python2-certifi noarch 2018.10.15-5.el7 epel 12 k 2019-11-28T21:45:00.643 INFO:teuthology.orchestra.run.smithi074.stdout: python2-google-auth noarch 1:1.1.1-5.el7 epel 76 k 2019-11-28T21:45:00.643 INFO:teuthology.orchestra.run.smithi074.stdout: python2-kubernetes noarch 10.0.1-1.el7 epel 1.1 M 2019-11-28T21:45:00.643 INFO:teuthology.orchestra.run.smithi074.stdout: python2-oauthlib noarch 2.0.1-8.el7 base 146 k 2019-11-28T21:45:00.644 INFO:teuthology.orchestra.run.smithi074.stdout: python2-pyasn1-modules noarch 0.1.9-7.el7 base 59 k 2019-11-28T21:45:00.644 INFO:teuthology.orchestra.run.smithi074.stdout: python2-requests-oauthlib noarch 0.8.0-5.el7 base 35 k 2019-11-28T21:45:00.644 INFO:teuthology.orchestra.run.smithi074.stdout: python2-rsa noarch 3.4.1-1.el7 epel 67 k 2019-11-28T21:45:00.644 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:45:00.644 INFO:teuthology.orchestra.run.smithi074.stdout:Transaction Summary 2019-11-28T21:45:00.644 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:45:00.644 INFO:teuthology.orchestra.run.smithi074.stdout:Install 1 Package (+10 Dependent packages) 2019-11-28T21:45:00.645 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:45:00.645 INFO:teuthology.orchestra.run.smithi074.stdout:Total download size: 1.6 M 2019-11-28T21:45:00.645 INFO:teuthology.orchestra.run.smithi074.stdout:Installed size: 24 M 2019-11-28T21:45:00.646 INFO:teuthology.orchestra.run.smithi074.stdout:Downloading packages: 2019-11-28T21:45:00.805 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python2-pyasn1-modules-0.1.9-7.el7.noarch 8/11 2019-11-28T21:45:01.141 INFO:teuthology.orchestra.run.smithi074.stdout:-------------------------------------------------------------------------------- 2019-11-28T21:45:01.141 INFO:teuthology.orchestra.run.smithi074.stdout:Total 3.3 MB/s | 1.6 MB 00:00 2019-11-28T21:45:01.149 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction check 2019-11-28T21:45:01.156 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction test 2019-11-28T21:45:01.237 INFO:teuthology.orchestra.run.smithi074.stdout:Transaction test succeeded 2019-11-28T21:45:01.237 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction 2019-11-28T21:45:01.945 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 1/11 2019-11-28T21:45:02.086 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : 1:python2-google-auth-1.1.1-5.el7.noarch 9/11 2019-11-28T21:45:02.335 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : python-jwcrypto-0.4.2-1.el7.noarch 2/11 2019-11-28T21:45:02.456 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python2-kubernetes-10.0.1-1.el7.noarch 10/11 2019-11-28T21:45:02.662 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : python2-oauthlib-2.0.1-8.el7.noarch 3/11 2019-11-28T21:45:02.692 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : 2:ceph-mgr-rook-15.0.0-7725.g0073295.el7.noarch 11/11 2019-11-28T21:45:02.782 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python2-requests-oauthlib-0.8.0-5.el7.noarch 1/11 2019-11-28T21:45:02.899 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python2-pyasn1-modules-0.1.9-7.el7.noarch 2/11 2019-11-28T21:45:02.960 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : python2-requests-oauthlib-0.8.0-5.el7.noarch 4/11 2019-11-28T21:45:03.008 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : 1:python2-google-auth-1.1.1-5.el7.noarch 3/11 2019-11-28T21:45:03.125 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python2-rsa-3.4.1-1.el7.noarch 4/11 2019-11-28T21:45:03.234 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python2-oauthlib-2.0.1-8.el7.noarch 5/11 2019-11-28T21:45:03.291 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : python2-certifi-2018.10.15-5.el7.noarch 5/11 2019-11-28T21:45:03.326 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python-cachetools-1.0.3-1.el7.noarch 6/11 2019-11-28T21:45:03.460 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : 2:ceph-mgr-rook-15.0.0-7725.g0073295.el7.noarch 7/11 2019-11-28T21:45:03.585 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python2-certifi-2018.10.15-5.el7.noarch 8/11 2019-11-28T21:45:03.652 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : python-cachetools-1.0.3-1.el7.noarch 6/11 2019-11-28T21:45:03.702 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python2-kubernetes-10.0.1-1.el7.noarch 9/11 2019-11-28T21:45:03.828 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python-jwcrypto-0.4.2-1.el7.noarch 10/11 2019-11-28T21:45:04.192 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : python2-rsa-3.4.1-1.el7.noarch 7/11 2019-11-28T21:45:04.297 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 11/11 2019-11-28T21:45:04.297 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:45:04.297 INFO:teuthology.orchestra.run.smithi141.stdout:Installed: 2019-11-28T21:45:04.297 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-rook.noarch 2:15.0.0-7725.g0073295.el7 2019-11-28T21:45:04.298 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:45:04.298 INFO:teuthology.orchestra.run.smithi141.stdout:Dependency Installed: 2019-11-28T21:45:04.298 INFO:teuthology.orchestra.run.smithi141.stdout: python-cachetools.noarch 0:1.0.3-1.el7 2019-11-28T21:45:04.298 INFO:teuthology.orchestra.run.smithi141.stdout: python-jwcrypto.noarch 0:0.4.2-1.el7 2019-11-28T21:45:04.298 INFO:teuthology.orchestra.run.smithi141.stdout: python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 2019-11-28T21:45:04.298 INFO:teuthology.orchestra.run.smithi141.stdout: python2-certifi.noarch 0:2018.10.15-5.el7 2019-11-28T21:45:04.299 INFO:teuthology.orchestra.run.smithi141.stdout: python2-google-auth.noarch 1:1.1.1-5.el7 2019-11-28T21:45:04.299 INFO:teuthology.orchestra.run.smithi141.stdout: python2-kubernetes.noarch 0:10.0.1-1.el7 2019-11-28T21:45:04.299 INFO:teuthology.orchestra.run.smithi141.stdout: python2-oauthlib.noarch 0:2.0.1-8.el7 2019-11-28T21:45:04.299 INFO:teuthology.orchestra.run.smithi141.stdout: python2-pyasn1-modules.noarch 0:0.1.9-7.el7 2019-11-28T21:45:04.299 INFO:teuthology.orchestra.run.smithi141.stdout: python2-requests-oauthlib.noarch 0:0.8.0-5.el7 2019-11-28T21:45:04.299 INFO:teuthology.orchestra.run.smithi141.stdout: python2-rsa.noarch 0:3.4.1-1.el7 2019-11-28T21:45:04.300 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:45:04.300 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2019-11-28T21:45:04.436 INFO:teuthology.orchestra.run.smithi141:> sudo yum -y install ceph-mgr-ssh 2019-11-28T21:45:04.479 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : python2-pyasn1-modules-0.1.9-7.el7.noarch 8/11 2019-11-28T21:45:04.671 INFO:teuthology.orchestra.run.smithi141.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:45:04.711 INFO:teuthology.orchestra.run.smithi141.stdout:Loading mirror speeds from cached hostfile 2019-11-28T21:45:04.712 INFO:teuthology.orchestra.run.smithi141.stdout: * base: mirror.cogentco.com 2019-11-28T21:45:04.713 INFO:teuthology.orchestra.run.smithi141.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T21:45:04.713 INFO:teuthology.orchestra.run.smithi141.stdout: * extras: mirror.linux.duke.edu 2019-11-28T21:45:04.713 INFO:teuthology.orchestra.run.smithi141.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-11-28T21:45:05.367 INFO:teuthology.orchestra.run.smithi141.stdout:7 packages excluded due to repository priority protections 2019-11-28T21:45:05.693 INFO:teuthology.orchestra.run.smithi141.stdout:Resolving Dependencies 2019-11-28T21:45:05.694 INFO:teuthology.orchestra.run.smithi141.stdout:--> Running transaction check 2019-11-28T21:45:05.694 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package ceph-mgr-ssh.noarch 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:45:05.696 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python-remoto for package: 2:ceph-mgr-ssh-15.0.0-7725.g0073295.el7.noarch 2019-11-28T21:45:05.726 INFO:teuthology.orchestra.run.smithi141.stdout:--> Running transaction check 2019-11-28T21:45:05.726 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python-remoto.noarch 0:0.0.25-1.el7 will be installed 2019-11-28T21:45:05.727 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python-execnet >= 1.2.0 for package: python-remoto-0.0.25-1.el7.noarch 2019-11-28T21:45:05.729 INFO:teuthology.orchestra.run.smithi141.stdout:--> Running transaction check 2019-11-28T21:45:05.729 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python-execnet.noarch 0:1.2.0-7.el7 will be installed 2019-11-28T21:45:05.763 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : 1:python2-google-auth-1.1.1-5.el7.noarch 9/11 2019-11-28T21:45:06.093 INFO:teuthology.orchestra.run.smithi141.stdout:--> Finished Dependency Resolution 2019-11-28T21:45:06.122 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : python2-kubernetes-10.0.1-1.el7.noarch 10/11 2019-11-28T21:45:06.320 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:45:06.321 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies Resolved 2019-11-28T21:45:06.321 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:45:06.322 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:45:06.322 INFO:teuthology.orchestra.run.smithi141.stdout: Package Arch Version Repository Size 2019-11-28T21:45:06.322 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:45:06.322 INFO:teuthology.orchestra.run.smithi141.stdout:Installing: 2019-11-28T21:45:06.322 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-ssh noarch 2:15.0.0-7725.g0073295.el7 ceph-noarch 31 k 2019-11-28T21:45:06.322 INFO:teuthology.orchestra.run.smithi141.stdout:Installing for dependencies: 2019-11-28T21:45:06.323 INFO:teuthology.orchestra.run.smithi141.stdout: python-execnet noarch 1.2.0-7.el7 epel 261 k 2019-11-28T21:45:06.323 INFO:teuthology.orchestra.run.smithi141.stdout: python-remoto noarch 0.0.25-1.el7 epel 22 k 2019-11-28T21:45:06.323 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:45:06.323 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction Summary 2019-11-28T21:45:06.323 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:45:06.323 INFO:teuthology.orchestra.run.smithi141.stdout:Install 1 Package (+2 Dependent packages) 2019-11-28T21:45:06.323 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:45:06.324 INFO:teuthology.orchestra.run.smithi141.stdout:Total download size: 313 k 2019-11-28T21:45:06.324 INFO:teuthology.orchestra.run.smithi141.stdout:Installed size: 1.1 M 2019-11-28T21:45:06.324 INFO:teuthology.orchestra.run.smithi141.stdout:Downloading packages: 2019-11-28T21:45:06.409 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : 2:ceph-mgr-rook-15.0.0-7725.g0073295.el7.noarch 11/11 2019-11-28T21:45:06.524 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : python2-requests-oauthlib-0.8.0-5.el7.noarch 1/11 2019-11-28T21:45:06.641 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : python2-pyasn1-modules-0.1.9-7.el7.noarch 2/11 2019-11-28T21:45:06.742 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : 1:python2-google-auth-1.1.1-5.el7.noarch 3/11 2019-11-28T21:45:06.842 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : python2-rsa-3.4.1-1.el7.noarch 4/11 2019-11-28T21:45:06.934 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : python2-oauthlib-2.0.1-8.el7.noarch 5/11 2019-11-28T21:45:07.018 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : python-cachetools-1.0.3-1.el7.noarch 6/11 2019-11-28T21:45:07.052 INFO:teuthology.orchestra.run.smithi141.stdout:-------------------------------------------------------------------------------- 2019-11-28T21:45:07.052 INFO:teuthology.orchestra.run.smithi141.stdout:Total 429 kB/s | 313 kB 00:00 2019-11-28T21:45:07.056 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction check 2019-11-28T21:45:07.065 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction test 2019-11-28T21:45:07.101 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : 2:ceph-mgr-rook-15.0.0-7725.g0073295.el7.noarch 7/11 2019-11-28T21:45:07.144 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction test succeeded 2019-11-28T21:45:07.144 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction 2019-11-28T21:45:07.210 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : python2-certifi-2018.10.15-5.el7.noarch 8/11 2019-11-28T21:45:07.319 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : python2-kubernetes-10.0.1-1.el7.noarch 9/11 2019-11-28T21:45:07.462 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : python-jwcrypto-0.4.2-1.el7.noarch 10/11 2019-11-28T21:45:07.855 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python-execnet-1.2.0-7.el7.noarch 1/3 2019-11-28T21:45:07.922 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 11/11 2019-11-28T21:45:07.922 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:45:07.923 INFO:teuthology.orchestra.run.smithi074.stdout:Installed: 2019-11-28T21:45:07.923 INFO:teuthology.orchestra.run.smithi074.stdout: ceph-mgr-rook.noarch 2:15.0.0-7725.g0073295.el7 2019-11-28T21:45:07.923 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:45:07.923 INFO:teuthology.orchestra.run.smithi074.stdout:Dependency Installed: 2019-11-28T21:45:07.923 INFO:teuthology.orchestra.run.smithi074.stdout: python-cachetools.noarch 0:1.0.3-1.el7 2019-11-28T21:45:07.923 INFO:teuthology.orchestra.run.smithi074.stdout: python-jwcrypto.noarch 0:0.4.2-1.el7 2019-11-28T21:45:07.924 INFO:teuthology.orchestra.run.smithi074.stdout: python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 2019-11-28T21:45:07.924 INFO:teuthology.orchestra.run.smithi074.stdout: python2-certifi.noarch 0:2018.10.15-5.el7 2019-11-28T21:45:07.924 INFO:teuthology.orchestra.run.smithi074.stdout: python2-google-auth.noarch 1:1.1.1-5.el7 2019-11-28T21:45:07.924 INFO:teuthology.orchestra.run.smithi074.stdout: python2-kubernetes.noarch 0:10.0.1-1.el7 2019-11-28T21:45:07.924 INFO:teuthology.orchestra.run.smithi074.stdout: python2-oauthlib.noarch 0:2.0.1-8.el7 2019-11-28T21:45:07.924 INFO:teuthology.orchestra.run.smithi074.stdout: python2-pyasn1-modules.noarch 0:0.1.9-7.el7 2019-11-28T21:45:07.924 INFO:teuthology.orchestra.run.smithi074.stdout: python2-requests-oauthlib.noarch 0:0.8.0-5.el7 2019-11-28T21:45:07.925 INFO:teuthology.orchestra.run.smithi074.stdout: python2-rsa.noarch 0:3.4.1-1.el7 2019-11-28T21:45:07.925 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:45:07.925 INFO:teuthology.orchestra.run.smithi074.stdout:Complete! 2019-11-28T21:45:08.058 INFO:teuthology.orchestra.run.smithi074:> sudo yum -y install ceph-mgr-ssh 2019-11-28T21:45:08.162 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python-remoto-0.0.25-1.el7.noarch 2/3 2019-11-28T21:45:08.315 INFO:teuthology.orchestra.run.smithi074.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:45:08.359 INFO:teuthology.orchestra.run.smithi074.stdout:Loading mirror speeds from cached hostfile 2019-11-28T21:45:08.360 INFO:teuthology.orchestra.run.smithi074.stdout: * base: mirror.cogentco.com 2019-11-28T21:45:08.361 INFO:teuthology.orchestra.run.smithi074.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T21:45:08.361 INFO:teuthology.orchestra.run.smithi074.stdout: * extras: mirror.linux.duke.edu 2019-11-28T21:45:08.361 INFO:teuthology.orchestra.run.smithi074.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-11-28T21:45:08.439 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : 2:ceph-mgr-ssh-15.0.0-7725.g0073295.el7.noarch 3/3 2019-11-28T21:45:08.551 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python-remoto-0.0.25-1.el7.noarch 1/3 2019-11-28T21:45:08.677 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python-execnet-1.2.0-7.el7.noarch 2/3 2019-11-28T21:45:09.000 INFO:teuthology.orchestra.run.smithi074.stdout:7 packages excluded due to repository priority protections 2019-11-28T21:45:09.170 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : 2:ceph-mgr-ssh-15.0.0-7725.g0073295.el7.noarch 3/3 2019-11-28T21:45:09.170 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:45:09.171 INFO:teuthology.orchestra.run.smithi141.stdout:Installed: 2019-11-28T21:45:09.171 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-mgr-ssh.noarch 2:15.0.0-7725.g0073295.el7 2019-11-28T21:45:09.171 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:45:09.171 INFO:teuthology.orchestra.run.smithi141.stdout:Dependency Installed: 2019-11-28T21:45:09.171 INFO:teuthology.orchestra.run.smithi141.stdout: python-execnet.noarch 0:1.2.0-7.el7 python-remoto.noarch 0:0.0.25-1.el7 2019-11-28T21:45:09.171 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:45:09.172 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2019-11-28T21:45:09.287 INFO:teuthology.orchestra.run.smithi141:> sudo yum -y install ceph-fuse 2019-11-28T21:45:09.335 INFO:teuthology.orchestra.run.smithi074.stdout:Resolving Dependencies 2019-11-28T21:45:09.335 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:45:09.335 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package ceph-mgr-ssh.noarch 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:45:09.338 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python-remoto for package: 2:ceph-mgr-ssh-15.0.0-7725.g0073295.el7.noarch 2019-11-28T21:45:09.367 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:45:09.367 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python-remoto.noarch 0:0.0.25-1.el7 will be installed 2019-11-28T21:45:09.368 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python-execnet >= 1.2.0 for package: python-remoto-0.0.25-1.el7.noarch 2019-11-28T21:45:09.369 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:45:09.369 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python-execnet.noarch 0:1.2.0-7.el7 will be installed 2019-11-28T21:45:09.521 INFO:teuthology.orchestra.run.smithi141.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:45:09.562 INFO:teuthology.orchestra.run.smithi141.stdout:Loading mirror speeds from cached hostfile 2019-11-28T21:45:09.562 INFO:teuthology.orchestra.run.smithi141.stdout: * base: mirror.cogentco.com 2019-11-28T21:45:09.563 INFO:teuthology.orchestra.run.smithi141.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T21:45:09.563 INFO:teuthology.orchestra.run.smithi141.stdout: * extras: mirror.linux.duke.edu 2019-11-28T21:45:09.563 INFO:teuthology.orchestra.run.smithi141.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-11-28T21:45:09.735 INFO:teuthology.orchestra.run.smithi074.stdout:--> Finished Dependency Resolution 2019-11-28T21:45:09.961 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:45:09.961 INFO:teuthology.orchestra.run.smithi074.stdout:Dependencies Resolved 2019-11-28T21:45:09.962 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:45:09.962 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:45:09.962 INFO:teuthology.orchestra.run.smithi074.stdout: Package Arch Version Repository Size 2019-11-28T21:45:09.962 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:45:09.962 INFO:teuthology.orchestra.run.smithi074.stdout:Installing: 2019-11-28T21:45:09.962 INFO:teuthology.orchestra.run.smithi074.stdout: ceph-mgr-ssh noarch 2:15.0.0-7725.g0073295.el7 ceph-noarch 31 k 2019-11-28T21:45:09.962 INFO:teuthology.orchestra.run.smithi074.stdout:Installing for dependencies: 2019-11-28T21:45:09.963 INFO:teuthology.orchestra.run.smithi074.stdout: python-execnet noarch 1.2.0-7.el7 epel 261 k 2019-11-28T21:45:09.963 INFO:teuthology.orchestra.run.smithi074.stdout: python-remoto noarch 0.0.25-1.el7 epel 22 k 2019-11-28T21:45:09.963 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:45:09.963 INFO:teuthology.orchestra.run.smithi074.stdout:Transaction Summary 2019-11-28T21:45:09.963 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:45:09.963 INFO:teuthology.orchestra.run.smithi074.stdout:Install 1 Package (+2 Dependent packages) 2019-11-28T21:45:09.963 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:45:09.964 INFO:teuthology.orchestra.run.smithi074.stdout:Total download size: 313 k 2019-11-28T21:45:09.964 INFO:teuthology.orchestra.run.smithi074.stdout:Installed size: 1.1 M 2019-11-28T21:45:09.964 INFO:teuthology.orchestra.run.smithi074.stdout:Downloading packages: 2019-11-28T21:45:10.201 INFO:teuthology.orchestra.run.smithi141.stdout:7 packages excluded due to repository priority protections 2019-11-28T21:45:10.223 INFO:teuthology.orchestra.run.smithi074.stdout:-------------------------------------------------------------------------------- 2019-11-28T21:45:10.223 INFO:teuthology.orchestra.run.smithi074.stdout:Total 1.2 MB/s | 313 kB 00:00 2019-11-28T21:45:10.226 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction check 2019-11-28T21:45:10.235 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction test 2019-11-28T21:45:10.297 INFO:teuthology.orchestra.run.smithi074.stdout:Transaction test succeeded 2019-11-28T21:45:10.299 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction 2019-11-28T21:45:10.527 INFO:teuthology.orchestra.run.smithi141.stdout:Resolving Dependencies 2019-11-28T21:45:10.528 INFO:teuthology.orchestra.run.smithi141.stdout:--> Running transaction check 2019-11-28T21:45:10.528 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package ceph-fuse.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:45:10.538 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: /usr/bin/python3 for package: 2:ceph-fuse-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:45:10.571 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python3 for package: 2:ceph-fuse-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:45:10.571 INFO:teuthology.orchestra.run.smithi141.stdout:--> Running transaction check 2019-11-28T21:45:10.572 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python3.x86_64 0:3.6.8-10.el7 will be installed 2019-11-28T21:45:10.572 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python3-libs(x86-64) = 3.6.8-10.el7 for package: python3-3.6.8-10.el7.x86_64 2019-11-28T21:45:10.573 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python3-setuptools for package: python3-3.6.8-10.el7.x86_64 2019-11-28T21:45:10.574 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: python3-pip for package: python3-3.6.8-10.el7.x86_64 2019-11-28T21:45:10.575 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: libpython3.6m.so.1.0()(64bit) for package: python3-3.6.8-10.el7.x86_64 2019-11-28T21:45:10.576 INFO:teuthology.orchestra.run.smithi141.stdout:--> Running transaction check 2019-11-28T21:45:10.576 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python3-libs.x86_64 0:3.6.8-10.el7 will be installed 2019-11-28T21:45:10.582 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python3-pip.noarch 0:9.0.3-5.el7 will be installed 2019-11-28T21:45:10.582 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python3-setuptools.noarch 0:39.2.0-10.el7 will be installed 2019-11-28T21:45:10.945 INFO:teuthology.orchestra.run.smithi141.stdout:--> Finished Dependency Resolution 2019-11-28T21:45:11.082 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : python-execnet-1.2.0-7.el7.noarch 1/3 2019-11-28T21:45:11.170 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:45:11.170 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies Resolved 2019-11-28T21:45:11.171 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:45:11.171 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:45:11.172 INFO:teuthology.orchestra.run.smithi141.stdout: Package Arch Version Repository 2019-11-28T21:45:11.172 INFO:teuthology.orchestra.run.smithi141.stdout: Size 2019-11-28T21:45:11.172 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:45:11.172 INFO:teuthology.orchestra.run.smithi141.stdout:Installing: 2019-11-28T21:45:11.172 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-fuse x86_64 2:15.0.0-7725.g0073295.el7 ceph 566 k 2019-11-28T21:45:11.172 INFO:teuthology.orchestra.run.smithi141.stdout:Installing for dependencies: 2019-11-28T21:45:11.173 INFO:teuthology.orchestra.run.smithi141.stdout: python3 x86_64 3.6.8-10.el7 base 69 k 2019-11-28T21:45:11.173 INFO:teuthology.orchestra.run.smithi141.stdout: python3-libs x86_64 3.6.8-10.el7 base 7.0 M 2019-11-28T21:45:11.173 INFO:teuthology.orchestra.run.smithi141.stdout: python3-pip noarch 9.0.3-5.el7 base 1.8 M 2019-11-28T21:45:11.173 INFO:teuthology.orchestra.run.smithi141.stdout: python3-setuptools noarch 39.2.0-10.el7 base 629 k 2019-11-28T21:45:11.173 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:45:11.173 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction Summary 2019-11-28T21:45:11.173 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:45:11.173 INFO:teuthology.orchestra.run.smithi141.stdout:Install 1 Package (+4 Dependent packages) 2019-11-28T21:45:11.174 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:45:11.174 INFO:teuthology.orchestra.run.smithi141.stdout:Total download size: 10 M 2019-11-28T21:45:11.174 INFO:teuthology.orchestra.run.smithi141.stdout:Installed size: 49 M 2019-11-28T21:45:11.174 INFO:teuthology.orchestra.run.smithi141.stdout:Downloading packages: 2019-11-28T21:45:11.345 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : python-remoto-0.0.25-1.el7.noarch 2/3 2019-11-28T21:45:11.614 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : 2:ceph-mgr-ssh-15.0.0-7725.g0073295.el7.noarch 3/3 2019-11-28T21:45:11.630 INFO:teuthology.orchestra.run.smithi141.stdout:-------------------------------------------------------------------------------- 2019-11-28T21:45:11.631 INFO:teuthology.orchestra.run.smithi141.stdout:Total 22 MB/s | 10 MB 00:00 2019-11-28T21:45:11.648 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction check 2019-11-28T21:45:11.671 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction test 2019-11-28T21:45:11.702 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : python-remoto-0.0.25-1.el7.noarch 1/3 2019-11-28T21:45:11.774 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction test succeeded 2019-11-28T21:45:11.774 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction 2019-11-28T21:45:11.852 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : python-execnet-1.2.0-7.el7.noarch 2/3 2019-11-28T21:45:12.304 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : 2:ceph-mgr-ssh-15.0.0-7725.g0073295.el7.noarch 3/3 2019-11-28T21:45:12.304 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:45:12.304 INFO:teuthology.orchestra.run.smithi074.stdout:Installed: 2019-11-28T21:45:12.304 INFO:teuthology.orchestra.run.smithi074.stdout: ceph-mgr-ssh.noarch 2:15.0.0-7725.g0073295.el7 2019-11-28T21:45:12.305 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:45:12.305 INFO:teuthology.orchestra.run.smithi074.stdout:Dependency Installed: 2019-11-28T21:45:12.305 INFO:teuthology.orchestra.run.smithi074.stdout: python-execnet.noarch 0:1.2.0-7.el7 python-remoto.noarch 0:0.0.25-1.el7 2019-11-28T21:45:12.305 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:45:12.305 INFO:teuthology.orchestra.run.smithi074.stdout:Complete! 2019-11-28T21:45:12.433 INFO:teuthology.orchestra.run.smithi074:> sudo yum -y install ceph-fuse 2019-11-28T21:45:12.682 INFO:teuthology.orchestra.run.smithi074.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:45:12.728 INFO:teuthology.orchestra.run.smithi074.stdout:Loading mirror speeds from cached hostfile 2019-11-28T21:45:12.729 INFO:teuthology.orchestra.run.smithi074.stdout: * base: mirror.cogentco.com 2019-11-28T21:45:12.730 INFO:teuthology.orchestra.run.smithi074.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T21:45:12.730 INFO:teuthology.orchestra.run.smithi074.stdout: * extras: mirror.linux.duke.edu 2019-11-28T21:45:12.731 INFO:teuthology.orchestra.run.smithi074.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-11-28T21:45:13.371 INFO:teuthology.orchestra.run.smithi074.stdout:7 packages excluded due to repository priority protections 2019-11-28T21:45:13.710 INFO:teuthology.orchestra.run.smithi074.stdout:Resolving Dependencies 2019-11-28T21:45:13.710 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:45:13.710 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package ceph-fuse.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:45:13.720 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: /usr/bin/python3 for package: 2:ceph-fuse-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:45:13.752 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python3 for package: 2:ceph-fuse-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:45:13.753 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:45:13.753 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python3.x86_64 0:3.6.8-10.el7 will be installed 2019-11-28T21:45:13.753 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python3-libs(x86-64) = 3.6.8-10.el7 for package: python3-3.6.8-10.el7.x86_64 2019-11-28T21:45:13.755 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python3-setuptools for package: python3-3.6.8-10.el7.x86_64 2019-11-28T21:45:13.756 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: python3-pip for package: python3-3.6.8-10.el7.x86_64 2019-11-28T21:45:13.756 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: libpython3.6m.so.1.0()(64bit) for package: python3-3.6.8-10.el7.x86_64 2019-11-28T21:45:13.757 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:45:13.757 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python3-libs.x86_64 0:3.6.8-10.el7 will be installed 2019-11-28T21:45:13.763 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python3-pip.noarch 0:9.0.3-5.el7 will be installed 2019-11-28T21:45:13.763 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python3-setuptools.noarch 0:39.2.0-10.el7 will be installed 2019-11-28T21:45:14.127 INFO:teuthology.orchestra.run.smithi074.stdout:--> Finished Dependency Resolution 2019-11-28T21:45:14.218 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-setuptools-39.2.0-10.el7.noarch 1/5 2019-11-28T21:45:14.348 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:45:14.348 INFO:teuthology.orchestra.run.smithi074.stdout:Dependencies Resolved 2019-11-28T21:45:14.349 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:45:14.349 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:45:14.350 INFO:teuthology.orchestra.run.smithi074.stdout: Package Arch Version Repository 2019-11-28T21:45:14.350 INFO:teuthology.orchestra.run.smithi074.stdout: Size 2019-11-28T21:45:14.350 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:45:14.350 INFO:teuthology.orchestra.run.smithi074.stdout:Installing: 2019-11-28T21:45:14.350 INFO:teuthology.orchestra.run.smithi074.stdout: ceph-fuse x86_64 2:15.0.0-7725.g0073295.el7 ceph 566 k 2019-11-28T21:45:14.350 INFO:teuthology.orchestra.run.smithi074.stdout:Installing for dependencies: 2019-11-28T21:45:14.350 INFO:teuthology.orchestra.run.smithi074.stdout: python3 x86_64 3.6.8-10.el7 base 69 k 2019-11-28T21:45:14.351 INFO:teuthology.orchestra.run.smithi074.stdout: python3-libs x86_64 3.6.8-10.el7 base 7.0 M 2019-11-28T21:45:14.351 INFO:teuthology.orchestra.run.smithi074.stdout: python3-pip noarch 9.0.3-5.el7 base 1.8 M 2019-11-28T21:45:14.351 INFO:teuthology.orchestra.run.smithi074.stdout: python3-setuptools noarch 39.2.0-10.el7 base 629 k 2019-11-28T21:45:14.351 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:45:14.351 INFO:teuthology.orchestra.run.smithi074.stdout:Transaction Summary 2019-11-28T21:45:14.351 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:45:14.351 INFO:teuthology.orchestra.run.smithi074.stdout:Install 1 Package (+4 Dependent packages) 2019-11-28T21:45:14.351 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:45:14.352 INFO:teuthology.orchestra.run.smithi074.stdout:Total download size: 10 M 2019-11-28T21:45:14.352 INFO:teuthology.orchestra.run.smithi074.stdout:Installed size: 49 M 2019-11-28T21:45:14.352 INFO:teuthology.orchestra.run.smithi074.stdout:Downloading packages: 2019-11-28T21:45:14.597 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-libs-3.6.8-10.el7.x86_64 2/5 2019-11-28T21:45:14.821 INFO:teuthology.orchestra.run.smithi074.stdout:-------------------------------------------------------------------------------- 2019-11-28T21:45:14.821 INFO:teuthology.orchestra.run.smithi074.stdout:Total 21 MB/s | 10 MB 00:00 2019-11-28T21:45:14.832 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction check 2019-11-28T21:45:14.848 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction test 2019-11-28T21:45:14.931 INFO:teuthology.orchestra.run.smithi074.stdout:Transaction test succeeded 2019-11-28T21:45:14.931 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction 2019-11-28T21:45:15.505 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-3.6.8-10.el7.x86_64 3/5 2019-11-28T21:45:15.958 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : python3-pip-9.0.3-5.el7.noarch 4/5 2019-11-28T21:45:16.206 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : 2:ceph-fuse-15.0.0-7725.g0073295.el7.x86_64 5/5 2019-11-28T21:45:16.322 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-pip-9.0.3-5.el7.noarch 1/5 2019-11-28T21:45:16.448 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-setuptools-39.2.0-10.el7.noarch 2/5 2019-11-28T21:45:16.548 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-libs-3.6.8-10.el7.x86_64 3/5 2019-11-28T21:45:16.707 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : python3-3.6.8-10.el7.x86_64 4/5 2019-11-28T21:45:17.201 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : 2:ceph-fuse-15.0.0-7725.g0073295.el7.x86_64 5/5 2019-11-28T21:45:17.201 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:45:17.201 INFO:teuthology.orchestra.run.smithi141.stdout:Installed: 2019-11-28T21:45:17.201 INFO:teuthology.orchestra.run.smithi141.stdout: ceph-fuse.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:45:17.201 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:45:17.201 INFO:teuthology.orchestra.run.smithi141.stdout:Dependency Installed: 2019-11-28T21:45:17.202 INFO:teuthology.orchestra.run.smithi141.stdout: python3.x86_64 0:3.6.8-10.el7 python3-libs.x86_64 0:3.6.8-10.el7 2019-11-28T21:45:17.202 INFO:teuthology.orchestra.run.smithi141.stdout: python3-pip.noarch 0:9.0.3-5.el7 python3-setuptools.noarch 0:39.2.0-10.el7 2019-11-28T21:45:17.202 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:45:17.202 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2019-11-28T21:45:17.325 INFO:teuthology.orchestra.run.smithi141:> sudo yum -y install libcephfs2 2019-11-28T21:45:17.327 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : python3-setuptools-39.2.0-10.el7.noarch 1/5 2019-11-28T21:45:17.558 INFO:teuthology.orchestra.run.smithi141.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:45:17.601 INFO:teuthology.orchestra.run.smithi141.stdout:Loading mirror speeds from cached hostfile 2019-11-28T21:45:17.602 INFO:teuthology.orchestra.run.smithi141.stdout: * base: mirror.cogentco.com 2019-11-28T21:45:17.602 INFO:teuthology.orchestra.run.smithi141.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T21:45:17.603 INFO:teuthology.orchestra.run.smithi141.stdout: * extras: mirror.linux.duke.edu 2019-11-28T21:45:17.603 INFO:teuthology.orchestra.run.smithi141.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-11-28T21:45:17.696 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : python3-libs-3.6.8-10.el7.x86_64 2/5 2019-11-28T21:45:18.247 INFO:teuthology.orchestra.run.smithi141.stdout:7 packages excluded due to repository priority protections 2019-11-28T21:45:18.504 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : python3-3.6.8-10.el7.x86_64 3/5 2019-11-28T21:45:18.579 INFO:teuthology.orchestra.run.smithi141.stdout:Package 2:libcephfs2-15.0.0-7725.g0073295.el7.x86_64 already installed and latest version 2019-11-28T21:45:18.580 INFO:teuthology.orchestra.run.smithi141.stdout:Nothing to do 2019-11-28T21:45:18.640 INFO:teuthology.orchestra.run.smithi141:> sudo yum -y install libcephfs-devel 2019-11-28T21:45:18.854 INFO:teuthology.orchestra.run.smithi141.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:45:18.892 INFO:teuthology.orchestra.run.smithi141.stdout:Loading mirror speeds from cached hostfile 2019-11-28T21:45:18.894 INFO:teuthology.orchestra.run.smithi141.stdout: * base: mirror.cogentco.com 2019-11-28T21:45:18.894 INFO:teuthology.orchestra.run.smithi141.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T21:45:18.894 INFO:teuthology.orchestra.run.smithi141.stdout: * extras: mirror.linux.duke.edu 2019-11-28T21:45:18.895 INFO:teuthology.orchestra.run.smithi141.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-11-28T21:45:19.003 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : python3-pip-9.0.3-5.el7.noarch 4/5 2019-11-28T21:45:19.306 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : 2:ceph-fuse-15.0.0-7725.g0073295.el7.x86_64 5/5 2019-11-28T21:45:19.429 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : python3-pip-9.0.3-5.el7.noarch 1/5 2019-11-28T21:45:19.477 INFO:teuthology.orchestra.run.smithi141.stdout:7 packages excluded due to repository priority protections 2019-11-28T21:45:19.555 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : python3-setuptools-39.2.0-10.el7.noarch 2/5 2019-11-28T21:45:19.647 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : python3-libs-3.6.8-10.el7.x86_64 3/5 2019-11-28T21:45:19.776 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : python3-3.6.8-10.el7.x86_64 4/5 2019-11-28T21:45:19.803 INFO:teuthology.orchestra.run.smithi141.stdout:Resolving Dependencies 2019-11-28T21:45:19.803 INFO:teuthology.orchestra.run.smithi141.stdout:--> Running transaction check 2019-11-28T21:45:19.804 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package libcephfs-devel.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:45:19.804 INFO:teuthology.orchestra.run.smithi141.stdout:--> Processing Dependency: librados-devel = 2:15.0.0-7725.g0073295.el7 for package: 2:libcephfs-devel-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:45:19.834 INFO:teuthology.orchestra.run.smithi141.stdout:--> Running transaction check 2019-11-28T21:45:19.834 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package librados-devel.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:45:20.182 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : 2:ceph-fuse-15.0.0-7725.g0073295.el7.x86_64 5/5 2019-11-28T21:45:20.182 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:45:20.183 INFO:teuthology.orchestra.run.smithi074.stdout:Installed: 2019-11-28T21:45:20.183 INFO:teuthology.orchestra.run.smithi074.stdout: ceph-fuse.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:45:20.183 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:45:20.183 INFO:teuthology.orchestra.run.smithi074.stdout:Dependency Installed: 2019-11-28T21:45:20.183 INFO:teuthology.orchestra.run.smithi074.stdout: python3.x86_64 0:3.6.8-10.el7 python3-libs.x86_64 0:3.6.8-10.el7 2019-11-28T21:45:20.183 INFO:teuthology.orchestra.run.smithi074.stdout: python3-pip.noarch 0:9.0.3-5.el7 python3-setuptools.noarch 0:39.2.0-10.el7 2019-11-28T21:45:20.183 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:45:20.184 INFO:teuthology.orchestra.run.smithi074.stdout:Complete! 2019-11-28T21:45:20.204 INFO:teuthology.orchestra.run.smithi141.stdout:--> Finished Dependency Resolution 2019-11-28T21:45:20.317 INFO:teuthology.orchestra.run.smithi074:> sudo yum -y install libcephfs2 2019-11-28T21:45:20.433 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:45:20.433 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies Resolved 2019-11-28T21:45:20.434 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:45:20.434 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:45:20.434 INFO:teuthology.orchestra.run.smithi141.stdout: Package Arch Version Repository 2019-11-28T21:45:20.435 INFO:teuthology.orchestra.run.smithi141.stdout: Size 2019-11-28T21:45:20.435 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:45:20.435 INFO:teuthology.orchestra.run.smithi141.stdout:Installing: 2019-11-28T21:45:20.435 INFO:teuthology.orchestra.run.smithi141.stdout: libcephfs-devel x86_64 2:15.0.0-7725.g0073295.el7 ceph 17 k 2019-11-28T21:45:20.435 INFO:teuthology.orchestra.run.smithi141.stdout:Installing for dependencies: 2019-11-28T21:45:20.435 INFO:teuthology.orchestra.run.smithi141.stdout: librados-devel x86_64 2:15.0.0-7725.g0073295.el7 ceph 153 k 2019-11-28T21:45:20.435 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:45:20.436 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction Summary 2019-11-28T21:45:20.436 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:45:20.436 INFO:teuthology.orchestra.run.smithi141.stdout:Install 1 Package (+1 Dependent package) 2019-11-28T21:45:20.436 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:45:20.436 INFO:teuthology.orchestra.run.smithi141.stdout:Total download size: 170 k 2019-11-28T21:45:20.436 INFO:teuthology.orchestra.run.smithi141.stdout:Installed size: 679 k 2019-11-28T21:45:20.436 INFO:teuthology.orchestra.run.smithi141.stdout:Downloading packages: 2019-11-28T21:45:20.546 INFO:teuthology.orchestra.run.smithi074.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:45:20.589 INFO:teuthology.orchestra.run.smithi074.stdout:Loading mirror speeds from cached hostfile 2019-11-28T21:45:20.590 INFO:teuthology.orchestra.run.smithi074.stdout: * base: mirror.cogentco.com 2019-11-28T21:45:20.591 INFO:teuthology.orchestra.run.smithi074.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T21:45:20.591 INFO:teuthology.orchestra.run.smithi074.stdout: * extras: mirror.linux.duke.edu 2019-11-28T21:45:20.592 INFO:teuthology.orchestra.run.smithi074.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-11-28T21:45:20.778 INFO:teuthology.orchestra.run.smithi141.stdout:-------------------------------------------------------------------------------- 2019-11-28T21:45:20.779 INFO:teuthology.orchestra.run.smithi141.stdout:Total 494 kB/s | 170 kB 00:00 2019-11-28T21:45:20.781 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction check 2019-11-28T21:45:20.788 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction test 2019-11-28T21:45:20.790 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction test succeeded 2019-11-28T21:45:20.790 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction 2019-11-28T21:45:21.232 INFO:teuthology.orchestra.run.smithi074.stdout:7 packages excluded due to repository priority protections 2019-11-28T21:45:21.294 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : 2:librados-devel-15.0.0-7725.g0073295.el7.x86_64 1/2 2019-11-28T21:45:21.532 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : 2:libcephfs-devel-15.0.0-7725.g0073295.el7.x86_64 2/2 2019-11-28T21:45:21.564 INFO:teuthology.orchestra.run.smithi074.stdout:Package 2:libcephfs2-15.0.0-7725.g0073295.el7.x86_64 already installed and latest version 2019-11-28T21:45:21.564 INFO:teuthology.orchestra.run.smithi074.stdout:Nothing to do 2019-11-28T21:45:21.625 INFO:teuthology.orchestra.run.smithi074:> sudo yum -y install libcephfs-devel 2019-11-28T21:45:21.646 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : 2:libcephfs-devel-15.0.0-7725.g0073295.el7.x86_64 1/2 2019-11-28T21:45:21.847 INFO:teuthology.orchestra.run.smithi074.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:45:21.886 INFO:teuthology.orchestra.run.smithi074.stdout:Loading mirror speeds from cached hostfile 2019-11-28T21:45:21.887 INFO:teuthology.orchestra.run.smithi074.stdout: * base: mirror.cogentco.com 2019-11-28T21:45:21.888 INFO:teuthology.orchestra.run.smithi074.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T21:45:21.888 INFO:teuthology.orchestra.run.smithi074.stdout: * extras: mirror.linux.duke.edu 2019-11-28T21:45:21.888 INFO:teuthology.orchestra.run.smithi074.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-11-28T21:45:22.123 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : 2:librados-devel-15.0.0-7725.g0073295.el7.x86_64 2/2 2019-11-28T21:45:22.123 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:45:22.123 INFO:teuthology.orchestra.run.smithi141.stdout:Installed: 2019-11-28T21:45:22.124 INFO:teuthology.orchestra.run.smithi141.stdout: libcephfs-devel.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:45:22.124 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:45:22.124 INFO:teuthology.orchestra.run.smithi141.stdout:Dependency Installed: 2019-11-28T21:45:22.124 INFO:teuthology.orchestra.run.smithi141.stdout: librados-devel.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:45:22.124 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:45:22.124 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2019-11-28T21:45:22.254 INFO:teuthology.orchestra.run.smithi141:> sudo yum -y install librados2 2019-11-28T21:45:22.469 INFO:teuthology.orchestra.run.smithi074.stdout:7 packages excluded due to repository priority protections 2019-11-28T21:45:22.481 INFO:teuthology.orchestra.run.smithi141.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:45:22.523 INFO:teuthology.orchestra.run.smithi141.stdout:Loading mirror speeds from cached hostfile 2019-11-28T21:45:22.524 INFO:teuthology.orchestra.run.smithi141.stdout: * base: mirror.cogentco.com 2019-11-28T21:45:22.524 INFO:teuthology.orchestra.run.smithi141.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T21:45:22.525 INFO:teuthology.orchestra.run.smithi141.stdout: * extras: mirror.linux.duke.edu 2019-11-28T21:45:22.525 INFO:teuthology.orchestra.run.smithi141.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-11-28T21:45:22.790 INFO:teuthology.orchestra.run.smithi074.stdout:Resolving Dependencies 2019-11-28T21:45:22.790 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:45:22.790 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package libcephfs-devel.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:45:22.791 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: librados-devel = 2:15.0.0-7725.g0073295.el7 for package: 2:libcephfs-devel-15.0.0-7725.g0073295.el7.x86_64 2019-11-28T21:45:22.821 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:45:22.821 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package librados-devel.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:45:23.169 INFO:teuthology.orchestra.run.smithi141.stdout:7 packages excluded due to repository priority protections 2019-11-28T21:45:23.190 INFO:teuthology.orchestra.run.smithi074.stdout:--> Finished Dependency Resolution 2019-11-28T21:45:23.415 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:45:23.415 INFO:teuthology.orchestra.run.smithi074.stdout:Dependencies Resolved 2019-11-28T21:45:23.416 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:45:23.416 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:45:23.416 INFO:teuthology.orchestra.run.smithi074.stdout: Package Arch Version Repository 2019-11-28T21:45:23.416 INFO:teuthology.orchestra.run.smithi074.stdout: Size 2019-11-28T21:45:23.416 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:45:23.417 INFO:teuthology.orchestra.run.smithi074.stdout:Installing: 2019-11-28T21:45:23.417 INFO:teuthology.orchestra.run.smithi074.stdout: libcephfs-devel x86_64 2:15.0.0-7725.g0073295.el7 ceph 17 k 2019-11-28T21:45:23.417 INFO:teuthology.orchestra.run.smithi074.stdout:Installing for dependencies: 2019-11-28T21:45:23.417 INFO:teuthology.orchestra.run.smithi074.stdout: librados-devel x86_64 2:15.0.0-7725.g0073295.el7 ceph 153 k 2019-11-28T21:45:23.417 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:45:23.417 INFO:teuthology.orchestra.run.smithi074.stdout:Transaction Summary 2019-11-28T21:45:23.417 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:45:23.418 INFO:teuthology.orchestra.run.smithi074.stdout:Install 1 Package (+1 Dependent package) 2019-11-28T21:45:23.418 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:45:23.418 INFO:teuthology.orchestra.run.smithi074.stdout:Total download size: 170 k 2019-11-28T21:45:23.418 INFO:teuthology.orchestra.run.smithi074.stdout:Installed size: 679 k 2019-11-28T21:45:23.418 INFO:teuthology.orchestra.run.smithi074.stdout:Downloading packages: 2019-11-28T21:45:23.501 INFO:teuthology.orchestra.run.smithi141.stdout:Package 2:librados2-15.0.0-7725.g0073295.el7.x86_64 already installed and latest version 2019-11-28T21:45:23.502 INFO:teuthology.orchestra.run.smithi141.stdout:Nothing to do 2019-11-28T21:45:23.563 INFO:teuthology.orchestra.run.smithi141:> sudo yum -y install librbd1 2019-11-28T21:45:23.718 INFO:teuthology.orchestra.run.smithi141.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:45:23.753 INFO:teuthology.orchestra.run.smithi141.stdout:Loading mirror speeds from cached hostfile 2019-11-28T21:45:23.753 INFO:teuthology.orchestra.run.smithi141.stdout: * base: mirror.cogentco.com 2019-11-28T21:45:23.755 INFO:teuthology.orchestra.run.smithi141.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T21:45:23.755 INFO:teuthology.orchestra.run.smithi141.stdout: * extras: mirror.linux.duke.edu 2019-11-28T21:45:23.755 INFO:teuthology.orchestra.run.smithi141.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-11-28T21:45:23.785 INFO:teuthology.orchestra.run.smithi074.stdout:-------------------------------------------------------------------------------- 2019-11-28T21:45:23.785 INFO:teuthology.orchestra.run.smithi074.stdout:Total 460 kB/s | 170 kB 00:00 2019-11-28T21:45:23.788 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction check 2019-11-28T21:45:23.797 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction test 2019-11-28T21:45:23.799 INFO:teuthology.orchestra.run.smithi074.stdout:Transaction test succeeded 2019-11-28T21:45:23.800 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction 2019-11-28T21:45:24.333 INFO:teuthology.orchestra.run.smithi141.stdout:7 packages excluded due to repository priority protections 2019-11-28T21:45:24.417 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : 2:librados-devel-15.0.0-7725.g0073295.el7.x86_64 1/2 2019-11-28T21:45:24.657 INFO:teuthology.orchestra.run.smithi141.stdout:Package 2:librbd1-15.0.0-7725.g0073295.el7.x86_64 already installed and latest version 2019-11-28T21:45:24.657 INFO:teuthology.orchestra.run.smithi141.stdout:Nothing to do 2019-11-28T21:45:24.672 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : 2:libcephfs-devel-15.0.0-7725.g0073295.el7.x86_64 2/2 2019-11-28T21:45:24.719 INFO:teuthology.orchestra.run.smithi141:> sudo yum -y install python-ceph 2019-11-28T21:45:24.794 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : 2:libcephfs-devel-15.0.0-7725.g0073295.el7.x86_64 1/2 2019-11-28T21:45:24.930 INFO:teuthology.orchestra.run.smithi141.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:45:24.972 INFO:teuthology.orchestra.run.smithi141.stdout:Loading mirror speeds from cached hostfile 2019-11-28T21:45:24.973 INFO:teuthology.orchestra.run.smithi141.stdout: * base: mirror.cogentco.com 2019-11-28T21:45:24.973 INFO:teuthology.orchestra.run.smithi141.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T21:45:24.973 INFO:teuthology.orchestra.run.smithi141.stdout: * extras: mirror.linux.duke.edu 2019-11-28T21:45:24.974 INFO:teuthology.orchestra.run.smithi141.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-11-28T21:45:25.312 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : 2:librados-devel-15.0.0-7725.g0073295.el7.x86_64 2/2 2019-11-28T21:45:25.312 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:45:25.312 INFO:teuthology.orchestra.run.smithi074.stdout:Installed: 2019-11-28T21:45:25.312 INFO:teuthology.orchestra.run.smithi074.stdout: libcephfs-devel.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:45:25.312 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:45:25.313 INFO:teuthology.orchestra.run.smithi074.stdout:Dependency Installed: 2019-11-28T21:45:25.313 INFO:teuthology.orchestra.run.smithi074.stdout: librados-devel.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:45:25.313 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:45:25.313 INFO:teuthology.orchestra.run.smithi074.stdout:Complete! 2019-11-28T21:45:25.432 INFO:teuthology.orchestra.run.smithi074:> sudo yum -y install librados2 2019-11-28T21:45:25.613 INFO:teuthology.orchestra.run.smithi141.stdout:7 packages excluded due to repository priority protections 2019-11-28T21:45:25.666 INFO:teuthology.orchestra.run.smithi074.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:45:25.708 INFO:teuthology.orchestra.run.smithi074.stdout:Loading mirror speeds from cached hostfile 2019-11-28T21:45:25.710 INFO:teuthology.orchestra.run.smithi074.stdout: * base: mirror.cogentco.com 2019-11-28T21:45:25.710 INFO:teuthology.orchestra.run.smithi074.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T21:45:25.710 INFO:teuthology.orchestra.run.smithi074.stdout: * extras: mirror.linux.duke.edu 2019-11-28T21:45:25.710 INFO:teuthology.orchestra.run.smithi074.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-11-28T21:45:25.941 INFO:teuthology.orchestra.run.smithi141.stdout:Resolving Dependencies 2019-11-28T21:45:25.942 INFO:teuthology.orchestra.run.smithi141.stdout:--> Running transaction check 2019-11-28T21:45:25.942 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package python-ceph-compat.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:45:26.311 INFO:teuthology.orchestra.run.smithi141.stdout:--> Finished Dependency Resolution 2019-11-28T21:45:26.346 INFO:teuthology.orchestra.run.smithi074.stdout:7 packages excluded due to repository priority protections 2019-11-28T21:45:26.539 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:45:26.539 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies Resolved 2019-11-28T21:45:26.540 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:45:26.540 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:45:26.540 INFO:teuthology.orchestra.run.smithi141.stdout: Package Arch Version Repository 2019-11-28T21:45:26.540 INFO:teuthology.orchestra.run.smithi141.stdout: Size 2019-11-28T21:45:26.540 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:45:26.540 INFO:teuthology.orchestra.run.smithi141.stdout:Installing: 2019-11-28T21:45:26.541 INFO:teuthology.orchestra.run.smithi141.stdout: python-ceph-compat x86_64 2:15.0.0-7725.g0073295.el7 ceph 2.2 k 2019-11-28T21:45:26.541 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:45:26.541 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction Summary 2019-11-28T21:45:26.541 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:45:26.541 INFO:teuthology.orchestra.run.smithi141.stdout:Install 1 Package 2019-11-28T21:45:26.541 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:45:26.541 INFO:teuthology.orchestra.run.smithi141.stdout:Total download size: 2.2 k 2019-11-28T21:45:26.541 INFO:teuthology.orchestra.run.smithi141.stdout:Installed size: 0 2019-11-28T21:45:26.542 INFO:teuthology.orchestra.run.smithi141.stdout:Downloading packages: 2019-11-28T21:45:26.679 INFO:teuthology.orchestra.run.smithi074.stdout:Package 2:librados2-15.0.0-7725.g0073295.el7.x86_64 already installed and latest version 2019-11-28T21:45:26.679 INFO:teuthology.orchestra.run.smithi074.stdout:Nothing to do 2019-11-28T21:45:26.739 INFO:teuthology.orchestra.run.smithi074:> sudo yum -y install librbd1 2019-11-28T21:45:26.852 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction check 2019-11-28T21:45:26.853 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction test 2019-11-28T21:45:26.855 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction test succeeded 2019-11-28T21:45:26.855 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction 2019-11-28T21:45:26.979 INFO:teuthology.orchestra.run.smithi074.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:45:27.023 INFO:teuthology.orchestra.run.smithi074.stdout:Loading mirror speeds from cached hostfile 2019-11-28T21:45:27.024 INFO:teuthology.orchestra.run.smithi074.stdout: * base: mirror.cogentco.com 2019-11-28T21:45:27.025 INFO:teuthology.orchestra.run.smithi074.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T21:45:27.025 INFO:teuthology.orchestra.run.smithi074.stdout: * extras: mirror.linux.duke.edu 2019-11-28T21:45:27.025 INFO:teuthology.orchestra.run.smithi074.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-11-28T21:45:27.336 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : 2:python-ceph-compat-15.0.0-7725.g0073295.el7.x86_64 1/1 2019-11-28T21:45:27.670 INFO:teuthology.orchestra.run.smithi074.stdout:7 packages excluded due to repository priority protections 2019-11-28T21:45:27.744 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : 2:python-ceph-compat-15.0.0-7725.g0073295.el7.x86_64 1/1 2019-11-28T21:45:27.744 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:45:27.744 INFO:teuthology.orchestra.run.smithi141.stdout:Installed: 2019-11-28T21:45:27.744 INFO:teuthology.orchestra.run.smithi141.stdout: python-ceph-compat.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:45:27.744 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:45:27.744 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2019-11-28T21:45:27.859 INFO:teuthology.orchestra.run.smithi141:> sudo yum -y install rbd-fuse 2019-11-28T21:45:28.003 INFO:teuthology.orchestra.run.smithi074.stdout:Package 2:librbd1-15.0.0-7725.g0073295.el7.x86_64 already installed and latest version 2019-11-28T21:45:28.003 INFO:teuthology.orchestra.run.smithi074.stdout:Nothing to do 2019-11-28T21:45:28.063 INFO:teuthology.orchestra.run.smithi074:> sudo yum -y install python-ceph 2019-11-28T21:45:28.102 INFO:teuthology.orchestra.run.smithi141.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:45:28.144 INFO:teuthology.orchestra.run.smithi141.stdout:Loading mirror speeds from cached hostfile 2019-11-28T21:45:28.145 INFO:teuthology.orchestra.run.smithi141.stdout: * base: mirror.cogentco.com 2019-11-28T21:45:28.146 INFO:teuthology.orchestra.run.smithi141.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T21:45:28.146 INFO:teuthology.orchestra.run.smithi141.stdout: * extras: mirror.linux.duke.edu 2019-11-28T21:45:28.146 INFO:teuthology.orchestra.run.smithi141.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-11-28T21:45:28.261 INFO:teuthology.orchestra.run.smithi074.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:45:28.296 INFO:teuthology.orchestra.run.smithi074.stdout:Loading mirror speeds from cached hostfile 2019-11-28T21:45:28.297 INFO:teuthology.orchestra.run.smithi074.stdout: * base: mirror.cogentco.com 2019-11-28T21:45:28.297 INFO:teuthology.orchestra.run.smithi074.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T21:45:28.297 INFO:teuthology.orchestra.run.smithi074.stdout: * extras: mirror.linux.duke.edu 2019-11-28T21:45:28.298 INFO:teuthology.orchestra.run.smithi074.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-11-28T21:45:28.791 INFO:teuthology.orchestra.run.smithi141.stdout:7 packages excluded due to repository priority protections 2019-11-28T21:45:28.889 INFO:teuthology.orchestra.run.smithi074.stdout:7 packages excluded due to repository priority protections 2019-11-28T21:45:29.120 INFO:teuthology.orchestra.run.smithi141.stdout:Resolving Dependencies 2019-11-28T21:45:29.121 INFO:teuthology.orchestra.run.smithi141.stdout:--> Running transaction check 2019-11-28T21:45:29.121 INFO:teuthology.orchestra.run.smithi141.stdout:---> Package rbd-fuse.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:45:29.212 INFO:teuthology.orchestra.run.smithi074.stdout:Resolving Dependencies 2019-11-28T21:45:29.213 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:45:29.213 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package python-ceph-compat.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:45:29.496 INFO:teuthology.orchestra.run.smithi141.stdout:--> Finished Dependency Resolution 2019-11-28T21:45:29.584 INFO:teuthology.orchestra.run.smithi074.stdout:--> Finished Dependency Resolution 2019-11-28T21:45:29.725 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:45:29.725 INFO:teuthology.orchestra.run.smithi141.stdout:Dependencies Resolved 2019-11-28T21:45:29.726 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:45:29.726 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:45:29.726 INFO:teuthology.orchestra.run.smithi141.stdout: Package Arch Version Repository Size 2019-11-28T21:45:29.726 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:45:29.726 INFO:teuthology.orchestra.run.smithi141.stdout:Installing: 2019-11-28T21:45:29.726 INFO:teuthology.orchestra.run.smithi141.stdout: rbd-fuse x86_64 2:15.0.0-7725.g0073295.el7 ceph 76 k 2019-11-28T21:45:29.726 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:45:29.727 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction Summary 2019-11-28T21:45:29.727 INFO:teuthology.orchestra.run.smithi141.stdout:================================================================================ 2019-11-28T21:45:29.727 INFO:teuthology.orchestra.run.smithi141.stdout:Install 1 Package 2019-11-28T21:45:29.727 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:45:29.727 INFO:teuthology.orchestra.run.smithi141.stdout:Total download size: 76 k 2019-11-28T21:45:29.727 INFO:teuthology.orchestra.run.smithi141.stdout:Installed size: 200 k 2019-11-28T21:45:29.727 INFO:teuthology.orchestra.run.smithi141.stdout:Downloading packages: 2019-11-28T21:45:29.809 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:45:29.809 INFO:teuthology.orchestra.run.smithi074.stdout:Dependencies Resolved 2019-11-28T21:45:29.810 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:45:29.810 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:45:29.810 INFO:teuthology.orchestra.run.smithi074.stdout: Package Arch Version Repository 2019-11-28T21:45:29.810 INFO:teuthology.orchestra.run.smithi074.stdout: Size 2019-11-28T21:45:29.811 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:45:29.811 INFO:teuthology.orchestra.run.smithi074.stdout:Installing: 2019-11-28T21:45:29.811 INFO:teuthology.orchestra.run.smithi074.stdout: python-ceph-compat x86_64 2:15.0.0-7725.g0073295.el7 ceph 2.2 k 2019-11-28T21:45:29.811 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:45:29.811 INFO:teuthology.orchestra.run.smithi074.stdout:Transaction Summary 2019-11-28T21:45:29.811 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:45:29.811 INFO:teuthology.orchestra.run.smithi074.stdout:Install 1 Package 2019-11-28T21:45:29.812 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:45:29.812 INFO:teuthology.orchestra.run.smithi074.stdout:Total download size: 2.2 k 2019-11-28T21:45:29.812 INFO:teuthology.orchestra.run.smithi074.stdout:Installed size: 0 2019-11-28T21:45:29.812 INFO:teuthology.orchestra.run.smithi074.stdout:Downloading packages: 2019-11-28T21:45:30.078 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction check 2019-11-28T21:45:30.100 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction test 2019-11-28T21:45:30.102 INFO:teuthology.orchestra.run.smithi141.stdout:Transaction test succeeded 2019-11-28T21:45:30.102 INFO:teuthology.orchestra.run.smithi141.stdout:Running transaction 2019-11-28T21:45:30.115 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction check 2019-11-28T21:45:30.116 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction test 2019-11-28T21:45:30.118 INFO:teuthology.orchestra.run.smithi074.stdout:Transaction test succeeded 2019-11-28T21:45:30.119 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction 2019-11-28T21:45:30.618 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : 2:python-ceph-compat-15.0.0-7725.g0073295.el7.x86_64 1/1 2019-11-28T21:45:30.691 INFO:teuthology.orchestra.run.smithi141.stdout: Installing : 2:rbd-fuse-15.0.0-7725.g0073295.el7.x86_64 1/1 2019-11-28T21:45:31.109 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : 2:python-ceph-compat-15.0.0-7725.g0073295.el7.x86_64 1/1 2019-11-28T21:45:31.109 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:45:31.109 INFO:teuthology.orchestra.run.smithi074.stdout:Installed: 2019-11-28T21:45:31.109 INFO:teuthology.orchestra.run.smithi074.stdout: python-ceph-compat.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:45:31.110 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:45:31.110 INFO:teuthology.orchestra.run.smithi074.stdout:Complete! 2019-11-28T21:45:31.181 INFO:teuthology.orchestra.run.smithi141.stdout: Verifying : 2:rbd-fuse-15.0.0-7725.g0073295.el7.x86_64 1/1 2019-11-28T21:45:31.181 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:45:31.181 INFO:teuthology.orchestra.run.smithi141.stdout:Installed: 2019-11-28T21:45:31.181 INFO:teuthology.orchestra.run.smithi141.stdout: rbd-fuse.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:45:31.182 INFO:teuthology.orchestra.run.smithi141.stdout: 2019-11-28T21:45:31.182 INFO:teuthology.orchestra.run.smithi141.stdout:Complete! 2019-11-28T21:45:31.222 INFO:teuthology.orchestra.run.smithi074:> sudo yum -y install rbd-fuse 2019-11-28T21:45:31.304 DEBUG:teuthology.parallel:result is None 2019-11-28T21:45:31.488 INFO:teuthology.orchestra.run.smithi074.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:45:31.535 INFO:teuthology.orchestra.run.smithi074.stdout:Loading mirror speeds from cached hostfile 2019-11-28T21:45:31.536 INFO:teuthology.orchestra.run.smithi074.stdout: * base: mirror.cogentco.com 2019-11-28T21:45:31.536 INFO:teuthology.orchestra.run.smithi074.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T21:45:31.537 INFO:teuthology.orchestra.run.smithi074.stdout: * extras: mirror.linux.duke.edu 2019-11-28T21:45:31.537 INFO:teuthology.orchestra.run.smithi074.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-11-28T21:45:32.178 INFO:teuthology.orchestra.run.smithi074.stdout:7 packages excluded due to repository priority protections 2019-11-28T21:45:32.519 INFO:teuthology.orchestra.run.smithi074.stdout:Resolving Dependencies 2019-11-28T21:45:32.520 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:45:32.520 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package rbd-fuse.x86_64 2:15.0.0-7725.g0073295.el7 will be installed 2019-11-28T21:45:32.894 INFO:teuthology.orchestra.run.smithi074.stdout:--> Finished Dependency Resolution 2019-11-28T21:45:33.119 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:45:33.119 INFO:teuthology.orchestra.run.smithi074.stdout:Dependencies Resolved 2019-11-28T21:45:33.120 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:45:33.120 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:45:33.120 INFO:teuthology.orchestra.run.smithi074.stdout: Package Arch Version Repository Size 2019-11-28T21:45:33.127 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:45:33.127 INFO:teuthology.orchestra.run.smithi074.stdout:Installing: 2019-11-28T21:45:33.127 INFO:teuthology.orchestra.run.smithi074.stdout: rbd-fuse x86_64 2:15.0.0-7725.g0073295.el7 ceph 76 k 2019-11-28T21:45:33.127 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:45:33.127 INFO:teuthology.orchestra.run.smithi074.stdout:Transaction Summary 2019-11-28T21:45:33.127 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:45:33.128 INFO:teuthology.orchestra.run.smithi074.stdout:Install 1 Package 2019-11-28T21:45:33.128 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:45:33.128 INFO:teuthology.orchestra.run.smithi074.stdout:Total download size: 76 k 2019-11-28T21:45:33.128 INFO:teuthology.orchestra.run.smithi074.stdout:Installed size: 200 k 2019-11-28T21:45:33.131 INFO:teuthology.orchestra.run.smithi074.stdout:Downloading packages: 2019-11-28T21:45:33.430 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction check 2019-11-28T21:45:33.449 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction test 2019-11-28T21:45:33.451 INFO:teuthology.orchestra.run.smithi074.stdout:Transaction test succeeded 2019-11-28T21:45:33.451 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction 2019-11-28T21:45:33.956 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : 2:rbd-fuse-15.0.0-7725.g0073295.el7.x86_64 1/1 2019-11-28T21:45:34.489 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : 2:rbd-fuse-15.0.0-7725.g0073295.el7.x86_64 1/1 2019-11-28T21:45:34.489 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:45:34.489 INFO:teuthology.orchestra.run.smithi074.stdout:Installed: 2019-11-28T21:45:34.489 INFO:teuthology.orchestra.run.smithi074.stdout: rbd-fuse.x86_64 2:15.0.0-7725.g0073295.el7 2019-11-28T21:45:34.489 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:45:34.490 INFO:teuthology.orchestra.run.smithi074.stdout:Complete! 2019-11-28T21:45:34.615 DEBUG:teuthology.parallel:result is None 2019-11-28T21:45:34.615 INFO:teuthology.orchestra.run.smithi074:> sudo lsb_release -is 2019-11-28T21:45:34.733 INFO:teuthology.orchestra.run.smithi074.stdout:CentOS 2019-11-28T21:45:34.735 DEBUG:teuthology.misc:System to be installed: CentOS 2019-11-28T21:45:34.735 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&sha1=00732956b62306ff37a7f7c81af9db807aae2dc8 2019-11-28T21:45:34.890 INFO:teuthology.orchestra.run.smithi074:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2019-11-28T21:45:35.045 INFO:teuthology.orchestra.run.smithi074.stdout:15.0.0-7725.g0073295.el7 2019-11-28T21:45:35.045 INFO:teuthology.packaging:The installed version of ceph is 15.0.0-7725.g0073295.el7 2019-11-28T21:45:35.045 INFO:teuthology.task.install:The correct ceph version 15.0.0-7725.g0073295 is installed. 2019-11-28T21:45:35.046 INFO:teuthology.orchestra.run.smithi141:> sudo lsb_release -is 2019-11-28T21:45:35.207 INFO:teuthology.orchestra.run.smithi141.stdout:CentOS 2019-11-28T21:45:35.210 DEBUG:teuthology.misc:System to be installed: CentOS 2019-11-28T21:45:35.210 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&sha1=00732956b62306ff37a7f7c81af9db807aae2dc8 2019-11-28T21:45:35.381 INFO:teuthology.orchestra.run.smithi141:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2019-11-28T21:45:35.521 INFO:teuthology.orchestra.run.smithi141.stdout:15.0.0-7725.g0073295.el7 2019-11-28T21:45:35.521 INFO:teuthology.packaging:The installed version of ceph is 15.0.0-7725.g0073295.el7 2019-11-28T21:45:35.522 INFO:teuthology.task.install:The correct ceph version 15.0.0-7725.g0073295 is installed. 2019-11-28T21:45:35.522 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2019-11-28T21:45:35.522 INFO:teuthology.orchestra.run.smithi074:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2019-11-28T21:45:35.645 INFO:teuthology.orchestra.run.smithi141:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2019-11-28T21:45:35.767 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2019-11-28T21:45:35.768 INFO:teuthology.orchestra.run.smithi074:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2019-11-28T21:45:35.905 INFO:teuthology.orchestra.run.smithi074:> sudo chmod a=rx -- /usr/bin/daemon-helper 2019-11-28T21:45:35.999 INFO:teuthology.orchestra.run.smithi141:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2019-11-28T21:45:36.119 INFO:teuthology.orchestra.run.smithi141:> sudo chmod a=rx -- /usr/bin/daemon-helper 2019-11-28T21:45:36.221 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2019-11-28T21:45:36.222 INFO:teuthology.orchestra.run.smithi074:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2019-11-28T21:45:36.343 INFO:teuthology.orchestra.run.smithi074:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2019-11-28T21:45:36.449 INFO:teuthology.orchestra.run.smithi141:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2019-11-28T21:45:36.571 INFO:teuthology.orchestra.run.smithi141:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2019-11-28T21:45:36.661 INFO:teuthology.run_tasks:Running task ceph... 2019-11-28T21:45:36.728 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2019-11-28T21:45:36.728 INFO:teuthology.orchestra.run.smithi074:> sudo chmod 777 /var/log/ceph 2019-11-28T21:45:36.734 INFO:teuthology.orchestra.run.smithi141:> sudo chmod 777 /var/log/ceph 2019-11-28T21:45:36.854 INFO:tasks.ceph:Disabling ceph logrotate... 2019-11-28T21:45:36.854 INFO:teuthology.orchestra.run.smithi074:> sudo rm -f -- /etc/logrotate.d/ceph 2019-11-28T21:45:36.859 INFO:teuthology.orchestra.run.smithi141:> sudo rm -f -- /etc/logrotate.d/ceph 2019-11-28T21:45:36.964 INFO:tasks.ceph:Creating extra log directories... 2019-11-28T21:45:36.964 INFO:teuthology.orchestra.run.smithi074:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2019-11-28T21:45:36.968 INFO:teuthology.orchestra.run.smithi141:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2019-11-28T21:45:37.065 INFO:tasks.ceph:Creating ceph cluster ceph... 2019-11-28T21:45:37.065 INFO:tasks.ceph:config {'mon_bind_addrvec': True, 'block_journal': None, 'fs': 'xfs', 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'skip_mgr_daemons': False, 'cpu_profile': set([]), 'mkfs_options': None, 'tmpfs_journal': None, 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mount_options': None, 'conf': {'global': {'osd heartbeat grace': 40, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'mon client directed command retry': 5, 'osd_min_pg_log_entries': 10}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'bluestore fsck on mount': True, 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'debug rocksdb': 10, 'osd shutdown pgref assert': True, 'debug journal': 20, 'bluestore allocator': 'bitmap', 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'bdev async discard': True, 'osd fast shutdown': False, 'bluestore block size': 96636764160, 'debug filestore': 20, 'bdev enable discard': True, 'osd failsafe full ratio': 0.95}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon osd crush smoke test': False, 'debug ms': 1}, 'client': {'debug rgw': 20, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw lc debug interval': 10}}} 2019-11-28T21:45:37.065 INFO:tasks.ceph:ctx.config {'kernel': {'sha1': 'distro', 'kdb': True}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (2, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'sha1': 'distro', 'kdb': True}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'flavor': 'notcmalloc', 'sha1': '00732956b62306ff37a7f7c81af9db807aae2dc8'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'rgw/test_rgw_gc_log.sh']}}}, {'ragweed': {'client.0': {'rgw_server': 'client.0', 'stages': 'prepare,check', 'default-branch': 'ceph-master'}}}, {'s3tests-java': {'client.0': {'force-repo': 'https://github.com/ceph/java_s3tests.git', 'force-branch': 'master'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0', 'force-branch': 'ceph-master'}}}, {'swift': {'client.0': {'rgw_server': 'client.0'}}}], 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_wip-mkogan-testing/qa', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.9250', 'owner': 'scheduled_mkogan@teuthology', 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'targets': {'smithi074.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1WSZn/Y1eHFUHumqGDZdQthu+ATZh5fYN/ifDTtwoAHZAjmBkBfyl5lzV06QpXbMLYpEMRh2dj9Aor2nCBvJreXeyQSK9LGixONLe+BTMplNmLZ0+vFXgnoLWFyxn64/wy3NJkK7/6SWc48VUlfKYzJh7p3oVBo58AdI6W73E/pB7ThV8jNNt4WtVZZh0Ca0fHHRKRreXBYeZNV1tQ2NzyfQ/FoGJHNJ8YYiQj52zghQc1zZr0q4feAIOPRDgJTctAz1tq+Xftj1xDw4FujifZ0wEIiNN72jp3KiX3QT0x/xMN/GEAH/TamfKWFWr5845jtHroGJBIa7MrWsTGQEN', 'smithi141.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD7plSsfAHElH2clej6mYVxUt6yu55nJ1sT5UdnIPATLleew5xxKNW/uxeAJaYhzo9QeNlWERp513knnVesSDHvX0pMP7n5BJ3aU3CfIaX2RF7vkE3DmDYtNWW/0DwbBKp9B8yjhiyfgsxAOFqhD6dZ4jqwtPX3K3P5H6HKNXIs07geJf1xU4ZKpnqpmprwtP6xEQIt//I9AYaDpA2dG+HwWP8EGJ21MKeIDQThnbdoVuVAcoYLGpeCgWkm7+tTD2c4tfMXr6Vf2opIMtKCEVyiVd4mKVLJx07U3Vrwrcv9EsLKmoRsCS3eQrEe30KleVJRHQiP0r19nJlz0Wbuf2xb'}, 'job_id': '4550431', 'tube': 'smithi', 'suite_branch': 'wip-mkogan-testing', 'priority': 90, 'first_in_suite': False, 'branch': 'wip-mkogan-testing', 'suite': 'rgw:verify', 'email': 'mkogan@redhat.com', 'archive_path': '/home/teuthworker/archive/mkogan-2019-11-28_17:38:37-rgw:verify-wip-mkogan-testing-distro-basic-smithi/4550431', 'description': 'rgw:verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml}', 'nuke-on-error': True, 'repo': 'https://github.com/ceph/ceph-ci.git', 'last_in_suite': False, 'machine_type': 'smithi', 'teuthology_branch': 'master', 'sha1': '00732956b62306ff37a7f7c81af9db807aae2dc8', 'name': 'mkogan-2019-11-28_17:38:37-rgw:verify-wip-mkogan-testing-distro-basic-smithi', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '00732956b62306ff37a7f7c81af9db807aae2dc8', 'os_type': 'centos', 'overrides': {'s3tests': {'slow_backend': True}, 'ceph-deploy': {'fs': 'xfs', 'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'mon osd full ratio': 0.9, 'mon osd backfillfull_ratio': 0.85, 'bluestore fsck on mount': True, 'mon osd nearfull ratio': 0.8, 'debug bluestore': 20, 'debug bluefs': 20, 'osd objectstore': 'bluestore', 'bluestore block size': 96636764160, 'debug rocksdb': 10, 'bdev enable discard': True, 'osd failsafe full ratio': 0.95, 'bdev async discard': True}}}, 'rgw': {'frontend': 'civetweb', 'compression type': 'random', 'storage classes': 'LUKEWARM, FROZEN', 'ec-data-pool': True}, 'workunit': {'sha1': '00732956b62306ff37a7f7c81af9db807aae2dc8', 'branch': 'wip-mkogan-testing'}, 'ceph': {'conf': {'global': {'osd heartbeat grace': 40, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'mon client directed command retry': 5, 'osd_min_pg_log_entries': 10}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'bluestore fsck on mount': True, 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'debug rocksdb': 10, 'osd shutdown pgref assert': True, 'debug journal': 20, 'bluestore allocator': 'bitmap', 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'bdev async discard': True, 'osd fast shutdown': False, 'bluestore block size': 96636764160, 'debug filestore': 20, 'bdev enable discard': True, 'osd failsafe full ratio': 0.95}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon osd crush smoke test': False, 'debug ms': 1}, 'client': {'debug rgw': 20, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw lc debug interval': 10}}, 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes'], 'osd': ['--tool=memcheck']}, 'fs': 'xfs', 'sha1': '00732956b62306ff37a7f7c81af9db807aae2dc8'}, 'install': {'ceph': {'flavor': 'notcmalloc', 'sha1': '00732956b62306ff37a7f7c81af9db807aae2dc8'}}, 'admin_socket': {'branch': 'wip-mkogan-testing'}, 'thrashosds': {'bdev_inject_crash_probability': 0.5, 'bdev_inject_crash': 2}}} 2019-11-28T21:45:37.066 INFO:teuthology.orchestra.run.smithi074:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2019-11-28T21:45:37.070 INFO:teuthology.orchestra.run.smithi141:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2019-11-28T21:45:37.132 INFO:teuthology.orchestra.run.smithi074:> sudo install -d -m0777 -- /var/run/ceph 2019-11-28T21:45:37.137 INFO:teuthology.orchestra.run.smithi141:> sudo install -d -m0777 -- /var/run/ceph 2019-11-28T21:45:37.283 DEBUG:teuthology.orchestra.remote:smithi074:/scratch_devs is 72B 2019-11-28T21:45:37.344 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-11-28T21:45:37.344 INFO:teuthology.orchestra.run.smithi074:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2019-11-28T21:45:37.417 INFO:teuthology.orchestra.run.smithi074.stdout: File: ‘/dev/vg_nvme/lv_4’ -> ‘../dm-1’ 2019-11-28T21:45:37.417 INFO:teuthology.orchestra.run.smithi074.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-28T21:45:37.417 INFO:teuthology.orchestra.run.smithi074.stdout:Device: 5h/5d Inode: 89922 Links: 1 2019-11-28T21:45:37.417 INFO:teuthology.orchestra.run.smithi074.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-28T21:45:37.417 INFO:teuthology.orchestra.run.smithi074.stdout:Context: system_u:object_r:device_t:s0 2019-11-28T21:45:37.418 INFO:teuthology.orchestra.run.smithi074.stdout:Access: 2019-11-28 21:44:30.004640669 +0000 2019-11-28T21:45:37.418 INFO:teuthology.orchestra.run.smithi074.stdout:Modify: 2019-11-28 21:42:40.900237582 +0000 2019-11-28T21:45:37.418 INFO:teuthology.orchestra.run.smithi074.stdout:Change: 2019-11-28 21:42:40.900237582 +0000 2019-11-28T21:45:37.418 INFO:teuthology.orchestra.run.smithi074.stdout: Birth: - 2019-11-28T21:45:37.442 INFO:teuthology.orchestra.run.smithi074.stderr:1+0 records in 2019-11-28T21:45:37.442 INFO:teuthology.orchestra.run.smithi074.stderr:1+0 records out 2019-11-28T21:45:37.442 INFO:teuthology.orchestra.run.smithi074.stderr:512 bytes (512 B) copied, 0.000427512 s, 1.2 MB/s 2019-11-28T21:45:37.445 INFO:teuthology.orchestra.run.smithi074:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2019-11-28T21:45:37.507 INFO:teuthology.orchestra.run.smithi074.stdout: File: ‘/dev/vg_nvme/lv_3’ -> ‘../dm-2’ 2019-11-28T21:45:37.508 INFO:teuthology.orchestra.run.smithi074.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-28T21:45:37.508 INFO:teuthology.orchestra.run.smithi074.stdout:Device: 5h/5d Inode: 106776 Links: 1 2019-11-28T21:45:37.508 INFO:teuthology.orchestra.run.smithi074.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-28T21:45:37.508 INFO:teuthology.orchestra.run.smithi074.stdout:Context: system_u:object_r:device_t:s0 2019-11-28T21:45:37.508 INFO:teuthology.orchestra.run.smithi074.stdout:Access: 2019-11-28 21:44:30.004640669 +0000 2019-11-28T21:45:37.508 INFO:teuthology.orchestra.run.smithi074.stdout:Modify: 2019-11-28 21:42:41.355227181 +0000 2019-11-28T21:45:37.509 INFO:teuthology.orchestra.run.smithi074.stdout:Change: 2019-11-28 21:42:41.355227181 +0000 2019-11-28T21:45:37.509 INFO:teuthology.orchestra.run.smithi074.stdout: Birth: - 2019-11-28T21:45:37.525 INFO:teuthology.orchestra.run.smithi074.stderr:1+0 records in 2019-11-28T21:45:37.525 INFO:teuthology.orchestra.run.smithi074.stderr:1+0 records out 2019-11-28T21:45:37.525 INFO:teuthology.orchestra.run.smithi074.stderr:512 bytes (512 B) copied, 0.00035997 s, 1.4 MB/s 2019-11-28T21:45:37.528 INFO:teuthology.orchestra.run.smithi074:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2019-11-28T21:45:37.582 INFO:teuthology.orchestra.run.smithi074.stdout: File: ‘/dev/vg_nvme/lv_2’ -> ‘../dm-3’ 2019-11-28T21:45:37.583 INFO:teuthology.orchestra.run.smithi074.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-28T21:45:37.583 INFO:teuthology.orchestra.run.smithi074.stdout:Device: 5h/5d Inode: 99991 Links: 1 2019-11-28T21:45:37.583 INFO:teuthology.orchestra.run.smithi074.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-28T21:45:37.583 INFO:teuthology.orchestra.run.smithi074.stdout:Context: system_u:object_r:device_t:s0 2019-11-28T21:45:37.583 INFO:teuthology.orchestra.run.smithi074.stdout:Access: 2019-11-28 21:44:30.004640669 +0000 2019-11-28T21:45:37.583 INFO:teuthology.orchestra.run.smithi074.stdout:Modify: 2019-11-28 21:42:41.804216918 +0000 2019-11-28T21:45:37.584 INFO:teuthology.orchestra.run.smithi074.stdout:Change: 2019-11-28 21:42:41.804216918 +0000 2019-11-28T21:45:37.584 INFO:teuthology.orchestra.run.smithi074.stdout: Birth: - 2019-11-28T21:45:37.601 INFO:teuthology.orchestra.run.smithi074.stderr:1+0 records in 2019-11-28T21:45:37.601 INFO:teuthology.orchestra.run.smithi074.stderr:1+0 records out 2019-11-28T21:45:37.601 INFO:teuthology.orchestra.run.smithi074.stderr:512 bytes (512 B) copied, 0.000316751 s, 1.6 MB/s 2019-11-28T21:45:37.605 INFO:teuthology.orchestra.run.smithi074:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2019-11-28T21:45:37.659 INFO:teuthology.orchestra.run.smithi074.stdout: File: ‘/dev/vg_nvme/lv_1’ -> ‘../dm-4’ 2019-11-28T21:45:37.660 INFO:teuthology.orchestra.run.smithi074.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-28T21:45:37.660 INFO:teuthology.orchestra.run.smithi074.stdout:Device: 5h/5d Inode: 107869 Links: 1 2019-11-28T21:45:37.660 INFO:teuthology.orchestra.run.smithi074.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-28T21:45:37.660 INFO:teuthology.orchestra.run.smithi074.stdout:Context: system_u:object_r:device_t:s0 2019-11-28T21:45:37.660 INFO:teuthology.orchestra.run.smithi074.stdout:Access: 2019-11-28 21:44:30.004640669 +0000 2019-11-28T21:45:37.660 INFO:teuthology.orchestra.run.smithi074.stdout:Modify: 2019-11-28 21:42:42.265206380 +0000 2019-11-28T21:45:37.660 INFO:teuthology.orchestra.run.smithi074.stdout:Change: 2019-11-28 21:42:42.265206380 +0000 2019-11-28T21:45:37.661 INFO:teuthology.orchestra.run.smithi074.stdout: Birth: - 2019-11-28T21:45:37.673 INFO:teuthology.orchestra.run.smithi074.stderr:1+0 records in 2019-11-28T21:45:37.674 INFO:teuthology.orchestra.run.smithi074.stderr:1+0 records out 2019-11-28T21:45:37.674 INFO:teuthology.orchestra.run.smithi074.stderr:512 bytes (512 B) copied, 0.000329029 s, 1.6 MB/s 2019-11-28T21:45:37.677 INFO:tasks.ceph:fs option selected, checking for scratch devs 2019-11-28T21:45:37.677 INFO:tasks.ceph:found devs: ['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-11-28T21:45:37.677 WARNING:teuthology.misc:Entering get_wwn_id_map, a deprecated function that will be removed 2019-11-28T21:45:37.677 INFO:tasks.ceph:dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-11-28T21:45:37.772 DEBUG:teuthology.orchestra.remote:smithi141:/scratch_devs is 72B 2019-11-28T21:45:37.850 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-11-28T21:45:37.850 INFO:teuthology.orchestra.run.smithi141:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2019-11-28T21:45:37.926 INFO:teuthology.orchestra.run.smithi141.stdout: File: ‘/dev/vg_nvme/lv_4’ -> ‘../dm-1’ 2019-11-28T21:45:37.926 INFO:teuthology.orchestra.run.smithi141.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-28T21:45:37.926 INFO:teuthology.orchestra.run.smithi141.stdout:Device: 5h/5d Inode: 107667 Links: 1 2019-11-28T21:45:37.926 INFO:teuthology.orchestra.run.smithi141.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-28T21:45:37.926 INFO:teuthology.orchestra.run.smithi141.stdout:Context: system_u:object_r:device_t:s0 2019-11-28T21:45:37.927 INFO:teuthology.orchestra.run.smithi141.stdout:Access: 2019-11-28 21:44:25.535771170 +0000 2019-11-28T21:45:37.927 INFO:teuthology.orchestra.run.smithi141.stdout:Modify: 2019-11-28 21:42:40.969588634 +0000 2019-11-28T21:45:37.927 INFO:teuthology.orchestra.run.smithi141.stdout:Change: 2019-11-28 21:42:40.969588634 +0000 2019-11-28T21:45:37.927 INFO:teuthology.orchestra.run.smithi141.stdout: Birth: - 2019-11-28T21:45:37.955 INFO:teuthology.orchestra.run.smithi141.stderr:1+0 records in 2019-11-28T21:45:37.957 INFO:teuthology.orchestra.run.smithi141.stderr:1+0 records out 2019-11-28T21:45:37.957 INFO:teuthology.orchestra.run.smithi141.stderr:512 bytes (512 B) copied, 0.000524485 s, 976 kB/s 2019-11-28T21:45:37.959 INFO:teuthology.orchestra.run.smithi141:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2019-11-28T21:45:38.113 INFO:teuthology.orchestra.run.smithi141.stdout: File: ‘/dev/vg_nvme/lv_3’ -> ‘../dm-2’ 2019-11-28T21:45:38.114 INFO:teuthology.orchestra.run.smithi141.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-28T21:45:38.114 INFO:teuthology.orchestra.run.smithi141.stdout:Device: 5h/5d Inode: 106990 Links: 1 2019-11-28T21:45:38.114 INFO:teuthology.orchestra.run.smithi141.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-28T21:45:38.114 INFO:teuthology.orchestra.run.smithi141.stdout:Context: system_u:object_r:device_t:s0 2019-11-28T21:45:38.114 INFO:teuthology.orchestra.run.smithi141.stdout:Access: 2019-11-28 21:44:25.535771170 +0000 2019-11-28T21:45:38.114 INFO:teuthology.orchestra.run.smithi141.stdout:Modify: 2019-11-28 21:42:41.427578409 +0000 2019-11-28T21:45:38.114 INFO:teuthology.orchestra.run.smithi141.stdout:Change: 2019-11-28 21:42:41.427578409 +0000 2019-11-28T21:45:38.115 INFO:teuthology.orchestra.run.smithi141.stdout: Birth: - 2019-11-28T21:45:38.143 INFO:teuthology.orchestra.run.smithi141.stderr:1+0 records in 2019-11-28T21:45:38.143 INFO:teuthology.orchestra.run.smithi141.stderr:1+0 records out 2019-11-28T21:45:38.144 INFO:teuthology.orchestra.run.smithi141.stderr:512 bytes (512 B) copied, 0.000430654 s, 1.2 MB/s 2019-11-28T21:45:38.147 INFO:teuthology.orchestra.run.smithi141:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2019-11-28T21:45:38.229 INFO:teuthology.orchestra.run.smithi141.stdout: File: ‘/dev/vg_nvme/lv_2’ -> ‘../dm-3’ 2019-11-28T21:45:38.230 INFO:teuthology.orchestra.run.smithi141.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-28T21:45:38.230 INFO:teuthology.orchestra.run.smithi141.stdout:Device: 5h/5d Inode: 105360 Links: 1 2019-11-28T21:45:38.230 INFO:teuthology.orchestra.run.smithi141.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-28T21:45:38.230 INFO:teuthology.orchestra.run.smithi141.stdout:Context: system_u:object_r:device_t:s0 2019-11-28T21:45:38.230 INFO:teuthology.orchestra.run.smithi141.stdout:Access: 2019-11-28 21:44:25.535771170 +0000 2019-11-28T21:45:38.230 INFO:teuthology.orchestra.run.smithi141.stdout:Modify: 2019-11-28 21:42:41.933567113 +0000 2019-11-28T21:45:38.231 INFO:teuthology.orchestra.run.smithi141.stdout:Change: 2019-11-28 21:42:41.933567113 +0000 2019-11-28T21:45:38.231 INFO:teuthology.orchestra.run.smithi141.stdout: Birth: - 2019-11-28T21:45:38.256 INFO:teuthology.orchestra.run.smithi141.stderr:1+0 records in 2019-11-28T21:45:38.256 INFO:teuthology.orchestra.run.smithi141.stderr:1+0 records out 2019-11-28T21:45:38.256 INFO:teuthology.orchestra.run.smithi141.stderr:512 bytes (512 B) copied, 0.000384214 s, 1.3 MB/s 2019-11-28T21:45:38.262 INFO:teuthology.orchestra.run.smithi141:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2019-11-28T21:45:38.339 INFO:teuthology.orchestra.run.smithi141.stdout: File: ‘/dev/vg_nvme/lv_1’ -> ‘../dm-4’ 2019-11-28T21:45:38.340 INFO:teuthology.orchestra.run.smithi141.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-28T21:45:38.340 INFO:teuthology.orchestra.run.smithi141.stdout:Device: 5h/5d Inode: 109625 Links: 1 2019-11-28T21:45:38.340 INFO:teuthology.orchestra.run.smithi141.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-28T21:45:38.340 INFO:teuthology.orchestra.run.smithi141.stdout:Context: system_u:object_r:device_t:s0 2019-11-28T21:45:38.340 INFO:teuthology.orchestra.run.smithi141.stdout:Access: 2019-11-28 21:44:25.535771170 +0000 2019-11-28T21:45:38.340 INFO:teuthology.orchestra.run.smithi141.stdout:Modify: 2019-11-28 21:42:42.404556598 +0000 2019-11-28T21:45:38.341 INFO:teuthology.orchestra.run.smithi141.stdout:Change: 2019-11-28 21:42:42.404556598 +0000 2019-11-28T21:45:38.341 INFO:teuthology.orchestra.run.smithi141.stdout: Birth: - 2019-11-28T21:45:38.366 INFO:teuthology.orchestra.run.smithi141.stderr:1+0 records in 2019-11-28T21:45:38.367 INFO:teuthology.orchestra.run.smithi141.stderr:1+0 records out 2019-11-28T21:45:38.367 INFO:teuthology.orchestra.run.smithi141.stderr:512 bytes (512 B) copied, 0.000360831 s, 1.4 MB/s 2019-11-28T21:45:38.371 INFO:tasks.ceph:fs option selected, checking for scratch devs 2019-11-28T21:45:38.371 INFO:tasks.ceph:found devs: ['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-11-28T21:45:38.371 WARNING:teuthology.misc:Entering get_wwn_id_map, a deprecated function that will be removed 2019-11-28T21:45:38.371 INFO:tasks.ceph:dev map: {'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-11-28T21:45:38.372 INFO:tasks.ceph:Generating config... 2019-11-28T21:45:38.373 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2019-11-28T21:45:38.373 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2019-11-28T21:45:38.373 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2019-11-28T21:45:38.373 INFO:tasks.ceph:[global] mon client directed command retry = 5 2019-11-28T21:45:38.373 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2019-11-28T21:45:38.373 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2019-11-28T21:45:38.374 INFO:tasks.ceph:[osd] debug ms = 1 2019-11-28T21:45:38.374 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2019-11-28T21:45:38.374 INFO:tasks.ceph:[osd] debug osd = 25 2019-11-28T21:45:38.374 INFO:tasks.ceph:[osd] debug bluestore = 20 2019-11-28T21:45:38.374 INFO:tasks.ceph:[osd] debug bluefs = 20 2019-11-28T21:45:38.374 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2019-11-28T21:45:38.374 INFO:tasks.ceph:[osd] debug rocksdb = 10 2019-11-28T21:45:38.374 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2019-11-28T21:45:38.375 INFO:tasks.ceph:[osd] debug journal = 20 2019-11-28T21:45:38.375 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2019-11-28T21:45:38.375 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2019-11-28T21:45:38.375 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2019-11-28T21:45:38.375 INFO:tasks.ceph:[osd] bdev async discard = True 2019-11-28T21:45:38.376 INFO:tasks.ceph:[osd] osd fast shutdown = False 2019-11-28T21:45:38.376 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2019-11-28T21:45:38.376 INFO:tasks.ceph:[osd] debug filestore = 20 2019-11-28T21:45:38.376 INFO:tasks.ceph:[osd] bdev enable discard = True 2019-11-28T21:45:38.376 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2019-11-28T21:45:38.376 INFO:tasks.ceph:[mon] debug mon = 20 2019-11-28T21:45:38.376 INFO:tasks.ceph:[mon] debug paxos = 20 2019-11-28T21:45:38.377 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2019-11-28T21:45:38.377 INFO:tasks.ceph:[mon] debug ms = 1 2019-11-28T21:45:38.377 INFO:tasks.ceph:[client] debug rgw = 20 2019-11-28T21:45:38.377 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2019-11-28T21:45:38.377 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2019-11-28T21:45:38.377 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2019-11-28T21:45:38.377 INFO:tasks.ceph:[client] rgw lc debug interval = 10 2019-11-28T21:45:38.377 INFO:tasks.ceph:Setting up mon.a... 2019-11-28T21:45:38.378 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2019-11-28T21:45:38.553 INFO:teuthology.orchestra.run.smithi074.stdout:creating /etc/ceph/ceph.keyring 2019-11-28T21:45:38.556 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2019-11-28T21:45:38.685 INFO:teuthology.orchestra.run.smithi074:> sudo chmod 0644 /etc/ceph/ceph.keyring 2019-11-28T21:45:38.788 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.74'), ('mon.c', '[v2:172.21.15.74:3301,v1:172.21.15.74:6790]'), ('mon.b', '172.21.15.141')] 2019-11-28T21:45:38.788 INFO:teuthology.orchestra.run.smithi074:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.74 --addv c '[v2:172.21.15.74:3301,v1:172.21.15.74:6790]' --add b 172.21.15.141 --print /home/ubuntu/cephtest/ceph.monmap 2019-11-28T21:45:38.928 INFO:teuthology.orchestra.run.smithi074.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2019-11-28T21:45:38.928 INFO:teuthology.orchestra.run.smithi074.stdout:monmaptool: generated fsid cecd8621-e0c7-45c8-9e74-513fdbad61b1 2019-11-28T21:45:38.928 INFO:teuthology.orchestra.run.smithi074.stdout:epoch 0 2019-11-28T21:45:38.928 INFO:teuthology.orchestra.run.smithi074.stdout:fsid cecd8621-e0c7-45c8-9e74-513fdbad61b1 2019-11-28T21:45:38.929 INFO:teuthology.orchestra.run.smithi074.stdout:last_changed 2019-11-28T21:45:38.929593+0000 2019-11-28T21:45:38.929 INFO:teuthology.orchestra.run.smithi074.stdout:created 2019-11-28T21:45:38.929593+0000 2019-11-28T21:45:38.929 INFO:teuthology.orchestra.run.smithi074.stdout:min_mon_release 0 (unknown) 2019-11-28T21:45:38.929 INFO:teuthology.orchestra.run.smithi074.stdout:0: [v2:172.21.15.74:3300/0,v1:172.21.15.74:6789/0] mon.a 2019-11-28T21:45:38.929 INFO:teuthology.orchestra.run.smithi074.stdout:1: [v2:172.21.15.141:3300/0,v1:172.21.15.141:6789/0] mon.b 2019-11-28T21:45:38.929 INFO:teuthology.orchestra.run.smithi074.stdout:2: [v2:172.21.15.74:3301/0,v1:172.21.15.74:6790/0] mon.c 2019-11-28T21:45:38.929 INFO:teuthology.orchestra.run.smithi074.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2019-11-28T21:45:38.931 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID cecd8621-e0c7-45c8-9e74-513fdbad61b1... 2019-11-28T21:45:38.932 INFO:teuthology.orchestra.run.smithi074:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo python -c 'import shutil, sys; shutil.copyfileobj(sys.stdin, file(sys.argv[1], "wb"))' /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf 2019-11-28T21:45:38.937 INFO:teuthology.orchestra.run.smithi141:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo python -c 'import shutil, sys; shutil.copyfileobj(sys.stdin, file(sys.argv[1], "wb"))' /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf 2019-11-28T21:45:39.158 INFO:tasks.ceph:Creating admin key on mon.a... 2019-11-28T21:45:39.158 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2019-11-28T21:45:39.336 INFO:tasks.ceph:Copying monmap to all nodes... 2019-11-28T21:45:39.427 DEBUG:teuthology.orchestra.remote:smithi074:/etc/ceph/ceph.keyring is 206B 2019-11-28T21:45:39.594 DEBUG:teuthology.orchestra.remote:smithi074:/home/ubuntu/cephtest/ceph.monmap is 379B 2019-11-28T21:45:39.684 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi074.front.sepia.ceph.com 2019-11-28T21:45:39.684 INFO:teuthology.orchestra.run.smithi074:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2019-11-28T21:45:39.807 INFO:teuthology.orchestra.run.smithi074:> cat > /home/ubuntu/cephtest/ceph.monmap 2019-11-28T21:45:39.866 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi141.front.sepia.ceph.com 2019-11-28T21:45:39.867 INFO:teuthology.orchestra.run.smithi141:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2019-11-28T21:45:40.023 INFO:teuthology.orchestra.run.smithi141:> cat > /home/ubuntu/cephtest/ceph.monmap 2019-11-28T21:45:40.101 INFO:tasks.ceph:Setting up mon nodes... 2019-11-28T21:45:40.101 INFO:tasks.ceph:Setting up mgr nodes... 2019-11-28T21:45:40.102 INFO:teuthology.orchestra.run.smithi074:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2019-11-28T21:45:40.276 INFO:teuthology.orchestra.run.smithi074.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2019-11-28T21:45:40.281 INFO:teuthology.orchestra.run.smithi141:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2019-11-28T21:45:40.493 INFO:teuthology.orchestra.run.smithi141.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2019-11-28T21:45:40.498 INFO:tasks.ceph:Setting up mds nodes... 2019-11-28T21:45:40.498 INFO:tasks.ceph_client:Setting up client nodes... 2019-11-28T21:45:40.499 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2019-11-28T21:45:40.644 INFO:teuthology.orchestra.run.smithi074.stdout:creating /etc/ceph/ceph.client.0.keyring 2019-11-28T21:45:40.676 INFO:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2019-11-28T21:45:40.821 INFO:teuthology.orchestra.run.smithi141.stdout:creating /etc/ceph/ceph.client.1.keyring 2019-11-28T21:45:40.851 INFO:tasks.ceph:Running mkfs on osd nodes... 2019-11-28T21:45:40.851 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi074.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi141.front.sepia.ceph.com'): {'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'}} 2019-11-28T21:45:40.851 INFO:teuthology.orchestra.run.smithi074:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2019-11-28T21:45:40.966 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-11-28T21:45:40.966 INFO:tasks.ceph:{} 2019-11-28T21:45:40.966 INFO:tasks.ceph:osd.0 2019-11-28T21:45:40.967 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi074.front.sepia.ceph.com 2019-11-28T21:45:40.967 INFO:teuthology.orchestra.run.smithi074:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2019-11-28T21:45:41.559 INFO:teuthology.orchestra.run.smithi074.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2019-11-28T21:45:41.559 INFO:teuthology.orchestra.run.smithi074.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-28T21:45:41.559 INFO:teuthology.orchestra.run.smithi074.stdout: = crc=1 finobt=0, sparse=0 2019-11-28T21:45:41.560 INFO:teuthology.orchestra.run.smithi074.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-28T21:45:41.560 INFO:teuthology.orchestra.run.smithi074.stdout: = sunit=0 swidth=0 blks 2019-11-28T21:45:41.560 INFO:teuthology.orchestra.run.smithi074.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-28T21:45:41.560 INFO:teuthology.orchestra.run.smithi074.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-28T21:45:41.560 INFO:teuthology.orchestra.run.smithi074.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-28T21:45:41.560 INFO:teuthology.orchestra.run.smithi074.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-28T21:45:41.562 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi074.front.sepia.ceph.com -o noatime 2019-11-28T21:45:41.562 INFO:teuthology.orchestra.run.smithi074:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0 2019-11-28T21:45:41.720 INFO:teuthology.orchestra.run.smithi074:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2019-11-28T21:45:41.820 INFO:teuthology.orchestra.run.smithi074:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2019-11-28T21:45:41.908 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-11-28T21:45:41.908 INFO:tasks.ceph:{} 2019-11-28T21:45:41.908 INFO:tasks.ceph:osd.1 2019-11-28T21:45:41.908 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi074.front.sepia.ceph.com 2019-11-28T21:45:41.908 INFO:teuthology.orchestra.run.smithi074:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2019-11-28T21:45:42.443 INFO:teuthology.orchestra.run.smithi074.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2019-11-28T21:45:42.443 INFO:teuthology.orchestra.run.smithi074.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-28T21:45:42.443 INFO:teuthology.orchestra.run.smithi074.stdout: = crc=1 finobt=0, sparse=0 2019-11-28T21:45:42.443 INFO:teuthology.orchestra.run.smithi074.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-28T21:45:42.444 INFO:teuthology.orchestra.run.smithi074.stdout: = sunit=0 swidth=0 blks 2019-11-28T21:45:42.444 INFO:teuthology.orchestra.run.smithi074.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-28T21:45:42.444 INFO:teuthology.orchestra.run.smithi074.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-28T21:45:42.444 INFO:teuthology.orchestra.run.smithi074.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-28T21:45:42.444 INFO:teuthology.orchestra.run.smithi074.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-28T21:45:42.445 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi074.front.sepia.ceph.com -o noatime 2019-11-28T21:45:42.446 INFO:teuthology.orchestra.run.smithi074:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2019-11-28T21:45:42.573 INFO:teuthology.orchestra.run.smithi074:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2019-11-28T21:45:42.651 INFO:teuthology.orchestra.run.smithi074:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2019-11-28T21:45:42.731 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-11-28T21:45:42.731 INFO:tasks.ceph:{} 2019-11-28T21:45:42.731 INFO:tasks.ceph:osd.2 2019-11-28T21:45:42.731 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi074.front.sepia.ceph.com 2019-11-28T21:45:42.732 INFO:teuthology.orchestra.run.smithi074:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2019-11-28T21:45:43.305 INFO:teuthology.orchestra.run.smithi074.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2019-11-28T21:45:43.305 INFO:teuthology.orchestra.run.smithi074.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-28T21:45:43.305 INFO:teuthology.orchestra.run.smithi074.stdout: = crc=1 finobt=0, sparse=0 2019-11-28T21:45:43.305 INFO:teuthology.orchestra.run.smithi074.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-28T21:45:43.305 INFO:teuthology.orchestra.run.smithi074.stdout: = sunit=0 swidth=0 blks 2019-11-28T21:45:43.306 INFO:teuthology.orchestra.run.smithi074.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-28T21:45:43.306 INFO:teuthology.orchestra.run.smithi074.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-28T21:45:43.306 INFO:teuthology.orchestra.run.smithi074.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-28T21:45:43.306 INFO:teuthology.orchestra.run.smithi074.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-28T21:45:43.308 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi074.front.sepia.ceph.com -o noatime 2019-11-28T21:45:43.308 INFO:teuthology.orchestra.run.smithi074:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2019-11-28T21:45:43.490 INFO:teuthology.orchestra.run.smithi074:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2019-11-28T21:45:43.603 INFO:teuthology.orchestra.run.smithi074:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2019-11-28T21:45:43.701 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-11-28T21:45:43.702 INFO:tasks.ceph:{} 2019-11-28T21:45:43.702 INFO:tasks.ceph:osd.3 2019-11-28T21:45:43.702 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi074.front.sepia.ceph.com 2019-11-28T21:45:43.702 INFO:teuthology.orchestra.run.smithi074:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2019-11-28T21:45:44.270 INFO:teuthology.orchestra.run.smithi074.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2019-11-28T21:45:44.271 INFO:teuthology.orchestra.run.smithi074.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-28T21:45:44.271 INFO:teuthology.orchestra.run.smithi074.stdout: = crc=1 finobt=0, sparse=0 2019-11-28T21:45:44.271 INFO:teuthology.orchestra.run.smithi074.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-28T21:45:44.271 INFO:teuthology.orchestra.run.smithi074.stdout: = sunit=0 swidth=0 blks 2019-11-28T21:45:44.271 INFO:teuthology.orchestra.run.smithi074.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-28T21:45:44.272 INFO:teuthology.orchestra.run.smithi074.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-28T21:45:44.272 INFO:teuthology.orchestra.run.smithi074.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-28T21:45:44.272 INFO:teuthology.orchestra.run.smithi074.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-28T21:45:44.274 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi074.front.sepia.ceph.com -o noatime 2019-11-28T21:45:44.274 INFO:teuthology.orchestra.run.smithi074:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2019-11-28T21:45:44.405 INFO:teuthology.orchestra.run.smithi074:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2019-11-28T21:45:44.496 INFO:teuthology.orchestra.run.smithi074:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-28T21:45:44.598 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:45:44.597+0000 7fb528b23b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2019-11-28T21:45:44.599 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:45:44.598+0000 7fb528b23b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2019-11-28T21:45:44.599 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:45:44.598+0000 7fb528b23b40 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2019-11-28T21:45:44.599 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:45:44.598+0000 7fb528b23b40 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2019-11-28T21:45:44.599 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:45:44.598+0000 7fb528b23b40 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2019-11-28T21:45:44.599 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:45:44.598+0000 7fb528b23b40 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2019-11-28T21:45:46.908 INFO:teuthology.orchestra.run.smithi074:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2019-11-28T21:45:47.030 INFO:teuthology.orchestra.run.smithi074:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-28T21:45:47.177 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:45:47.177+0000 7f36b3570b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2019-11-28T21:45:47.178 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:45:47.178+0000 7f36b3570b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2019-11-28T21:45:47.178 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:45:47.178+0000 7f36b3570b40 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2019-11-28T21:45:47.178 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:45:47.178+0000 7f36b3570b40 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2019-11-28T21:45:47.179 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:45:47.178+0000 7f36b3570b40 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2019-11-28T21:45:47.179 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:45:47.179+0000 7f36b3570b40 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2019-11-28T21:45:49.582 INFO:teuthology.orchestra.run.smithi074:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2019-11-28T21:45:49.698 INFO:teuthology.orchestra.run.smithi074:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-28T21:45:49.850 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:45:49.850+0000 7f84b04c5b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2019-11-28T21:45:49.850 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:45:49.851+0000 7f84b04c5b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2019-11-28T21:45:49.851 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:45:49.851+0000 7f84b04c5b40 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2019-11-28T21:45:49.851 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:45:49.851+0000 7f84b04c5b40 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2019-11-28T21:45:49.851 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:45:49.851+0000 7f84b04c5b40 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2019-11-28T21:45:49.851 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:45:49.852+0000 7f84b04c5b40 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2019-11-28T21:45:52.159 INFO:teuthology.orchestra.run.smithi074:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2019-11-28T21:45:52.279 INFO:teuthology.orchestra.run.smithi074:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-28T21:45:52.430 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:45:52.430+0000 7f6820df1b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2019-11-28T21:45:52.430 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:45:52.430+0000 7f6820df1b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2019-11-28T21:45:52.431 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:45:52.431+0000 7f6820df1b40 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2019-11-28T21:45:52.431 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:45:52.431+0000 7f6820df1b40 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2019-11-28T21:45:52.431 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:45:52.431+0000 7f6820df1b40 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2019-11-28T21:45:52.432 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:45:52.432+0000 7f6820df1b40 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2019-11-28T21:45:54.739 INFO:teuthology.orchestra.run.smithi074:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2019-11-28T21:45:54.859 INFO:teuthology.orchestra.run.smithi141:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2019-11-28T21:45:54.999 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-11-28T21:45:54.999 INFO:tasks.ceph:{} 2019-11-28T21:45:54.999 INFO:tasks.ceph:osd.4 2019-11-28T21:45:55.000 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi141.front.sepia.ceph.com 2019-11-28T21:45:55.000 INFO:teuthology.orchestra.run.smithi141:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2019-11-28T21:45:55.566 INFO:teuthology.orchestra.run.smithi141.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2019-11-28T21:45:55.566 INFO:teuthology.orchestra.run.smithi141.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-28T21:45:55.566 INFO:teuthology.orchestra.run.smithi141.stdout: = crc=1 finobt=0, sparse=0 2019-11-28T21:45:55.567 INFO:teuthology.orchestra.run.smithi141.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-28T21:45:55.567 INFO:teuthology.orchestra.run.smithi141.stdout: = sunit=0 swidth=0 blks 2019-11-28T21:45:55.567 INFO:teuthology.orchestra.run.smithi141.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-28T21:45:55.567 INFO:teuthology.orchestra.run.smithi141.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-28T21:45:55.567 INFO:teuthology.orchestra.run.smithi141.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-28T21:45:55.567 INFO:teuthology.orchestra.run.smithi141.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-28T21:45:55.568 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi141.front.sepia.ceph.com -o noatime 2019-11-28T21:45:55.569 INFO:teuthology.orchestra.run.smithi141:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4 2019-11-28T21:45:55.722 INFO:teuthology.orchestra.run.smithi141:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2019-11-28T21:45:55.822 INFO:teuthology.orchestra.run.smithi141:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2019-11-28T21:45:55.902 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-11-28T21:45:55.902 INFO:tasks.ceph:{} 2019-11-28T21:45:55.903 INFO:tasks.ceph:osd.5 2019-11-28T21:45:55.903 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi141.front.sepia.ceph.com 2019-11-28T21:45:55.903 INFO:teuthology.orchestra.run.smithi141:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2019-11-28T21:45:56.432 INFO:teuthology.orchestra.run.smithi141.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2019-11-28T21:45:56.432 INFO:teuthology.orchestra.run.smithi141.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-28T21:45:56.432 INFO:teuthology.orchestra.run.smithi141.stdout: = crc=1 finobt=0, sparse=0 2019-11-28T21:45:56.432 INFO:teuthology.orchestra.run.smithi141.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-28T21:45:56.432 INFO:teuthology.orchestra.run.smithi141.stdout: = sunit=0 swidth=0 blks 2019-11-28T21:45:56.433 INFO:teuthology.orchestra.run.smithi141.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-28T21:45:56.433 INFO:teuthology.orchestra.run.smithi141.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-28T21:45:56.433 INFO:teuthology.orchestra.run.smithi141.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-28T21:45:56.433 INFO:teuthology.orchestra.run.smithi141.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-28T21:45:56.434 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi141.front.sepia.ceph.com -o noatime 2019-11-28T21:45:56.435 INFO:teuthology.orchestra.run.smithi141:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-5 2019-11-28T21:45:56.579 INFO:teuthology.orchestra.run.smithi141:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2019-11-28T21:45:56.698 INFO:teuthology.orchestra.run.smithi141:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2019-11-28T21:45:56.806 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-11-28T21:45:56.806 INFO:tasks.ceph:{} 2019-11-28T21:45:56.806 INFO:tasks.ceph:osd.6 2019-11-28T21:45:56.806 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi141.front.sepia.ceph.com 2019-11-28T21:45:56.806 INFO:teuthology.orchestra.run.smithi141:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2019-11-28T21:45:57.401 INFO:teuthology.orchestra.run.smithi141.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2019-11-28T21:45:57.401 INFO:teuthology.orchestra.run.smithi141.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-28T21:45:57.401 INFO:teuthology.orchestra.run.smithi141.stdout: = crc=1 finobt=0, sparse=0 2019-11-28T21:45:57.401 INFO:teuthology.orchestra.run.smithi141.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-28T21:45:57.401 INFO:teuthology.orchestra.run.smithi141.stdout: = sunit=0 swidth=0 blks 2019-11-28T21:45:57.402 INFO:teuthology.orchestra.run.smithi141.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-28T21:45:57.402 INFO:teuthology.orchestra.run.smithi141.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-28T21:45:57.402 INFO:teuthology.orchestra.run.smithi141.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-28T21:45:57.402 INFO:teuthology.orchestra.run.smithi141.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-28T21:45:57.404 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi141.front.sepia.ceph.com -o noatime 2019-11-28T21:45:57.404 INFO:teuthology.orchestra.run.smithi141:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2019-11-28T21:45:57.570 INFO:teuthology.orchestra.run.smithi141:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2019-11-28T21:45:57.657 INFO:teuthology.orchestra.run.smithi141:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2019-11-28T21:45:57.726 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-11-28T21:45:57.727 INFO:tasks.ceph:{} 2019-11-28T21:45:57.727 INFO:tasks.ceph:osd.7 2019-11-28T21:45:57.727 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi141.front.sepia.ceph.com 2019-11-28T21:45:57.727 INFO:teuthology.orchestra.run.smithi141:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2019-11-28T21:45:58.251 INFO:teuthology.orchestra.run.smithi141.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2019-11-28T21:45:58.251 INFO:teuthology.orchestra.run.smithi141.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-28T21:45:58.251 INFO:teuthology.orchestra.run.smithi141.stdout: = crc=1 finobt=0, sparse=0 2019-11-28T21:45:58.251 INFO:teuthology.orchestra.run.smithi141.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-28T21:45:58.251 INFO:teuthology.orchestra.run.smithi141.stdout: = sunit=0 swidth=0 blks 2019-11-28T21:45:58.252 INFO:teuthology.orchestra.run.smithi141.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-28T21:45:58.252 INFO:teuthology.orchestra.run.smithi141.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-28T21:45:58.252 INFO:teuthology.orchestra.run.smithi141.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-28T21:45:58.252 INFO:teuthology.orchestra.run.smithi141.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-28T21:45:58.253 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi141.front.sepia.ceph.com -o noatime 2019-11-28T21:45:58.253 INFO:teuthology.orchestra.run.smithi141:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-7 2019-11-28T21:45:58.386 INFO:teuthology.orchestra.run.smithi141:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2019-11-28T21:45:58.483 INFO:teuthology.orchestra.run.smithi141:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-28T21:45:58.615 INFO:teuthology.orchestra.run.smithi141.stderr:2019-11-28T21:45:58.615+0000 7fe98df45b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2019-11-28T21:45:58.616 INFO:teuthology.orchestra.run.smithi141.stderr:2019-11-28T21:45:58.616+0000 7fe98df45b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2019-11-28T21:45:58.616 INFO:teuthology.orchestra.run.smithi141.stderr:2019-11-28T21:45:58.616+0000 7fe98df45b40 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2019-11-28T21:45:58.616 INFO:teuthology.orchestra.run.smithi141.stderr:2019-11-28T21:45:58.616+0000 7fe98df45b40 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2019-11-28T21:45:58.616 INFO:teuthology.orchestra.run.smithi141.stderr:2019-11-28T21:45:58.616+0000 7fe98df45b40 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2019-11-28T21:45:58.617 INFO:teuthology.orchestra.run.smithi141.stderr:2019-11-28T21:45:58.617+0000 7fe98df45b40 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2019-11-28T21:46:00.926 INFO:teuthology.orchestra.run.smithi141:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2019-11-28T21:46:01.047 INFO:teuthology.orchestra.run.smithi141:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-28T21:46:01.195 INFO:teuthology.orchestra.run.smithi141.stderr:2019-11-28T21:46:01.195+0000 7f1c4fa33b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2019-11-28T21:46:01.196 INFO:teuthology.orchestra.run.smithi141.stderr:2019-11-28T21:46:01.196+0000 7f1c4fa33b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2019-11-28T21:46:01.196 INFO:teuthology.orchestra.run.smithi141.stderr:2019-11-28T21:46:01.196+0000 7f1c4fa33b40 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2019-11-28T21:46:01.196 INFO:teuthology.orchestra.run.smithi141.stderr:2019-11-28T21:46:01.196+0000 7f1c4fa33b40 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2019-11-28T21:46:01.197 INFO:teuthology.orchestra.run.smithi141.stderr:2019-11-28T21:46:01.196+0000 7f1c4fa33b40 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2019-11-28T21:46:01.197 INFO:teuthology.orchestra.run.smithi141.stderr:2019-11-28T21:46:01.198+0000 7f1c4fa33b40 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2019-11-28T21:46:03.506 INFO:teuthology.orchestra.run.smithi141:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2019-11-28T21:46:03.628 INFO:teuthology.orchestra.run.smithi141:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-28T21:46:03.774 INFO:teuthology.orchestra.run.smithi141.stderr:2019-11-28T21:46:03.775+0000 7fc9ab693b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2019-11-28T21:46:03.775 INFO:teuthology.orchestra.run.smithi141.stderr:2019-11-28T21:46:03.776+0000 7fc9ab693b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2019-11-28T21:46:03.775 INFO:teuthology.orchestra.run.smithi141.stderr:2019-11-28T21:46:03.776+0000 7fc9ab693b40 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2019-11-28T21:46:03.776 INFO:teuthology.orchestra.run.smithi141.stderr:2019-11-28T21:46:03.776+0000 7fc9ab693b40 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2019-11-28T21:46:03.776 INFO:teuthology.orchestra.run.smithi141.stderr:2019-11-28T21:46:03.776+0000 7fc9ab693b40 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2019-11-28T21:46:03.776 INFO:teuthology.orchestra.run.smithi141.stderr:2019-11-28T21:46:03.777+0000 7fc9ab693b40 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2019-11-28T21:46:06.089 INFO:teuthology.orchestra.run.smithi141:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2019-11-28T21:46:06.215 INFO:teuthology.orchestra.run.smithi141:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-28T21:46:06.363 INFO:teuthology.orchestra.run.smithi141.stderr:2019-11-28T21:46:06.364+0000 7fe6a4682b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2019-11-28T21:46:06.364 INFO:teuthology.orchestra.run.smithi141.stderr:2019-11-28T21:46:06.364+0000 7fe6a4682b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2019-11-28T21:46:06.364 INFO:teuthology.orchestra.run.smithi141.stderr:2019-11-28T21:46:06.364+0000 7fe6a4682b40 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2019-11-28T21:46:06.364 INFO:teuthology.orchestra.run.smithi141.stderr:2019-11-28T21:46:06.364+0000 7fe6a4682b40 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2019-11-28T21:46:06.364 INFO:teuthology.orchestra.run.smithi141.stderr:2019-11-28T21:46:06.364+0000 7fe6a4682b40 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2019-11-28T21:46:06.365 INFO:teuthology.orchestra.run.smithi141.stderr:2019-11-28T21:46:06.366+0000 7fe6a4682b40 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2019-11-28T21:46:08.671 INFO:teuthology.orchestra.run.smithi141:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2019-11-28T21:46:08.788 INFO:tasks.ceph:Reading keys from all nodes... 2019-11-28T21:46:08.789 INFO:teuthology.orchestra.run.smithi074:> mktemp 2019-11-28T21:46:08.883 INFO:teuthology.orchestra.run.smithi074.stdout:/tmp/tmp.9YPEXwyQtV 2019-11-28T21:46:08.883 INFO:teuthology.orchestra.run.smithi074:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.9YPEXwyQtV 2019-11-28T21:46:08.998 INFO:teuthology.orchestra.run.smithi074:> sudo chmod 0666 /tmp/tmp.9YPEXwyQtV 2019-11-28T21:46:09.184 DEBUG:teuthology.orchestra.remote:smithi074:/tmp/tmp.9YPEXwyQtV is 56B 2019-11-28T21:46:09.259 INFO:teuthology.orchestra.run.smithi074:> rm -fr /tmp/tmp.9YPEXwyQtV 2019-11-28T21:46:09.322 INFO:teuthology.orchestra.run.smithi074:> mktemp 2019-11-28T21:46:09.476 INFO:teuthology.orchestra.run.smithi074.stdout:/tmp/tmp.8sxUJkMBsR 2019-11-28T21:46:09.476 INFO:teuthology.orchestra.run.smithi074:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.8sxUJkMBsR 2019-11-28T21:46:09.584 INFO:teuthology.orchestra.run.smithi074:> sudo chmod 0666 /tmp/tmp.8sxUJkMBsR 2019-11-28T21:46:09.771 DEBUG:teuthology.orchestra.remote:smithi074:/tmp/tmp.8sxUJkMBsR is 56B 2019-11-28T21:46:09.838 INFO:teuthology.orchestra.run.smithi074:> rm -fr /tmp/tmp.8sxUJkMBsR 2019-11-28T21:46:09.905 INFO:teuthology.orchestra.run.smithi074:> mktemp 2019-11-28T21:46:09.966 INFO:teuthology.orchestra.run.smithi074.stdout:/tmp/tmp.uaXw6vFDfr 2019-11-28T21:46:09.967 INFO:teuthology.orchestra.run.smithi074:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.uaXw6vFDfr 2019-11-28T21:46:10.046 INFO:teuthology.orchestra.run.smithi074:> sudo chmod 0666 /tmp/tmp.uaXw6vFDfr 2019-11-28T21:46:10.181 DEBUG:teuthology.orchestra.remote:smithi074:/tmp/tmp.uaXw6vFDfr is 56B 2019-11-28T21:46:10.242 INFO:teuthology.orchestra.run.smithi074:> rm -fr /tmp/tmp.uaXw6vFDfr 2019-11-28T21:46:10.293 INFO:teuthology.orchestra.run.smithi074:> mktemp 2019-11-28T21:46:10.447 INFO:teuthology.orchestra.run.smithi074.stdout:/tmp/tmp.etbmnCGBT0 2019-11-28T21:46:10.448 INFO:teuthology.orchestra.run.smithi074:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.etbmnCGBT0 2019-11-28T21:46:10.552 INFO:teuthology.orchestra.run.smithi074:> sudo chmod 0666 /tmp/tmp.etbmnCGBT0 2019-11-28T21:46:10.700 DEBUG:teuthology.orchestra.remote:smithi074:/tmp/tmp.etbmnCGBT0 is 56B 2019-11-28T21:46:10.779 INFO:teuthology.orchestra.run.smithi074:> rm -fr /tmp/tmp.etbmnCGBT0 2019-11-28T21:46:10.858 INFO:teuthology.orchestra.run.smithi074:> mktemp 2019-11-28T21:46:10.944 INFO:teuthology.orchestra.run.smithi074.stdout:/tmp/tmp.jjQl6IN47z 2019-11-28T21:46:10.944 INFO:teuthology.orchestra.run.smithi074:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.jjQl6IN47z 2019-11-28T21:46:11.036 INFO:teuthology.orchestra.run.smithi074:> sudo chmod 0666 /tmp/tmp.jjQl6IN47z 2019-11-28T21:46:11.228 DEBUG:teuthology.orchestra.remote:smithi074:/tmp/tmp.jjQl6IN47z is 56B 2019-11-28T21:46:11.309 INFO:teuthology.orchestra.run.smithi074:> rm -fr /tmp/tmp.jjQl6IN47z 2019-11-28T21:46:11.378 INFO:teuthology.orchestra.run.smithi141:> mktemp 2019-11-28T21:46:11.471 INFO:teuthology.orchestra.run.smithi141.stdout:/tmp/tmp.4S6pQszsrT 2019-11-28T21:46:11.471 INFO:teuthology.orchestra.run.smithi141:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.4S6pQszsrT 2019-11-28T21:46:11.576 INFO:teuthology.orchestra.run.smithi141:> sudo chmod 0666 /tmp/tmp.4S6pQszsrT 2019-11-28T21:46:11.730 DEBUG:teuthology.orchestra.remote:smithi141:/tmp/tmp.4S6pQszsrT is 56B 2019-11-28T21:46:11.807 INFO:teuthology.orchestra.run.smithi141:> rm -fr /tmp/tmp.4S6pQszsrT 2019-11-28T21:46:11.863 INFO:teuthology.orchestra.run.smithi141:> mktemp 2019-11-28T21:46:11.922 INFO:teuthology.orchestra.run.smithi141.stdout:/tmp/tmp.QoVtEbQdU6 2019-11-28T21:46:11.922 INFO:teuthology.orchestra.run.smithi141:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.QoVtEbQdU6 2019-11-28T21:46:12.016 INFO:teuthology.orchestra.run.smithi141:> sudo chmod 0666 /tmp/tmp.QoVtEbQdU6 2019-11-28T21:46:12.200 DEBUG:teuthology.orchestra.remote:smithi141:/tmp/tmp.QoVtEbQdU6 is 56B 2019-11-28T21:46:12.268 INFO:teuthology.orchestra.run.smithi141:> rm -fr /tmp/tmp.QoVtEbQdU6 2019-11-28T21:46:12.325 INFO:teuthology.orchestra.run.smithi141:> mktemp 2019-11-28T21:46:12.384 INFO:teuthology.orchestra.run.smithi141.stdout:/tmp/tmp.BVuPwSnliP 2019-11-28T21:46:12.385 INFO:teuthology.orchestra.run.smithi141:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.BVuPwSnliP 2019-11-28T21:46:12.454 INFO:teuthology.orchestra.run.smithi141:> sudo chmod 0666 /tmp/tmp.BVuPwSnliP 2019-11-28T21:46:12.572 DEBUG:teuthology.orchestra.remote:smithi141:/tmp/tmp.BVuPwSnliP is 56B 2019-11-28T21:46:12.623 INFO:teuthology.orchestra.run.smithi141:> rm -fr /tmp/tmp.BVuPwSnliP 2019-11-28T21:46:12.670 INFO:teuthology.orchestra.run.smithi141:> mktemp 2019-11-28T21:46:12.805 INFO:teuthology.orchestra.run.smithi141.stdout:/tmp/tmp.XsI1jcrA9k 2019-11-28T21:46:12.806 INFO:teuthology.orchestra.run.smithi141:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.XsI1jcrA9k 2019-11-28T21:46:12.895 INFO:teuthology.orchestra.run.smithi141:> sudo chmod 0666 /tmp/tmp.XsI1jcrA9k 2019-11-28T21:46:13.109 DEBUG:teuthology.orchestra.remote:smithi141:/tmp/tmp.XsI1jcrA9k is 56B 2019-11-28T21:46:13.209 INFO:teuthology.orchestra.run.smithi141:> rm -fr /tmp/tmp.XsI1jcrA9k 2019-11-28T21:46:13.288 INFO:teuthology.orchestra.run.smithi141:> mktemp 2019-11-28T21:46:13.376 INFO:teuthology.orchestra.run.smithi141.stdout:/tmp/tmp.0gpgbr0jPY 2019-11-28T21:46:13.376 INFO:teuthology.orchestra.run.smithi141:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.0gpgbr0jPY 2019-11-28T21:46:13.479 INFO:teuthology.orchestra.run.smithi141:> sudo chmod 0666 /tmp/tmp.0gpgbr0jPY 2019-11-28T21:46:13.637 DEBUG:teuthology.orchestra.remote:smithi141:/tmp/tmp.0gpgbr0jPY is 56B 2019-11-28T21:46:13.700 INFO:teuthology.orchestra.run.smithi141:> rm -fr /tmp/tmp.0gpgbr0jPY 2019-11-28T21:46:13.851 DEBUG:teuthology.orchestra.remote:smithi074:/etc/ceph/ceph.client.0.keyring is 59B 2019-11-28T21:46:14.027 DEBUG:teuthology.orchestra.remote:smithi141:/etc/ceph/ceph.client.1.keyring is 59B 2019-11-28T21:46:14.110 INFO:tasks.ceph:Adding keys to all mons... 2019-11-28T21:46:14.110 INFO:teuthology.orchestra.run.smithi074:> sudo tee -a /etc/ceph/ceph.keyring 2019-11-28T21:46:14.115 INFO:teuthology.orchestra.run.smithi141:> sudo tee -a /etc/ceph/ceph.keyring 2019-11-28T21:46:14.220 INFO:teuthology.orchestra.run.smithi141.stdout:[mgr.y] 2019-11-28T21:46:14.221 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQAEQOBdB0yWEBAA/bP2hAUV8uEV4p20aGBEvw== 2019-11-28T21:46:14.221 INFO:teuthology.orchestra.run.smithi141.stdout:[osd.0] 2019-11-28T21:46:14.221 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQAIQOBdZ9i0IxAAadY3fIQ9k2NdchhAQ3uHsg== 2019-11-28T21:46:14.221 INFO:teuthology.orchestra.run.smithi141.stdout:[osd.1] 2019-11-28T21:46:14.221 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQALQOBd3q+vChAAIXTiJAfoX3KKRz3Q9dUTqQ== 2019-11-28T21:46:14.221 INFO:teuthology.orchestra.run.smithi141.stdout:[osd.2] 2019-11-28T21:46:14.221 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQANQOBdhGrGMhAA7m4cTLHu/aPtgOOSMKJjwQ== 2019-11-28T21:46:14.222 INFO:teuthology.orchestra.run.smithi141.stdout:[osd.3] 2019-11-28T21:46:14.222 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQAQQOBdwSC7GRAAVOVGHBkuqfrNMn2Cxm5F+A== 2019-11-28T21:46:14.222 INFO:teuthology.orchestra.run.smithi141.stdout:[mgr.x] 2019-11-28T21:46:14.222 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQAEQOBdurN9HRAAQDUGxs/VRRXmzBfvt2Up7g== 2019-11-28T21:46:14.223 INFO:teuthology.orchestra.run.smithi141.stdout:[osd.4] 2019-11-28T21:46:14.223 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQAWQOBdDk/CJBAAqR575O/SvCUVczmzqraUSQ== 2019-11-28T21:46:14.223 INFO:teuthology.orchestra.run.smithi141.stdout:[osd.5] 2019-11-28T21:46:14.223 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQAZQOBdSKq9CxAA2JUvIb8IcQKAE+UVcN+OcA== 2019-11-28T21:46:14.223 INFO:teuthology.orchestra.run.smithi141.stdout:[osd.6] 2019-11-28T21:46:14.223 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQAbQOBd0RlILhAAWnBelZOgfos3B5OV9Nf3qA== 2019-11-28T21:46:14.223 INFO:teuthology.orchestra.run.smithi141.stdout:[osd.7] 2019-11-28T21:46:14.223 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQAeQOBdwfHBFRAAYjT85bWUUJhGVeBCQSb0hg== 2019-11-28T21:46:14.224 INFO:teuthology.orchestra.run.smithi141.stdout:[client.0] 2019-11-28T21:46:14.224 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQAEQOBdCD+FJhAAjAPerplNgIMqlmsaI2XK/A== 2019-11-28T21:46:14.224 INFO:teuthology.orchestra.run.smithi141.stdout:[client.1] 2019-11-28T21:46:14.224 INFO:teuthology.orchestra.run.smithi141.stdout: key = AQAEQOBdyL0OMRAAQkWmlUqkjrxRa9Tr/aZTXA== 2019-11-28T21:46:14.225 INFO:teuthology.orchestra.run.smithi074.stdout:[mgr.y] 2019-11-28T21:46:14.226 INFO:teuthology.orchestra.run.smithi074.stdout: key = AQAEQOBdB0yWEBAA/bP2hAUV8uEV4p20aGBEvw== 2019-11-28T21:46:14.226 INFO:teuthology.orchestra.run.smithi074.stdout:[osd.0] 2019-11-28T21:46:14.226 INFO:teuthology.orchestra.run.smithi074.stdout: key = AQAIQOBdZ9i0IxAAadY3fIQ9k2NdchhAQ3uHsg== 2019-11-28T21:46:14.226 INFO:teuthology.orchestra.run.smithi074.stdout:[osd.1] 2019-11-28T21:46:14.226 INFO:teuthology.orchestra.run.smithi074.stdout: key = AQALQOBd3q+vChAAIXTiJAfoX3KKRz3Q9dUTqQ== 2019-11-28T21:46:14.226 INFO:teuthology.orchestra.run.smithi074.stdout:[osd.2] 2019-11-28T21:46:14.226 INFO:teuthology.orchestra.run.smithi074.stdout: key = AQANQOBdhGrGMhAA7m4cTLHu/aPtgOOSMKJjwQ== 2019-11-28T21:46:14.227 INFO:teuthology.orchestra.run.smithi074.stdout:[osd.3] 2019-11-28T21:46:14.227 INFO:teuthology.orchestra.run.smithi074.stdout: key = AQAQQOBdwSC7GRAAVOVGHBkuqfrNMn2Cxm5F+A== 2019-11-28T21:46:14.227 INFO:teuthology.orchestra.run.smithi074.stdout:[mgr.x] 2019-11-28T21:46:14.227 INFO:teuthology.orchestra.run.smithi074.stdout: key = AQAEQOBdurN9HRAAQDUGxs/VRRXmzBfvt2Up7g== 2019-11-28T21:46:14.227 INFO:teuthology.orchestra.run.smithi074.stdout:[osd.4] 2019-11-28T21:46:14.227 INFO:teuthology.orchestra.run.smithi074.stdout: key = AQAWQOBdDk/CJBAAqR575O/SvCUVczmzqraUSQ== 2019-11-28T21:46:14.227 INFO:teuthology.orchestra.run.smithi074.stdout:[osd.5] 2019-11-28T21:46:14.227 INFO:teuthology.orchestra.run.smithi074.stdout: key = AQAZQOBdSKq9CxAA2JUvIb8IcQKAE+UVcN+OcA== 2019-11-28T21:46:14.228 INFO:teuthology.orchestra.run.smithi074.stdout:[osd.6] 2019-11-28T21:46:14.228 INFO:teuthology.orchestra.run.smithi074.stdout: key = AQAbQOBd0RlILhAAWnBelZOgfos3B5OV9Nf3qA== 2019-11-28T21:46:14.228 INFO:teuthology.orchestra.run.smithi074.stdout:[osd.7] 2019-11-28T21:46:14.228 INFO:teuthology.orchestra.run.smithi074.stdout: key = AQAeQOBdwfHBFRAAYjT85bWUUJhGVeBCQSb0hg== 2019-11-28T21:46:14.228 INFO:teuthology.orchestra.run.smithi074.stdout:[client.0] 2019-11-28T21:46:14.228 INFO:teuthology.orchestra.run.smithi074.stdout: key = AQAEQOBdCD+FJhAAjAPerplNgIMqlmsaI2XK/A== 2019-11-28T21:46:14.228 INFO:teuthology.orchestra.run.smithi074.stdout:[client.1] 2019-11-28T21:46:14.229 INFO:teuthology.orchestra.run.smithi074.stdout: key = AQAEQOBdyL0OMRAAQkWmlUqkjrxRa9Tr/aZTXA== 2019-11-28T21:46:14.229 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-11-28T21:46:14.233 INFO:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-11-28T21:46:14.393 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-28T21:46:14.398 INFO:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-28T21:46:14.567 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-28T21:46:14.572 INFO:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-28T21:46:14.730 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-28T21:46:14.735 INFO:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-28T21:46:14.897 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-28T21:46:14.902 INFO:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-28T21:46:15.071 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-11-28T21:46:15.075 INFO:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-11-28T21:46:15.233 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-28T21:46:15.238 INFO:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-28T21:46:15.394 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-28T21:46:15.399 INFO:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-28T21:46:15.561 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-28T21:46:15.566 INFO:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-28T21:46:15.730 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-28T21:46:15.735 INFO:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-28T21:46:15.898 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-11-28T21:46:15.907 INFO:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-11-28T21:46:16.072 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-11-28T21:46:16.078 INFO:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-11-28T21:46:16.257 INFO:tasks.ceph:Running mkfs on mon nodes... 2019-11-28T21:46:16.258 INFO:teuthology.orchestra.run.smithi074:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2019-11-28T21:46:16.384 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2019-11-28T21:46:16.573 INFO:teuthology.orchestra.run.smithi074:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2019-11-28T21:46:16.689 INFO:teuthology.orchestra.run.smithi074:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2019-11-28T21:46:16.801 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2019-11-28T21:46:16.986 INFO:teuthology.orchestra.run.smithi074:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2019-11-28T21:46:17.102 INFO:teuthology.orchestra.run.smithi141:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2019-11-28T21:46:17.223 INFO:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2019-11-28T21:46:17.382 INFO:teuthology.orchestra.run.smithi141:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2019-11-28T21:46:17.473 INFO:teuthology.orchestra.run.smithi074:> rm -- /home/ubuntu/cephtest/ceph.monmap 2019-11-28T21:46:17.478 INFO:teuthology.orchestra.run.smithi141:> rm -- /home/ubuntu/cephtest/ceph.monmap 2019-11-28T21:46:17.564 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2019-11-28T21:46:17.565 DEBUG:teuthology.misc:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2019-11-28T21:46:17.565 INFO:tasks.ceph.mon.a:Restarting daemon 2019-11-28T21:46:17.565 INFO:teuthology.orchestra.run.smithi074:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2019-11-28T21:46:17.580 INFO:tasks.ceph.mon.a:Started 2019-11-28T21:46:17.580 DEBUG:teuthology.misc:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2019-11-28T21:46:17.580 INFO:tasks.ceph.mon.c:Restarting daemon 2019-11-28T21:46:17.580 INFO:teuthology.orchestra.run.smithi074:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2019-11-28T21:46:17.584 INFO:tasks.ceph.mon.c:Started 2019-11-28T21:46:17.585 DEBUG:teuthology.misc:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2019-11-28T21:46:17.585 INFO:tasks.ceph.mon.b:Restarting daemon 2019-11-28T21:46:17.585 INFO:teuthology.orchestra.run.smithi141:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2019-11-28T21:46:17.591 INFO:tasks.ceph.mon.b:Started 2019-11-28T21:46:17.591 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2019-11-28T21:46:17.592 INFO:tasks.ceph.mgr.y:Restarting daemon 2019-11-28T21:46:17.592 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2019-11-28T21:46:17.596 INFO:tasks.ceph.mgr.y:Started 2019-11-28T21:46:17.597 INFO:tasks.ceph.mgr.x:Restarting daemon 2019-11-28T21:46:17.598 INFO:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2019-11-28T21:46:17.603 INFO:tasks.ceph.mgr.x:Started 2019-11-28T21:46:17.604 INFO:tasks.ceph:Setting crush tunables to default 2019-11-28T21:46:17.604 INFO:teuthology.orchestra.run.smithi074:> sudo ceph --cluster ceph osd crush tunables default 2019-11-28T21:46:21.638 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:00:03.860 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T21:46:21.679 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:00:03.907 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T21:46:21.727 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:00:03.948 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T21:46:34.421 INFO:teuthology.orchestra.run.smithi074.stderr:adjusted tunables profile to default 2019-11-28T21:46:34.432 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2019-11-28T21:46:34.433 INFO:teuthology.orchestra.run.smithi074:> mktemp 2019-11-28T21:46:34.480 INFO:teuthology.orchestra.run.smithi074.stdout:/tmp/tmp.33U19wzvwV 2019-11-28T21:46:34.480 INFO:teuthology.orchestra.run.smithi074:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.33U19wzvwV 2019-11-28T21:46:34.543 INFO:teuthology.orchestra.run.smithi074:> sudo chmod 0666 /tmp/tmp.33U19wzvwV 2019-11-28T21:46:34.646 DEBUG:teuthology.orchestra.remote:smithi074:/tmp/tmp.33U19wzvwV is 37B 2019-11-28T21:46:34.694 INFO:teuthology.orchestra.run.smithi074:> rm -fr /tmp/tmp.33U19wzvwV 2019-11-28T21:46:34.735 INFO:teuthology.orchestra.run.smithi074:> mktemp 2019-11-28T21:46:34.855 INFO:teuthology.orchestra.run.smithi074.stdout:/tmp/tmp.tzZxClzbgm 2019-11-28T21:46:34.856 INFO:teuthology.orchestra.run.smithi074:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.tzZxClzbgm 2019-11-28T21:46:34.920 INFO:teuthology.orchestra.run.smithi074:> sudo chmod 0666 /tmp/tmp.tzZxClzbgm 2019-11-28T21:46:35.021 DEBUG:teuthology.orchestra.remote:smithi074:/tmp/tmp.tzZxClzbgm is 37B 2019-11-28T21:46:35.083 INFO:teuthology.orchestra.run.smithi074:> rm -fr /tmp/tmp.tzZxClzbgm 2019-11-28T21:46:35.126 INFO:teuthology.orchestra.run.smithi074:> mktemp 2019-11-28T21:46:35.248 INFO:teuthology.orchestra.run.smithi074.stdout:/tmp/tmp.HY9TpBpJA0 2019-11-28T21:46:35.248 INFO:teuthology.orchestra.run.smithi074:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.HY9TpBpJA0 2019-11-28T21:46:35.310 INFO:teuthology.orchestra.run.smithi074:> sudo chmod 0666 /tmp/tmp.HY9TpBpJA0 2019-11-28T21:46:35.425 DEBUG:teuthology.orchestra.remote:smithi074:/tmp/tmp.HY9TpBpJA0 is 37B 2019-11-28T21:46:35.476 INFO:teuthology.orchestra.run.smithi074:> rm -fr /tmp/tmp.HY9TpBpJA0 2019-11-28T21:46:35.516 INFO:teuthology.orchestra.run.smithi074:> mktemp 2019-11-28T21:46:35.640 INFO:teuthology.orchestra.run.smithi074.stdout:/tmp/tmp.5UXj7nac7s 2019-11-28T21:46:35.640 INFO:teuthology.orchestra.run.smithi074:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.5UXj7nac7s 2019-11-28T21:46:35.697 INFO:teuthology.orchestra.run.smithi074:> sudo chmod 0666 /tmp/tmp.5UXj7nac7s 2019-11-28T21:46:35.812 DEBUG:teuthology.orchestra.remote:smithi074:/tmp/tmp.5UXj7nac7s is 37B 2019-11-28T21:46:35.864 INFO:teuthology.orchestra.run.smithi074:> rm -fr /tmp/tmp.5UXj7nac7s 2019-11-28T21:46:35.904 INFO:teuthology.orchestra.run.smithi141:> mktemp 2019-11-28T21:46:35.989 INFO:teuthology.orchestra.run.smithi141.stdout:/tmp/tmp.BLB9ELv0wi 2019-11-28T21:46:35.989 INFO:teuthology.orchestra.run.smithi141:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.BLB9ELv0wi 2019-11-28T21:46:36.057 INFO:teuthology.orchestra.run.smithi141:> sudo chmod 0666 /tmp/tmp.BLB9ELv0wi 2019-11-28T21:46:36.169 DEBUG:teuthology.orchestra.remote:smithi141:/tmp/tmp.BLB9ELv0wi is 37B 2019-11-28T21:46:36.216 INFO:teuthology.orchestra.run.smithi141:> rm -fr /tmp/tmp.BLB9ELv0wi 2019-11-28T21:46:36.259 INFO:teuthology.orchestra.run.smithi141:> mktemp 2019-11-28T21:46:36.387 INFO:teuthology.orchestra.run.smithi141.stdout:/tmp/tmp.X9FVTpURIP 2019-11-28T21:46:36.387 INFO:teuthology.orchestra.run.smithi141:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.X9FVTpURIP 2019-11-28T21:46:36.495 INFO:teuthology.orchestra.run.smithi141:> sudo chmod 0666 /tmp/tmp.X9FVTpURIP 2019-11-28T21:46:36.681 DEBUG:teuthology.orchestra.remote:smithi141:/tmp/tmp.X9FVTpURIP is 37B 2019-11-28T21:46:36.759 INFO:teuthology.orchestra.run.smithi141:> rm -fr /tmp/tmp.X9FVTpURIP 2019-11-28T21:46:36.826 INFO:teuthology.orchestra.run.smithi141:> mktemp 2019-11-28T21:46:36.949 INFO:teuthology.orchestra.run.smithi141.stdout:/tmp/tmp.snCqgZIrQn 2019-11-28T21:46:36.949 INFO:teuthology.orchestra.run.smithi141:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.snCqgZIrQn 2019-11-28T21:46:37.049 INFO:teuthology.orchestra.run.smithi141:> sudo chmod 0666 /tmp/tmp.snCqgZIrQn 2019-11-28T21:46:37.177 DEBUG:teuthology.orchestra.remote:smithi141:/tmp/tmp.snCqgZIrQn is 37B 2019-11-28T21:46:37.250 INFO:teuthology.orchestra.run.smithi141:> rm -fr /tmp/tmp.snCqgZIrQn 2019-11-28T21:46:37.310 INFO:teuthology.orchestra.run.smithi141:> mktemp 2019-11-28T21:46:37.461 INFO:teuthology.orchestra.run.smithi141.stdout:/tmp/tmp.DY0sPHlOCu 2019-11-28T21:46:37.462 INFO:teuthology.orchestra.run.smithi141:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.DY0sPHlOCu 2019-11-28T21:46:37.565 INFO:teuthology.orchestra.run.smithi141:> sudo chmod 0666 /tmp/tmp.DY0sPHlOCu 2019-11-28T21:46:37.760 DEBUG:teuthology.orchestra.remote:smithi141:/tmp/tmp.DY0sPHlOCu is 37B 2019-11-28T21:46:37.839 INFO:teuthology.orchestra.run.smithi141:> rm -fr /tmp/tmp.DY0sPHlOCu 2019-11-28T21:46:37.914 INFO:teuthology.orchestra.run.smithi141:> sudo ceph --cluster ceph osd new 730deae4-abee-43b7-8b76-2e5f289aae88 0 2019-11-28T21:46:39.369 INFO:teuthology.orchestra.run.smithi141.stdout:0 2019-11-28T21:46:39.395 INFO:teuthology.orchestra.run.smithi141:> sudo ceph --cluster ceph osd new de187634-055e-41ea-82a7-c816f51e1820 1 2019-11-28T21:46:40.433 INFO:teuthology.orchestra.run.smithi141.stdout:1 2019-11-28T21:46:40.454 INFO:teuthology.orchestra.run.smithi141:> sudo ceph --cluster ceph osd new 205809ec-bb7b-4c36-a166-67e901b85f99 2 2019-11-28T21:46:41.442 INFO:teuthology.orchestra.run.smithi141.stdout:2 2019-11-28T21:46:41.463 INFO:teuthology.orchestra.run.smithi141:> sudo ceph --cluster ceph osd new af8196a6-1f3d-40bc-80a3-adf4bea9a538 3 2019-11-28T21:46:42.549 INFO:teuthology.orchestra.run.smithi141.stdout:3 2019-11-28T21:46:42.571 INFO:teuthology.orchestra.run.smithi141:> sudo ceph --cluster ceph osd new b9f05f0d-b4dc-4e68-b45c-286c155ef12e 4 2019-11-28T21:46:43.576 INFO:teuthology.orchestra.run.smithi141.stdout:4 2019-11-28T21:46:43.594 INFO:teuthology.orchestra.run.smithi141:> sudo ceph --cluster ceph osd new f45b92eb-1c12-4f90-9f43-cc80eac0e51f 5 2019-11-28T21:46:44.718 INFO:teuthology.orchestra.run.smithi141.stdout:5 2019-11-28T21:46:44.741 INFO:teuthology.orchestra.run.smithi141:> sudo ceph --cluster ceph osd new 54870918-6c2c-470b-b61b-4a26c01d9fce 6 2019-11-28T21:46:45.761 INFO:teuthology.orchestra.run.smithi141.stdout:6 2019-11-28T21:46:45.775 INFO:teuthology.orchestra.run.smithi141:> sudo ceph --cluster ceph osd new d7dabb17-88fa-45b9-be80-8dfc0a2af317 7 2019-11-28T21:46:46.778 INFO:teuthology.orchestra.run.smithi141.stdout:7 2019-11-28T21:46:46.800 DEBUG:teuthology.misc:running osd.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.0.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-28T21:46:46.800 INFO:tasks.ceph.osd.0:Restarting daemon 2019-11-28T21:46:46.800 INFO:teuthology.orchestra.run.smithi074:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 0 2019-11-28T21:46:46.805 INFO:tasks.ceph.osd.0:Started 2019-11-28T21:46:46.805 DEBUG:teuthology.misc:running osd.1 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.1.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-28T21:46:46.806 INFO:tasks.ceph.osd.1:Restarting daemon 2019-11-28T21:46:46.806 INFO:teuthology.orchestra.run.smithi074:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 1 2019-11-28T21:46:46.811 INFO:tasks.ceph.osd.1:Started 2019-11-28T21:46:46.812 DEBUG:teuthology.misc:running osd.2 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.2.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-28T21:46:46.812 INFO:tasks.ceph.osd.2:Restarting daemon 2019-11-28T21:46:46.812 INFO:teuthology.orchestra.run.smithi074:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 2 2019-11-28T21:46:46.816 INFO:tasks.ceph.osd.2:Started 2019-11-28T21:46:46.816 DEBUG:teuthology.misc:running osd.3 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.3.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-28T21:46:46.816 INFO:tasks.ceph.osd.3:Restarting daemon 2019-11-28T21:46:46.816 INFO:teuthology.orchestra.run.smithi074:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 3 2019-11-28T21:46:46.820 INFO:tasks.ceph.osd.3:Started 2019-11-28T21:46:46.820 DEBUG:teuthology.misc:running osd.4 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.4.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-28T21:46:46.821 INFO:tasks.ceph.osd.4:Restarting daemon 2019-11-28T21:46:46.821 INFO:teuthology.orchestra.run.smithi141:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 4 2019-11-28T21:46:46.825 INFO:tasks.ceph.osd.4:Started 2019-11-28T21:46:46.825 DEBUG:teuthology.misc:running osd.5 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.5.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-28T21:46:46.826 INFO:tasks.ceph.osd.5:Restarting daemon 2019-11-28T21:46:46.826 INFO:teuthology.orchestra.run.smithi141:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 5 2019-11-28T21:46:46.830 INFO:tasks.ceph.osd.5:Started 2019-11-28T21:46:46.830 DEBUG:teuthology.misc:running osd.6 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.6.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-28T21:46:46.830 INFO:tasks.ceph.osd.6:Restarting daemon 2019-11-28T21:46:46.830 INFO:teuthology.orchestra.run.smithi141:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 6 2019-11-28T21:46:46.835 INFO:tasks.ceph.osd.6:Started 2019-11-28T21:46:46.835 DEBUG:teuthology.misc:running osd.7 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.7.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-28T21:46:46.835 INFO:tasks.ceph.osd.7:Restarting daemon 2019-11-28T21:46:46.835 INFO:teuthology.orchestra.run.smithi141:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 7 2019-11-28T21:46:46.839 INFO:tasks.ceph.osd.7:Started 2019-11-28T21:46:46.839 INFO:tasks.ceph:Waiting for OSDs to come up 2019-11-28T21:46:47.645 INFO:teuthology.orchestra.run.smithi074:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2019-11-28T21:46:48.689 INFO:teuthology.misc.health.smithi074.stdout: 2019-11-28T21:46:48.690 INFO:teuthology.misc.health.smithi074.stdout:{"epoch":10,"fsid":"cecd8621-e0c7-45c8-9e74-513fdbad61b1","created":"2019-11-28T21:46:31.444776+0000","modified":"2019-11-28T21:46:46.630029+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"730deae4-abee-43b7-8b76-2e5f289aae88","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"de187634-055e-41ea-82a7-c816f51e1820","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"205809ec-bb7b-4c36-a166-67e901b85f99","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"af8196a6-1f3d-40bc-80a3-adf4bea9a538","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b9f05f0d-b4dc-4e68-b45c-286c155ef12e","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f45b92eb-1c12-4f90-9f43-cc80eac0e51f","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"54870918-6c2c-470b-b61b-4a26c01d9fce","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d7dabb17-88fa-45b9-be80-8dfc0a2af317","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T21:46:48.704 DEBUG:teuthology.misc:0 of 8 OSDs are up 2019-11-28T21:46:50.600 INFO:tasks.ceph.osd.4.smithi141.stderr:==00:00:00:03.615 9903== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:50.610 INFO:tasks.ceph.osd.5.smithi141.stderr:==00:00:00:03.617 9905== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:50.656 INFO:tasks.ceph.osd.4.smithi141.stderr:==00:00:00:03.672 9903== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:50.667 INFO:tasks.ceph.osd.5.smithi141.stderr:==00:00:00:03.673 9905== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:50.690 INFO:tasks.ceph.osd.6.smithi141.stderr:==00:00:00:03.700 9904== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:50.704 INFO:tasks.ceph.osd.7.smithi141.stderr:==00:00:00:03.724 9902== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:50.748 INFO:tasks.ceph.osd.3.smithi074.stderr:==00:00:00:03.804 10096== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:50.751 INFO:tasks.ceph.osd.1.smithi074.stderr:==00:00:00:03.789 10097== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:50.771 INFO:tasks.ceph.osd.6.smithi141.stderr:==00:00:00:03.781 9904== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:50.783 INFO:tasks.ceph.osd.7.smithi141.stderr:==00:00:00:03.803 9902== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:50.807 INFO:tasks.ceph.osd.3.smithi074.stderr:==00:00:00:03.860 10096== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:50.808 INFO:tasks.ceph.osd.1.smithi074.stderr:==00:00:00:03.847 10097== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:50.899 INFO:tasks.ceph.osd.0.smithi074.stderr:==00:00:00:03.981 10091== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:50.955 INFO:tasks.ceph.osd.0.smithi074.stderr:==00:00:00:04.038 10091== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:51.128 INFO:tasks.ceph.osd.2.smithi074.stderr:==00:00:00:04.165 10098== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:51.183 INFO:tasks.ceph.osd.2.smithi074.stderr:==00:00:00:04.220 10098== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:51.271 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-28T21:46:51.248+0000 9b10800 -1 Falling back to public interface 2019-11-28T21:46:51.282 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-28T21:46:51.260+0000 9b10800 -1 Falling back to public interface 2019-11-28T21:46:51.356 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-28T21:46:51.342+0000 9b10800 -1 Falling back to public interface 2019-11-28T21:46:51.375 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-28T21:46:51.365+0000 9b10800 -1 Falling back to public interface 2019-11-28T21:46:51.418 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-28T21:46:51.396+0000 9b10800 -1 Falling back to public interface 2019-11-28T21:46:51.420 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-28T21:46:51.396+0000 9b10800 -1 Falling back to public interface 2019-11-28T21:46:51.431 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-28T21:46:51.429+0000 114ab700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6803/0: (98) Address already in use 2019-11-28T21:46:51.533 INFO:tasks.ceph.osd.4.smithi141.stderr:==00:00:00:04.548 9903== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:51.556 INFO:tasks.ceph.osd.5.smithi141.stderr:==00:00:00:04.563 9905== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:51.581 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-28T21:46:51.560+0000 9b10800 -1 Falling back to public interface 2019-11-28T21:46:51.632 INFO:tasks.ceph.osd.3.smithi074.stderr:==00:00:00:04.688 10096== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:51.702 INFO:tasks.ceph.osd.7.smithi141.stderr:==00:00:00:04.722 9902== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:51.717 INFO:tasks.ceph.osd.1.smithi074.stderr:==00:00:00:04.754 10097== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:51.717 INFO:tasks.ceph.osd.6.smithi141.stderr:==00:00:00:04.726 9904== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:51.786 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-28T21:46:51.768+0000 9b10800 -1 Falling back to public interface 2019-11-28T21:46:51.833 INFO:tasks.ceph.osd.0.smithi074.stderr:==00:00:00:04.915 10091== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:51.941 INFO:tasks.ceph.osd.5.smithi141.stderr:==00:00:00:04.947 9905== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:51.944 INFO:tasks.ceph.osd.4.smithi141.stderr:==00:00:00:04.960 9903== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:51.963 INFO:tasks.ceph.osd.5.smithi141.stderr:==00:00:00:04.969 9905== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:51.969 INFO:tasks.ceph.osd.4.smithi141.stderr:==00:00:00:04.985 9903== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:52.001 INFO:tasks.ceph.osd.2.smithi074.stderr:==00:00:00:05.038 10098== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:52.043 INFO:tasks.ceph.osd.3.smithi074.stderr:==00:00:00:05.093 10096== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:52.048 INFO:tasks.ceph.osd.3.smithi074.stderr:==00:00:00:05.104 10096== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:52.061 INFO:tasks.ceph.osd.6.smithi141.stderr:==00:00:00:05.071 9904== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:52.072 INFO:tasks.ceph.osd.7.smithi141.stderr:==00:00:00:05.092 9902== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:52.072 INFO:tasks.ceph.osd.6.smithi141.stderr:==00:00:00:05.082 9904== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:52.083 INFO:tasks.ceph.osd.7.smithi141.stderr:==00:00:00:05.104 9902== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:52.106 INFO:tasks.ceph.osd.1.smithi074.stderr:==00:00:00:05.144 10097== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:52.117 INFO:tasks.ceph.osd.1.smithi074.stderr:==00:00:00:05.155 10097== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:52.226 INFO:tasks.ceph.osd.0.smithi074.stderr:==00:00:00:05.308 10091== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:52.249 INFO:tasks.ceph.osd.0.smithi074.stderr:==00:00:00:05.332 10091== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:52.381 INFO:tasks.ceph.osd.2.smithi074.stderr:==00:00:00:05.419 10098== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:52.392 INFO:tasks.ceph.osd.2.smithi074.stderr:==00:00:00:05.430 10098== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:54.922 INFO:tasks.ceph.osd.7.smithi141.stderr:==00:00:00:07.942 9902== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:54.932 INFO:tasks.ceph.osd.7.smithi141.stderr:==00:00:00:07.953 9902== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:54.991 INFO:tasks.ceph.osd.6.smithi141.stderr:==00:00:00:08.001 9904== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:55.001 INFO:tasks.ceph.osd.6.smithi141.stderr:==00:00:00:08.010 9904== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:55.196 INFO:tasks.ceph.osd.7.smithi141.stderr:==00:00:00:08.216 9902== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:55.262 INFO:tasks.ceph.osd.6.smithi141.stderr:==00:00:00:08.271 9904== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:55.301 INFO:tasks.ceph.osd.1.smithi074.stderr:==00:00:00:08.339 10097== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:55.312 INFO:tasks.ceph.osd.1.smithi074.stderr:==00:00:00:08.350 10097== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:55.510 INFO:teuthology.orchestra.run.smithi074:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2019-11-28T21:46:55.515 INFO:tasks.ceph.osd.4.smithi141.stderr:==00:00:00:08.531 9903== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:55.520 INFO:tasks.ceph.osd.4.smithi141.stderr:==00:00:00:08.535 9903== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:55.533 INFO:tasks.ceph.osd.5.smithi141.stderr:==00:00:00:08.538 9905== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:55.540 INFO:tasks.ceph.osd.5.smithi141.stderr:==00:00:00:08.547 9905== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:55.577 INFO:tasks.ceph.osd.1.smithi074.stderr:==00:00:00:08.615 10097== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:55.745 INFO:tasks.ceph.osd.3.smithi074.stderr:==00:00:00:08.801 10096== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:55.755 INFO:tasks.ceph.osd.3.smithi074.stderr:==00:00:00:08.811 10096== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:55.786 INFO:tasks.ceph.osd.4.smithi141.stderr:==00:00:00:08.801 9903== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:55.804 INFO:tasks.ceph.osd.5.smithi141.stderr:==00:00:00:08.810 9905== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:55.810 INFO:tasks.ceph.osd.0.smithi074.stderr:==00:00:00:08.893 10091== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:55.823 INFO:tasks.ceph.osd.0.smithi074.stderr:==00:00:00:08.905 10091== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:55.868 INFO:tasks.ceph.osd.2.smithi074.stderr:==00:00:00:08.905 10098== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:55.872 INFO:tasks.ceph.osd.2.smithi074.stderr:==00:00:00:08.910 10098== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:56.025 INFO:tasks.ceph.osd.3.smithi074.stderr:==00:00:00:09.077 10096== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:56.088 INFO:tasks.ceph.osd.0.smithi074.stderr:==00:00:00:09.170 10091== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:56.133 INFO:tasks.ceph.osd.2.smithi074.stderr:==00:00:00:09.170 10098== Warning: unimplemented fcntl command: 1038 2019-11-28T21:46:56.388 INFO:teuthology.misc.health.smithi074.stdout: 2019-11-28T21:46:56.389 INFO:teuthology.misc.health.smithi074.stdout:{"epoch":10,"fsid":"cecd8621-e0c7-45c8-9e74-513fdbad61b1","created":"2019-11-28T21:46:31.444776+0000","modified":"2019-11-28T21:46:46.630029+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"730deae4-abee-43b7-8b76-2e5f289aae88","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"de187634-055e-41ea-82a7-c816f51e1820","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"205809ec-bb7b-4c36-a166-67e901b85f99","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"af8196a6-1f3d-40bc-80a3-adf4bea9a538","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b9f05f0d-b4dc-4e68-b45c-286c155ef12e","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f45b92eb-1c12-4f90-9f43-cc80eac0e51f","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"54870918-6c2c-470b-b61b-4a26c01d9fce","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d7dabb17-88fa-45b9-be80-8dfc0a2af317","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T21:46:56.400 DEBUG:teuthology.misc:0 of 8 OSDs are up 2019-11-28T21:46:56.820 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-28T21:46:56.819+0000 9b10800 -1 osd.7 0 log_to_monitors {default=true} 2019-11-28T21:46:56.834 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-28T21:46:56.833+0000 9b10800 -1 osd.6 0 log_to_monitors {default=true} 2019-11-28T21:46:56.979 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-28T21:46:56.979+0000 9b10800 -1 osd.1 0 log_to_monitors {default=true} 2019-11-28T21:46:57.208 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-28T21:46:57.206+0000 9b10800 -1 osd.5 0 log_to_monitors {default=true} 2019-11-28T21:46:57.240 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-28T21:46:57.239+0000 9b10800 -1 osd.4 0 log_to_monitors {default=true} 2019-11-28T21:46:57.533 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-28T21:46:57.532+0000 9b10800 -1 osd.3 0 log_to_monitors {default=true} 2019-11-28T21:46:57.576 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-28T21:46:57.575+0000 9b10800 -1 osd.0 0 log_to_monitors {default=true} 2019-11-28T21:46:57.662 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-28T21:46:57.660+0000 9b10800 -1 osd.2 0 log_to_monitors {default=true} 2019-11-28T21:46:59.258 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-28T21:46:59.253+0000 2776f700 -1 osd.6 0 waiting for initial osdmap 2019-11-28T21:46:59.263 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-28T21:46:59.249+0000 2476b700 -1 osd.1 0 waiting for initial osdmap 2019-11-28T21:46:59.284 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-28T21:46:59.282+0000 2476b700 -1 osd.7 0 waiting for initial osdmap 2019-11-28T21:46:59.285 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-28T21:46:59.281+0000 2476b700 -1 osd.5 0 waiting for initial osdmap 2019-11-28T21:46:59.296 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-28T21:46:59.291+0000 2476b700 -1 osd.4 0 waiting for initial osdmap 2019-11-28T21:47:00.382 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-28T21:47:00.382+0000 2776f700 -1 osd.3 0 waiting for initial osdmap 2019-11-28T21:47:00.427 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-28T21:47:00.427+0000 2776f700 -1 osd.0 0 waiting for initial osdmap 2019-11-28T21:47:00.516 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-28T21:47:00.510+0000 2756a700 -1 osd.2 0 waiting for initial osdmap 2019-11-28T21:47:03.208 INFO:teuthology.orchestra.run.smithi074:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2019-11-28T21:47:04.106 INFO:teuthology.misc.health.smithi074.stdout: 2019-11-28T21:47:04.107 INFO:teuthology.misc.health.smithi074.stdout:{"epoch":16,"fsid":"cecd8621-e0c7-45c8-9e74-513fdbad61b1","created":"2019-11-28T21:46:31.444776+0000","modified":"2019-11-28T21:47:03.372949+0000","last_up_change":"2019-11-28T21:47:02.045007+0000","last_in_change":"2019-11-28T21:47:02.045007+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"730deae4-abee-43b7-8b76-2e5f289aae88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6818","nonce":10091},{"type":"v1","addr":"172.21.15.74:6819","nonce":10091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6820","nonce":10091},{"type":"v1","addr":"172.21.15.74:6821","nonce":10091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6824","nonce":10091},{"type":"v1","addr":"172.21.15.74:6825","nonce":10091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6822","nonce":10091},{"type":"v1","addr":"172.21.15.74:6823","nonce":10091}]},"public_addr":"172.21.15.74:6819/10091","cluster_addr":"172.21.15.74:6821/10091","heartbeat_back_addr":"172.21.15.74:6825/10091","heartbeat_front_addr":"172.21.15.74:6823/10091","state":["exists","up"]},{"osd":1,"uuid":"de187634-055e-41ea-82a7-c816f51e1820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6804","nonce":10097},{"type":"v1","addr":"172.21.15.74:6805","nonce":10097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6809","nonce":10097},{"type":"v1","addr":"172.21.15.74:6811","nonce":10097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6816","nonce":10097},{"type":"v1","addr":"172.21.15.74:6817","nonce":10097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6813","nonce":10097},{"type":"v1","addr":"172.21.15.74:6815","nonce":10097}]},"public_addr":"172.21.15.74:6805/10097","cluster_addr":"172.21.15.74:6811/10097","heartbeat_back_addr":"172.21.15.74:6817/10097","heartbeat_front_addr":"172.21.15.74:6815/10097","state":["exists","up"]},{"osd":2,"uuid":"205809ec-bb7b-4c36-a166-67e901b85f99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6826","nonce":10098},{"type":"v1","addr":"172.21.15.74:6827","nonce":10098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6828","nonce":10098},{"type":"v1","addr":"172.21.15.74:6829","nonce":10098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6832","nonce":10098},{"type":"v1","addr":"172.21.15.74:6833","nonce":10098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6830","nonce":10098},{"type":"v1","addr":"172.21.15.74:6831","nonce":10098}]},"public_addr":"172.21.15.74:6827/10098","cluster_addr":"172.21.15.74:6829/10098","heartbeat_back_addr":"172.21.15.74:6833/10098","heartbeat_front_addr":"172.21.15.74:6831/10098","state":["exists","up"]},{"osd":3,"uuid":"af8196a6-1f3d-40bc-80a3-adf4bea9a538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6802","nonce":10096},{"type":"v1","addr":"172.21.15.74:6803","nonce":10096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6806","nonce":10096},{"type":"v1","addr":"172.21.15.74:6807","nonce":10096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6812","nonce":10096},{"type":"v1","addr":"172.21.15.74:6814","nonce":10096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6808","nonce":10096},{"type":"v1","addr":"172.21.15.74:6810","nonce":10096}]},"public_addr":"172.21.15.74:6803/10096","cluster_addr":"172.21.15.74:6807/10096","heartbeat_back_addr":"172.21.15.74:6814/10096","heartbeat_front_addr":"172.21.15.74:6810/10096","state":["exists","up"]},{"osd":4,"uuid":"b9f05f0d-b4dc-4e68-b45c-286c155ef12e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":9903},{"type":"v1","addr":"172.21.15.141:6801","nonce":9903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":9903},{"type":"v1","addr":"172.21.15.141:6803","nonce":9903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6807","nonce":9903},{"type":"v1","addr":"172.21.15.141:6809","nonce":9903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":9903},{"type":"v1","addr":"172.21.15.141:6805","nonce":9903}]},"public_addr":"172.21.15.141:6801/9903","cluster_addr":"172.21.15.141:6803/9903","heartbeat_back_addr":"172.21.15.141:6809/9903","heartbeat_front_addr":"172.21.15.141:6805/9903","state":["exists","up"]},{"osd":5,"uuid":"f45b92eb-1c12-4f90-9f43-cc80eac0e51f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":9905},{"type":"v1","addr":"172.21.15.141:6808","nonce":9905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":9905},{"type":"v1","addr":"172.21.15.141:6811","nonce":9905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":9905},{"type":"v1","addr":"172.21.15.141:6815","nonce":9905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":9905},{"type":"v1","addr":"172.21.15.141:6813","nonce":9905}]},"public_addr":"172.21.15.141:6808/9905","cluster_addr":"172.21.15.141:6811/9905","heartbeat_back_addr":"172.21.15.141:6815/9905","heartbeat_front_addr":"172.21.15.141:6813/9905","state":["exists","up"]},{"osd":6,"uuid":"54870918-6c2c-470b-b61b-4a26c01d9fce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":9904},{"type":"v1","addr":"172.21.15.141:6820","nonce":9904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":9904},{"type":"v1","addr":"172.21.15.141:6824","nonce":9904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":9904},{"type":"v1","addr":"172.21.15.141:6831","nonce":9904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":9904},{"type":"v1","addr":"172.21.15.141:6828","nonce":9904}]},"public_addr":"172.21.15.141:6820/9904","cluster_addr":"172.21.15.141:6824/9904","heartbeat_back_addr":"172.21.15.141:6831/9904","heartbeat_front_addr":"172.21.15.141:6828/9904","state":["exists","up"]},{"osd":7,"uuid":"d7dabb17-88fa-45b9-be80-8dfc0a2af317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":9902},{"type":"v1","addr":"172.21.15.141:6817","nonce":9902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6819","nonce":9902},{"type":"v1","addr":"172.21.15.141:6821","nonce":9902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6827","nonce":9902},{"type":"v1","addr":"172.21.15.141:6829","nonce":9902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6823","nonce":9902},{"type":"v1","addr":"172.21.15.141:6825","nonce":9902}]},"public_addr":"172.21.15.141:6817/9902","cluster_addr":"172.21.15.141:6821/9902","heartbeat_back_addr":"172.21.15.141:6829/9902","heartbeat_front_addr":"172.21.15.141:6825/9902","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T21:46:58.706645+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T21:46:58.092058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T21:46:58.733111+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T21:46:58.705864+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T21:46:58.369192+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T21:46:58.342739+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T21:46:57.914451+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T21:46:57.985684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T21:47:04.123 DEBUG:teuthology.misc:8 of 8 OSDs are up 2019-11-28T21:47:04.123 INFO:tasks.ceph:Creating RBD pool 2019-11-28T21:47:04.123 INFO:teuthology.orchestra.run.smithi074:> sudo ceph --cluster ceph osd pool create rbd 8 2019-11-28T21:47:06.346 INFO:teuthology.orchestra.run.smithi074.stderr:pool 'rbd' created 2019-11-28T21:47:06.359 INFO:teuthology.orchestra.run.smithi074:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2019-11-28T21:47:08.174 INFO:teuthology.orchestra.run.smithi074.stderr:enabled application 'rbd' on pool 'rbd' 2019-11-28T21:47:08.189 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2019-11-28T21:47:08.189 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T21:47:08.190 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2019-11-28T21:47:09.048 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:47:09.048 INFO:teuthology.orchestra.run.smithi074.stdout:{"epoch":19,"fsid":"cecd8621-e0c7-45c8-9e74-513fdbad61b1","created":"2019-11-28T21:46:31.444776+0000","modified":"2019-11-28T21:47:08.036257+0000","last_up_change":"2019-11-28T21:47:02.045007+0000","last_in_change":"2019-11-28T21:47:02.045007+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T21:47:04.886536+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"730deae4-abee-43b7-8b76-2e5f289aae88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6818","nonce":10091},{"type":"v1","addr":"172.21.15.74:6819","nonce":10091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6820","nonce":10091},{"type":"v1","addr":"172.21.15.74:6821","nonce":10091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6824","nonce":10091},{"type":"v1","addr":"172.21.15.74:6825","nonce":10091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6822","nonce":10091},{"type":"v1","addr":"172.21.15.74:6823","nonce":10091}]},"public_addr":"172.21.15.74:6819/10091","cluster_addr":"172.21.15.74:6821/10091","heartbeat_back_addr":"172.21.15.74:6825/10091","heartbeat_front_addr":"172.21.15.74:6823/10091","state":["exists","up"]},{"osd":1,"uuid":"de187634-055e-41ea-82a7-c816f51e1820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6804","nonce":10097},{"type":"v1","addr":"172.21.15.74:6805","nonce":10097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6809","nonce":10097},{"type":"v1","addr":"172.21.15.74:6811","nonce":10097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6816","nonce":10097},{"type":"v1","addr":"172.21.15.74:6817","nonce":10097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6813","nonce":10097},{"type":"v1","addr":"172.21.15.74:6815","nonce":10097}]},"public_addr":"172.21.15.74:6805/10097","cluster_addr":"172.21.15.74:6811/10097","heartbeat_back_addr":"172.21.15.74:6817/10097","heartbeat_front_addr":"172.21.15.74:6815/10097","state":["exists","up"]},{"osd":2,"uuid":"205809ec-bb7b-4c36-a166-67e901b85f99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6826","nonce":10098},{"type":"v1","addr":"172.21.15.74:6827","nonce":10098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6828","nonce":10098},{"type":"v1","addr":"172.21.15.74:6829","nonce":10098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6832","nonce":10098},{"type":"v1","addr":"172.21.15.74:6833","nonce":10098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6830","nonce":10098},{"type":"v1","addr":"172.21.15.74:6831","nonce":10098}]},"public_addr":"172.21.15.74:6827/10098","cluster_addr":"172.21.15.74:6829/10098","heartbeat_back_addr":"172.21.15.74:6833/10098","heartbeat_front_addr":"172.21.15.74:6831/10098","state":["exists","up"]},{"osd":3,"uuid":"af8196a6-1f3d-40bc-80a3-adf4bea9a538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6802","nonce":10096},{"type":"v1","addr":"172.21.15.74:6803","nonce":10096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6806","nonce":10096},{"type":"v1","addr":"172.21.15.74:6807","nonce":10096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6812","nonce":10096},{"type":"v1","addr":"172.21.15.74:6814","nonce":10096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6808","nonce":10096},{"type":"v1","addr":"172.21.15.74:6810","nonce":10096}]},"public_addr":"172.21.15.74:6803/10096","cluster_addr":"172.21.15.74:6807/10096","heartbeat_back_addr":"172.21.15.74:6814/10096","heartbeat_front_addr":"172.21.15.74:6810/10096","state":["exists","up"]},{"osd":4,"uuid":"b9f05f0d-b4dc-4e68-b45c-286c155ef12e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":9903},{"type":"v1","addr":"172.21.15.141:6801","nonce":9903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":9903},{"type":"v1","addr":"172.21.15.141:6803","nonce":9903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6807","nonce":9903},{"type":"v1","addr":"172.21.15.141:6809","nonce":9903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":9903},{"type":"v1","addr":"172.21.15.141:6805","nonce":9903}]},"public_addr":"172.21.15.141:6801/9903","cluster_addr":"172.21.15.141:6803/9903","heartbeat_back_addr":"172.21.15.141:6809/9903","heartbeat_front_addr":"172.21.15.141:6805/9903","state":["exists","up"]},{"osd":5,"uuid":"f45b92eb-1c12-4f90-9f43-cc80eac0e51f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":9905},{"type":"v1","addr":"172.21.15.141:6808","nonce":9905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":9905},{"type":"v1","addr":"172.21.15.141:6811","nonce":9905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":9905},{"type":"v1","addr":"172.21.15.141:6815","nonce":9905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":9905},{"type":"v1","addr":"172.21.15.141:6813","nonce":9905}]},"public_addr":"172.21.15.141:6808/9905","cluster_addr":"172.21.15.141:6811/9905","heartbeat_back_addr":"172.21.15.141:6815/9905","heartbeat_front_addr":"172.21.15.141:6813/9905","state":["exists","up"]},{"osd":6,"uuid":"54870918-6c2c-470b-b61b-4a26c01d9fce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":9904},{"type":"v1","addr":"172.21.15.141:6820","nonce":9904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":9904},{"type":"v1","addr":"172.21.15.141:6824","nonce":9904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":9904},{"type":"v1","addr":"172.21.15.141:6831","nonce":9904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":9904},{"type":"v1","addr":"172.21.15.141:6828","nonce":9904}]},"public_addr":"172.21.15.141:6820/9904","cluster_addr":"172.21.15.141:6824/9904","heartbeat_back_addr":"172.21.15.141:6831/9904","heartbeat_front_addr":"172.21.15.141:6828/9904","state":["exists","up"]},{"osd":7,"uuid":"d7dabb17-88fa-45b9-be80-8dfc0a2af317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":9902},{"type":"v1","addr":"172.21.15.141:6817","nonce":9902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6819","nonce":9902},{"type":"v1","addr":"172.21.15.141:6821","nonce":9902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6827","nonce":9902},{"type":"v1","addr":"172.21.15.141:6829","nonce":9902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6823","nonce":9902},{"type":"v1","addr":"172.21.15.141:6825","nonce":9902}]},"public_addr":"172.21.15.141:6817/9902","cluster_addr":"172.21.15.141:6821/9902","heartbeat_back_addr":"172.21.15.141:6829/9902","heartbeat_front_addr":"172.21.15.141:6825/9902","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T21:46:58.706645+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T21:46:58.092058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T21:46:58.733111+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T21:46:58.705864+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T21:46:58.369192+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T21:46:58.342739+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T21:46:57.914451+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T21:46:57.985684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T21:47:09.067 INFO:tasks.ceph.ceph_manager.ceph:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool,creating', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-28T21:47:04.886536+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 32769, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'19', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-28T21:47:09.068 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-28T21:47:09.857 INFO:teuthology.orchestra.run.smithi074.stdout:pg_num: 8 2019-11-28T21:47:09.870 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2019-11-28T21:47:09.871 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2019-11-28T21:47:09.871 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2019-11-28T21:47:10.916 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:47:10.935 INFO:teuthology.orchestra.run.smithi074.stdout:{"epoch":3,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6800","nonce":9122},{"type":"v1","addr":"172.21.15.74:6801","nonce":9122}]},"active_addr":"172.21.15.74:6801/9122","active_change":"2019-11-28T21:46:35.374682+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"str","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"ca_bundle":{"name":"ca_bundle","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_location":{"name":"server_location","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"float","level":"advanced","flags":1,"default_value":"0.01","min":"0","max":"1","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the ratio between the fullest and least-full OSD is below this value then we stop trying to optimize placement.","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"str","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"ssh","can_run":true,"error_string":"","module_options":{"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["ceph-daemon-package","root"],"desc":"mode for remote execution of ceph-daemon","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{}},{"name":"volumes","can_run":true,"error_string":"","module_options":{}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"str","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"ca_bundle":{"name":"ca_bundle","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_location":{"name":"server_location","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"float","level":"advanced","flags":1,"default_value":"0.01","min":"0","max":"1","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the ratio between the fullest and least-full OSD is below this value then we stop trying to optimize placement.","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"str","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"ssh","can_run":true,"error_string":"","module_options":{"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["ceph-daemon-package","root"],"desc":"mode for remote execution of ceph-daemon","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{}},{"name":"volumes","can_run":true,"error_string":"","module_options":{}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator_cli","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]}} 2019-11-28T21:47:10.939 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2019-11-28T21:47:10.940 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2019-11-28T21:47:10.940 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T21:47:11.795 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:47:11.796 INFO:teuthology.orchestra.run.smithi074.stdout:{"epoch":20,"fsid":"cecd8621-e0c7-45c8-9e74-513fdbad61b1","created":"2019-11-28T21:46:31.444776+0000","modified":"2019-11-28T21:47:09.078168+0000","last_up_change":"2019-11-28T21:47:02.045007+0000","last_in_change":"2019-11-28T21:47:02.045007+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T21:47:04.886536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"730deae4-abee-43b7-8b76-2e5f289aae88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6818","nonce":10091},{"type":"v1","addr":"172.21.15.74:6819","nonce":10091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6820","nonce":10091},{"type":"v1","addr":"172.21.15.74:6821","nonce":10091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6824","nonce":10091},{"type":"v1","addr":"172.21.15.74:6825","nonce":10091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6822","nonce":10091},{"type":"v1","addr":"172.21.15.74:6823","nonce":10091}]},"public_addr":"172.21.15.74:6819/10091","cluster_addr":"172.21.15.74:6821/10091","heartbeat_back_addr":"172.21.15.74:6825/10091","heartbeat_front_addr":"172.21.15.74:6823/10091","state":["exists","up"]},{"osd":1,"uuid":"de187634-055e-41ea-82a7-c816f51e1820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6804","nonce":10097},{"type":"v1","addr":"172.21.15.74:6805","nonce":10097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6809","nonce":10097},{"type":"v1","addr":"172.21.15.74:6811","nonce":10097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6816","nonce":10097},{"type":"v1","addr":"172.21.15.74:6817","nonce":10097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6813","nonce":10097},{"type":"v1","addr":"172.21.15.74:6815","nonce":10097}]},"public_addr":"172.21.15.74:6805/10097","cluster_addr":"172.21.15.74:6811/10097","heartbeat_back_addr":"172.21.15.74:6817/10097","heartbeat_front_addr":"172.21.15.74:6815/10097","state":["exists","up"]},{"osd":2,"uuid":"205809ec-bb7b-4c36-a166-67e901b85f99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6826","nonce":10098},{"type":"v1","addr":"172.21.15.74:6827","nonce":10098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6828","nonce":10098},{"type":"v1","addr":"172.21.15.74:6829","nonce":10098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6832","nonce":10098},{"type":"v1","addr":"172.21.15.74:6833","nonce":10098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6830","nonce":10098},{"type":"v1","addr":"172.21.15.74:6831","nonce":10098}]},"public_addr":"172.21.15.74:6827/10098","cluster_addr":"172.21.15.74:6829/10098","heartbeat_back_addr":"172.21.15.74:6833/10098","heartbeat_front_addr":"172.21.15.74:6831/10098","state":["exists","up"]},{"osd":3,"uuid":"af8196a6-1f3d-40bc-80a3-adf4bea9a538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6802","nonce":10096},{"type":"v1","addr":"172.21.15.74:6803","nonce":10096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6806","nonce":10096},{"type":"v1","addr":"172.21.15.74:6807","nonce":10096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6812","nonce":10096},{"type":"v1","addr":"172.21.15.74:6814","nonce":10096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6808","nonce":10096},{"type":"v1","addr":"172.21.15.74:6810","nonce":10096}]},"public_addr":"172.21.15.74:6803/10096","cluster_addr":"172.21.15.74:6807/10096","heartbeat_back_addr":"172.21.15.74:6814/10096","heartbeat_front_addr":"172.21.15.74:6810/10096","state":["exists","up"]},{"osd":4,"uuid":"b9f05f0d-b4dc-4e68-b45c-286c155ef12e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":9903},{"type":"v1","addr":"172.21.15.141:6801","nonce":9903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":9903},{"type":"v1","addr":"172.21.15.141:6803","nonce":9903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6807","nonce":9903},{"type":"v1","addr":"172.21.15.141:6809","nonce":9903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":9903},{"type":"v1","addr":"172.21.15.141:6805","nonce":9903}]},"public_addr":"172.21.15.141:6801/9903","cluster_addr":"172.21.15.141:6803/9903","heartbeat_back_addr":"172.21.15.141:6809/9903","heartbeat_front_addr":"172.21.15.141:6805/9903","state":["exists","up"]},{"osd":5,"uuid":"f45b92eb-1c12-4f90-9f43-cc80eac0e51f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":9905},{"type":"v1","addr":"172.21.15.141:6808","nonce":9905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":9905},{"type":"v1","addr":"172.21.15.141:6811","nonce":9905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":9905},{"type":"v1","addr":"172.21.15.141:6815","nonce":9905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":9905},{"type":"v1","addr":"172.21.15.141:6813","nonce":9905}]},"public_addr":"172.21.15.141:6808/9905","cluster_addr":"172.21.15.141:6811/9905","heartbeat_back_addr":"172.21.15.141:6815/9905","heartbeat_front_addr":"172.21.15.141:6813/9905","state":["exists","up"]},{"osd":6,"uuid":"54870918-6c2c-470b-b61b-4a26c01d9fce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":9904},{"type":"v1","addr":"172.21.15.141:6820","nonce":9904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":9904},{"type":"v1","addr":"172.21.15.141:6824","nonce":9904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":9904},{"type":"v1","addr":"172.21.15.141:6831","nonce":9904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":9904},{"type":"v1","addr":"172.21.15.141:6828","nonce":9904}]},"public_addr":"172.21.15.141:6820/9904","cluster_addr":"172.21.15.141:6824/9904","heartbeat_back_addr":"172.21.15.141:6831/9904","heartbeat_front_addr":"172.21.15.141:6828/9904","state":["exists","up"]},{"osd":7,"uuid":"d7dabb17-88fa-45b9-be80-8dfc0a2af317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":9902},{"type":"v1","addr":"172.21.15.141:6817","nonce":9902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6819","nonce":9902},{"type":"v1","addr":"172.21.15.141:6821","nonce":9902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6827","nonce":9902},{"type":"v1","addr":"172.21.15.141:6829","nonce":9902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6823","nonce":9902},{"type":"v1","addr":"172.21.15.141:6825","nonce":9902}]},"public_addr":"172.21.15.141:6817/9902","cluster_addr":"172.21.15.141:6821/9902","heartbeat_back_addr":"172.21.15.141:6829/9902","heartbeat_front_addr":"172.21.15.141:6825/9902","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T21:46:58.706645+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T21:46:58.092058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T21:46:58.733111+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T21:46:58.705864+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T21:46:58.369192+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T21:46:58.342739+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T21:46:57.914451+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T21:46:57.985684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T21:47:11.816 INFO:tasks.ceph.ceph_manager.ceph:all up! 2019-11-28T21:47:11.816 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-28T21:47:12.652 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:47:12.653 INFO:teuthology.orchestra.run.smithi074.stdout:{"epoch":20,"fsid":"cecd8621-e0c7-45c8-9e74-513fdbad61b1","created":"2019-11-28T21:46:31.444776+0000","modified":"2019-11-28T21:47:09.078168+0000","last_up_change":"2019-11-28T21:47:02.045007+0000","last_in_change":"2019-11-28T21:47:02.045007+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-28T21:47:04.886536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"730deae4-abee-43b7-8b76-2e5f289aae88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6818","nonce":10091},{"type":"v1","addr":"172.21.15.74:6819","nonce":10091}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6820","nonce":10091},{"type":"v1","addr":"172.21.15.74:6821","nonce":10091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6824","nonce":10091},{"type":"v1","addr":"172.21.15.74:6825","nonce":10091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6822","nonce":10091},{"type":"v1","addr":"172.21.15.74:6823","nonce":10091}]},"public_addr":"172.21.15.74:6819/10091","cluster_addr":"172.21.15.74:6821/10091","heartbeat_back_addr":"172.21.15.74:6825/10091","heartbeat_front_addr":"172.21.15.74:6823/10091","state":["exists","up"]},{"osd":1,"uuid":"de187634-055e-41ea-82a7-c816f51e1820","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6804","nonce":10097},{"type":"v1","addr":"172.21.15.74:6805","nonce":10097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6809","nonce":10097},{"type":"v1","addr":"172.21.15.74:6811","nonce":10097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6816","nonce":10097},{"type":"v1","addr":"172.21.15.74:6817","nonce":10097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6813","nonce":10097},{"type":"v1","addr":"172.21.15.74:6815","nonce":10097}]},"public_addr":"172.21.15.74:6805/10097","cluster_addr":"172.21.15.74:6811/10097","heartbeat_back_addr":"172.21.15.74:6817/10097","heartbeat_front_addr":"172.21.15.74:6815/10097","state":["exists","up"]},{"osd":2,"uuid":"205809ec-bb7b-4c36-a166-67e901b85f99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6826","nonce":10098},{"type":"v1","addr":"172.21.15.74:6827","nonce":10098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6828","nonce":10098},{"type":"v1","addr":"172.21.15.74:6829","nonce":10098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6832","nonce":10098},{"type":"v1","addr":"172.21.15.74:6833","nonce":10098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6830","nonce":10098},{"type":"v1","addr":"172.21.15.74:6831","nonce":10098}]},"public_addr":"172.21.15.74:6827/10098","cluster_addr":"172.21.15.74:6829/10098","heartbeat_back_addr":"172.21.15.74:6833/10098","heartbeat_front_addr":"172.21.15.74:6831/10098","state":["exists","up"]},{"osd":3,"uuid":"af8196a6-1f3d-40bc-80a3-adf4bea9a538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6802","nonce":10096},{"type":"v1","addr":"172.21.15.74:6803","nonce":10096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6806","nonce":10096},{"type":"v1","addr":"172.21.15.74:6807","nonce":10096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6812","nonce":10096},{"type":"v1","addr":"172.21.15.74:6814","nonce":10096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.74:6808","nonce":10096},{"type":"v1","addr":"172.21.15.74:6810","nonce":10096}]},"public_addr":"172.21.15.74:6803/10096","cluster_addr":"172.21.15.74:6807/10096","heartbeat_back_addr":"172.21.15.74:6814/10096","heartbeat_front_addr":"172.21.15.74:6810/10096","state":["exists","up"]},{"osd":4,"uuid":"b9f05f0d-b4dc-4e68-b45c-286c155ef12e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6800","nonce":9903},{"type":"v1","addr":"172.21.15.141:6801","nonce":9903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6802","nonce":9903},{"type":"v1","addr":"172.21.15.141:6803","nonce":9903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6807","nonce":9903},{"type":"v1","addr":"172.21.15.141:6809","nonce":9903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6804","nonce":9903},{"type":"v1","addr":"172.21.15.141:6805","nonce":9903}]},"public_addr":"172.21.15.141:6801/9903","cluster_addr":"172.21.15.141:6803/9903","heartbeat_back_addr":"172.21.15.141:6809/9903","heartbeat_front_addr":"172.21.15.141:6805/9903","state":["exists","up"]},{"osd":5,"uuid":"f45b92eb-1c12-4f90-9f43-cc80eac0e51f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6806","nonce":9905},{"type":"v1","addr":"172.21.15.141:6808","nonce":9905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6810","nonce":9905},{"type":"v1","addr":"172.21.15.141:6811","nonce":9905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6814","nonce":9905},{"type":"v1","addr":"172.21.15.141:6815","nonce":9905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6812","nonce":9905},{"type":"v1","addr":"172.21.15.141:6813","nonce":9905}]},"public_addr":"172.21.15.141:6808/9905","cluster_addr":"172.21.15.141:6811/9905","heartbeat_back_addr":"172.21.15.141:6815/9905","heartbeat_front_addr":"172.21.15.141:6813/9905","state":["exists","up"]},{"osd":6,"uuid":"54870918-6c2c-470b-b61b-4a26c01d9fce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6818","nonce":9904},{"type":"v1","addr":"172.21.15.141:6820","nonce":9904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6822","nonce":9904},{"type":"v1","addr":"172.21.15.141:6824","nonce":9904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6830","nonce":9904},{"type":"v1","addr":"172.21.15.141:6831","nonce":9904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6826","nonce":9904},{"type":"v1","addr":"172.21.15.141:6828","nonce":9904}]},"public_addr":"172.21.15.141:6820/9904","cluster_addr":"172.21.15.141:6824/9904","heartbeat_back_addr":"172.21.15.141:6831/9904","heartbeat_front_addr":"172.21.15.141:6828/9904","state":["exists","up"]},{"osd":7,"uuid":"d7dabb17-88fa-45b9-be80-8dfc0a2af317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6816","nonce":9902},{"type":"v1","addr":"172.21.15.141:6817","nonce":9902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6819","nonce":9902},{"type":"v1","addr":"172.21.15.141:6821","nonce":9902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6827","nonce":9902},{"type":"v1","addr":"172.21.15.141:6829","nonce":9902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.141:6823","nonce":9902},{"type":"v1","addr":"172.21.15.141:6825","nonce":9902}]},"public_addr":"172.21.15.141:6817/9902","cluster_addr":"172.21.15.141:6821/9902","heartbeat_back_addr":"172.21.15.141:6829/9902","heartbeat_front_addr":"172.21.15.141:6825/9902","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T21:46:58.706645+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T21:46:58.092058+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T21:46:58.733111+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T21:46:58.705864+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T21:46:58.369192+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T21:46:58.342739+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T21:46:57.914451+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-28T21:46:57.985684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-28T21:47:12.668 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2019-11-28T21:47:13.156 INFO:teuthology.orchestra.run.smithi074.stdout:60129542149 2019-11-28T21:47:13.156 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2019-11-28T21:47:13.667 INFO:teuthology.orchestra.run.smithi074.stdout:60129542150 2019-11-28T21:47:13.667 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2019-11-28T21:47:14.165 INFO:teuthology.orchestra.run.smithi074.stdout:64424509446 2019-11-28T21:47:14.166 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2019-11-28T21:47:14.751 INFO:teuthology.orchestra.run.smithi074.stdout:60129542149 2019-11-28T21:47:14.752 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2019-11-28T21:47:15.314 INFO:teuthology.orchestra.run.smithi074.stdout:60129542150 2019-11-28T21:47:15.315 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2019-11-28T21:47:15.990 INFO:teuthology.orchestra.run.smithi074.stdout:60129542150 2019-11-28T21:47:15.991 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2019-11-28T21:47:16.634 INFO:teuthology.orchestra.run.smithi074.stdout:55834574855 2019-11-28T21:47:16.634 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2019-11-28T21:47:17.231 INFO:teuthology.orchestra.run.smithi074.stdout:55834574854 2019-11-28T21:47:17.232 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2019-11-28T21:47:18.114 INFO:teuthology.orchestra.run.smithi074.stdout:60129542150 2019-11-28T21:47:18.131 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542150 for osd.0 2019-11-28T21:47:18.131 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2019-11-28T21:47:18.996 INFO:teuthology.orchestra.run.smithi074.stdout:60129542151 2019-11-28T21:47:19.011 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542151 for osd.1 2019-11-28T21:47:19.011 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2019-11-28T21:47:19.808 INFO:teuthology.orchestra.run.smithi074.stdout:64424509446 2019-11-28T21:47:19.822 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.2 2019-11-28T21:47:19.823 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2019-11-28T21:47:20.491 INFO:teuthology.orchestra.run.smithi074.stdout:60129542150 2019-11-28T21:47:20.505 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542150 for osd.3 2019-11-28T21:47:20.505 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2019-11-28T21:47:21.304 INFO:teuthology.orchestra.run.smithi074.stdout:60129542151 2019-11-28T21:47:21.319 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542151 for osd.4 2019-11-28T21:47:21.319 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2019-11-28T21:47:22.093 INFO:teuthology.orchestra.run.smithi074.stdout:60129542151 2019-11-28T21:47:22.106 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542151 for osd.5 2019-11-28T21:47:22.106 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2019-11-28T21:47:22.801 INFO:teuthology.orchestra.run.smithi074.stdout:55834574856 2019-11-28T21:47:22.825 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.6 2019-11-28T21:47:22.825 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2019-11-28T21:47:23.593 INFO:teuthology.orchestra.run.smithi074.stdout:55834574855 2019-11-28T21:47:23.610 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.7 2019-11-28T21:47:23.610 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2019-11-28T21:47:23.610 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2019-11-28T21:47:24.348 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:47:24.348 INFO:teuthology.orchestra.run.smithi074.stderr:dumped all 2019-11-28T21:47:24.361 INFO:teuthology.orchestra.run.smithi074.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2019-11-28T21:47:23.497149+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390240,"kb_used_data":1568,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584480,"statfs":{"total":773094113280,"available":764502507520,"internally_reserved":8589934592,"allocated":1605632,"data_stored":509904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-28T21:47:08.694695+0000","last_change":"2019-11-28T21:47:08.678875+0000","last_active":"2019-11-28T21:47:08.694695+0000","last_peered":"2019-11-28T21:47:08.694695+0000","last_clean":"2019-11-28T21:47:08.694695+0000","last_became_active":"2019-11-28T21:47:08.641047+0000","last_became_peered":"2019-11-28T21:47:08.641047+0000","last_unstale":"2019-11-28T21:47:08.694695+0000","last_undegraded":"2019-11-28T21:47:08.694695+0000","last_fullsized":"2019-11-28T21:47:08.694695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T21:47:05.688744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T21:47:05.688744+0000","last_clean_scrub_stamp":"2019-11-28T21:47:05.688744+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-28T21:47:08.270567+0000","last_change":"2019-11-28T21:47:08.104724+0000","last_active":"2019-11-28T21:47:08.270567+0000","last_peered":"2019-11-28T21:47:08.270567+0000","last_clean":"2019-11-28T21:47:08.270567+0000","last_became_active":"2019-11-28T21:47:08.008397+0000","last_became_peered":"2019-11-28T21:47:08.008397+0000","last_unstale":"2019-11-28T21:47:08.270567+0000","last_undegraded":"2019-11-28T21:47:08.270567+0000","last_fullsized":"2019-11-28T21:47:08.270567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T21:47:05.688744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T21:47:05.688744+0000","last_clean_scrub_stamp":"2019-11-28T21:47:05.688744+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-28T21:47:08.717903+0000","last_change":"2019-11-28T21:47:08.694627+0000","last_active":"2019-11-28T21:47:08.717903+0000","last_peered":"2019-11-28T21:47:08.717903+0000","last_clean":"2019-11-28T21:47:08.717903+0000","last_became_active":"2019-11-28T21:47:08.642321+0000","last_became_peered":"2019-11-28T21:47:08.642321+0000","last_unstale":"2019-11-28T21:47:08.717903+0000","last_undegraded":"2019-11-28T21:47:08.717903+0000","last_fullsized":"2019-11-28T21:47:08.717903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T21:47:05.688744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T21:47:05.688744+0000","last_clean_scrub_stamp":"2019-11-28T21:47:05.688744+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-28T21:47:08.514292+0000","last_change":"2019-11-28T21:47:08.482109+0000","last_active":"2019-11-28T21:47:08.514292+0000","last_peered":"2019-11-28T21:47:08.514292+0000","last_clean":"2019-11-28T21:47:08.514292+0000","last_became_active":"2019-11-28T21:47:08.452560+0000","last_became_peered":"2019-11-28T21:47:08.452560+0000","last_unstale":"2019-11-28T21:47:08.514292+0000","last_undegraded":"2019-11-28T21:47:08.514292+0000","last_fullsized":"2019-11-28T21:47:08.514292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T21:47:05.688744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T21:47:05.688744+0000","last_clean_scrub_stamp":"2019-11-28T21:47:05.688744+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-28T21:47:08.742322+0000","last_change":"2019-11-28T21:47:08.734091+0000","last_active":"2019-11-28T21:47:08.742322+0000","last_peered":"2019-11-28T21:47:08.742322+0000","last_clean":"2019-11-28T21:47:08.742322+0000","last_became_active":"2019-11-28T21:47:08.721089+0000","last_became_peered":"2019-11-28T21:47:08.721089+0000","last_unstale":"2019-11-28T21:47:08.742322+0000","last_undegraded":"2019-11-28T21:47:08.742322+0000","last_fullsized":"2019-11-28T21:47:08.742322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T21:47:05.688744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T21:47:05.688744+0000","last_clean_scrub_stamp":"2019-11-28T21:47:05.688744+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-28T21:47:08.261655+0000","last_change":"2019-11-28T21:47:08.137781+0000","last_active":"2019-11-28T21:47:08.261655+0000","last_peered":"2019-11-28T21:47:08.261655+0000","last_clean":"2019-11-28T21:47:08.261655+0000","last_became_active":"2019-11-28T21:47:08.054796+0000","last_became_peered":"2019-11-28T21:47:08.054796+0000","last_unstale":"2019-11-28T21:47:08.261655+0000","last_undegraded":"2019-11-28T21:47:08.261655+0000","last_fullsized":"2019-11-28T21:47:08.261655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T21:47:05.688744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T21:47:05.688744+0000","last_clean_scrub_stamp":"2019-11-28T21:47:05.688744+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-28T21:47:08.491019+0000","last_change":"2019-11-28T21:47:08.447165+0000","last_active":"2019-11-28T21:47:08.491019+0000","last_peered":"2019-11-28T21:47:08.491019+0000","last_clean":"2019-11-28T21:47:08.491019+0000","last_became_active":"2019-11-28T21:47:08.409009+0000","last_became_peered":"2019-11-28T21:47:08.409009+0000","last_unstale":"2019-11-28T21:47:08.491019+0000","last_undegraded":"2019-11-28T21:47:08.491019+0000","last_fullsized":"2019-11-28T21:47:08.491019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T21:47:05.688744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T21:47:05.688744+0000","last_clean_scrub_stamp":"2019-11-28T21:47:05.688744+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-28T21:47:08.255709+0000","last_change":"2019-11-28T21:47:08.234689+0000","last_active":"2019-11-28T21:47:08.255709+0000","last_peered":"2019-11-28T21:47:08.255709+0000","last_clean":"2019-11-28T21:47:08.255709+0000","last_became_active":"2019-11-28T21:47:08.208978+0000","last_became_peered":"2019-11-28T21:47:08.208978+0000","last_unstale":"2019-11-28T21:47:08.255709+0000","last_undegraded":"2019-11-28T21:47:08.255709+0000","last_fullsized":"2019-11-28T21:47:08.255709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T21:47:05.688744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T21:47:05.688744+0000","last_clean_scrub_stamp":"2019-11-28T21:47:05.688744+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048780,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323060,"statfs":{"total":96636764160,"available":95562813440,"internally_reserved":1073741824,"allocated":200704,"data_stored":63738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.028}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":7.592}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":12.096}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":11.007}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":16.218}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":13.853}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":10.616}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048780,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323060,"statfs":{"total":96636764160,"available":95562813440,"internally_reserved":1073741824,"allocated":200704,"data_stored":63738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":12.669}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":33.181}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.762}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.302}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":36.567}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.326}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":38.384}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048780,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323060,"statfs":{"total":96636764160,"available":95562813440,"internally_reserved":1073741824,"allocated":200704,"data_stored":63738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.830}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.677}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.971}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":39.903}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":42.970}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":36.859}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.321}]}]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048780,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323060,"statfs":{"total":96636764160,"available":95562813440,"internally_reserved":1073741824,"allocated":200704,"data_stored":63738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.888}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":13.994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":38.060}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":41.781}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":54.858}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":43.492}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":52.115}]}]},{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048780,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323060,"statfs":{"total":96636764160,"available":95562813440,"internally_reserved":1073741824,"allocated":200704,"data_stored":63738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":43.076}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.785}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.458}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":38.770}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":26.212}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.895}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.503}]}]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048780,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323060,"statfs":{"total":96636764160,"available":95562813440,"internally_reserved":1073741824,"allocated":200704,"data_stored":63738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":26.935}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.462}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.706}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.432}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.636}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.340}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.279}]}]},{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048780,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323060,"statfs":{"total":96636764160,"available":95562813440,"internally_reserved":1073741824,"allocated":200704,"data_stored":63738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":19.760}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":16.221}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.205}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":14.838}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.228}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.356}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":25.315}]}]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048780,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323060,"statfs":{"total":96636764160,"available":95562813440,"internally_reserved":1073741824,"allocated":200704,"data_stored":63738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":13.256}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.455}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":19.414}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.486}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.326}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.639}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.090}]}]}]}} 2019-11-28T21:47:24.364 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2019-11-28T21:47:25.017 INFO:teuthology.orchestra.run.smithi074.stderr:dumped all 2019-11-28T21:47:25.017 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:47:25.033 INFO:teuthology.orchestra.run.smithi074.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2019-11-28T21:47:23.497149+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390240,"kb_used_data":1568,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584480,"statfs":{"total":773094113280,"available":764502507520,"internally_reserved":8589934592,"allocated":1605632,"data_stored":509904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-28T21:47:08.694695+0000","last_change":"2019-11-28T21:47:08.678875+0000","last_active":"2019-11-28T21:47:08.694695+0000","last_peered":"2019-11-28T21:47:08.694695+0000","last_clean":"2019-11-28T21:47:08.694695+0000","last_became_active":"2019-11-28T21:47:08.641047+0000","last_became_peered":"2019-11-28T21:47:08.641047+0000","last_unstale":"2019-11-28T21:47:08.694695+0000","last_undegraded":"2019-11-28T21:47:08.694695+0000","last_fullsized":"2019-11-28T21:47:08.694695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T21:47:05.688744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T21:47:05.688744+0000","last_clean_scrub_stamp":"2019-11-28T21:47:05.688744+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-28T21:47:08.270567+0000","last_change":"2019-11-28T21:47:08.104724+0000","last_active":"2019-11-28T21:47:08.270567+0000","last_peered":"2019-11-28T21:47:08.270567+0000","last_clean":"2019-11-28T21:47:08.270567+0000","last_became_active":"2019-11-28T21:47:08.008397+0000","last_became_peered":"2019-11-28T21:47:08.008397+0000","last_unstale":"2019-11-28T21:47:08.270567+0000","last_undegraded":"2019-11-28T21:47:08.270567+0000","last_fullsized":"2019-11-28T21:47:08.270567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T21:47:05.688744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T21:47:05.688744+0000","last_clean_scrub_stamp":"2019-11-28T21:47:05.688744+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-28T21:47:08.717903+0000","last_change":"2019-11-28T21:47:08.694627+0000","last_active":"2019-11-28T21:47:08.717903+0000","last_peered":"2019-11-28T21:47:08.717903+0000","last_clean":"2019-11-28T21:47:08.717903+0000","last_became_active":"2019-11-28T21:47:08.642321+0000","last_became_peered":"2019-11-28T21:47:08.642321+0000","last_unstale":"2019-11-28T21:47:08.717903+0000","last_undegraded":"2019-11-28T21:47:08.717903+0000","last_fullsized":"2019-11-28T21:47:08.717903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T21:47:05.688744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T21:47:05.688744+0000","last_clean_scrub_stamp":"2019-11-28T21:47:05.688744+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-28T21:47:08.514292+0000","last_change":"2019-11-28T21:47:08.482109+0000","last_active":"2019-11-28T21:47:08.514292+0000","last_peered":"2019-11-28T21:47:08.514292+0000","last_clean":"2019-11-28T21:47:08.514292+0000","last_became_active":"2019-11-28T21:47:08.452560+0000","last_became_peered":"2019-11-28T21:47:08.452560+0000","last_unstale":"2019-11-28T21:47:08.514292+0000","last_undegraded":"2019-11-28T21:47:08.514292+0000","last_fullsized":"2019-11-28T21:47:08.514292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T21:47:05.688744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T21:47:05.688744+0000","last_clean_scrub_stamp":"2019-11-28T21:47:05.688744+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-28T21:47:08.742322+0000","last_change":"2019-11-28T21:47:08.734091+0000","last_active":"2019-11-28T21:47:08.742322+0000","last_peered":"2019-11-28T21:47:08.742322+0000","last_clean":"2019-11-28T21:47:08.742322+0000","last_became_active":"2019-11-28T21:47:08.721089+0000","last_became_peered":"2019-11-28T21:47:08.721089+0000","last_unstale":"2019-11-28T21:47:08.742322+0000","last_undegraded":"2019-11-28T21:47:08.742322+0000","last_fullsized":"2019-11-28T21:47:08.742322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T21:47:05.688744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T21:47:05.688744+0000","last_clean_scrub_stamp":"2019-11-28T21:47:05.688744+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-28T21:47:08.261655+0000","last_change":"2019-11-28T21:47:08.137781+0000","last_active":"2019-11-28T21:47:08.261655+0000","last_peered":"2019-11-28T21:47:08.261655+0000","last_clean":"2019-11-28T21:47:08.261655+0000","last_became_active":"2019-11-28T21:47:08.054796+0000","last_became_peered":"2019-11-28T21:47:08.054796+0000","last_unstale":"2019-11-28T21:47:08.261655+0000","last_undegraded":"2019-11-28T21:47:08.261655+0000","last_fullsized":"2019-11-28T21:47:08.261655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T21:47:05.688744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T21:47:05.688744+0000","last_clean_scrub_stamp":"2019-11-28T21:47:05.688744+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-28T21:47:08.491019+0000","last_change":"2019-11-28T21:47:08.447165+0000","last_active":"2019-11-28T21:47:08.491019+0000","last_peered":"2019-11-28T21:47:08.491019+0000","last_clean":"2019-11-28T21:47:08.491019+0000","last_became_active":"2019-11-28T21:47:08.409009+0000","last_became_peered":"2019-11-28T21:47:08.409009+0000","last_unstale":"2019-11-28T21:47:08.491019+0000","last_undegraded":"2019-11-28T21:47:08.491019+0000","last_fullsized":"2019-11-28T21:47:08.491019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T21:47:05.688744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T21:47:05.688744+0000","last_clean_scrub_stamp":"2019-11-28T21:47:05.688744+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-28T21:47:08.255709+0000","last_change":"2019-11-28T21:47:08.234689+0000","last_active":"2019-11-28T21:47:08.255709+0000","last_peered":"2019-11-28T21:47:08.255709+0000","last_clean":"2019-11-28T21:47:08.255709+0000","last_became_active":"2019-11-28T21:47:08.208978+0000","last_became_peered":"2019-11-28T21:47:08.208978+0000","last_unstale":"2019-11-28T21:47:08.255709+0000","last_undegraded":"2019-11-28T21:47:08.255709+0000","last_fullsized":"2019-11-28T21:47:08.255709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-28T21:47:05.688744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-28T21:47:05.688744+0000","last_clean_scrub_stamp":"2019-11-28T21:47:05.688744+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048780,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323060,"statfs":{"total":96636764160,"available":95562813440,"internally_reserved":1073741824,"allocated":200704,"data_stored":63738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.028}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":7.592}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":12.096}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":11.007}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":16.218}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":13.853}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":10.616}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048780,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323060,"statfs":{"total":96636764160,"available":95562813440,"internally_reserved":1073741824,"allocated":200704,"data_stored":63738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":12.669}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":33.181}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.762}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.302}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":36.567}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.326}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":38.384}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048780,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323060,"statfs":{"total":96636764160,"available":95562813440,"internally_reserved":1073741824,"allocated":200704,"data_stored":63738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.830}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.677}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.971}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":39.903}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":42.970}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":36.859}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.321}]}]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048780,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323060,"statfs":{"total":96636764160,"available":95562813440,"internally_reserved":1073741824,"allocated":200704,"data_stored":63738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.888}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":13.994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":38.060}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":41.781}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":54.858}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":43.492}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":52.115}]}]},{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048780,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323060,"statfs":{"total":96636764160,"available":95562813440,"internally_reserved":1073741824,"allocated":200704,"data_stored":63738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":43.076}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.785}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.458}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":38.770}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":26.212}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.895}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.503}]}]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048780,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323060,"statfs":{"total":96636764160,"available":95562813440,"internally_reserved":1073741824,"allocated":200704,"data_stored":63738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":26.935}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.462}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.706}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.432}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.636}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.340}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.279}]}]},{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048780,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323060,"statfs":{"total":96636764160,"available":95562813440,"internally_reserved":1073741824,"allocated":200704,"data_stored":63738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":19.760}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":16.221}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.205}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":14.838}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.228}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.356}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":25.315}]}]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048780,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323060,"statfs":{"total":96636764160,"available":95562813440,"internally_reserved":1073741824,"allocated":200704,"data_stored":63738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":13.256}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.455}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":19.414}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.486}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.326}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.639}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.090}]}]}]}} 2019-11-28T21:47:25.036 INFO:tasks.ceph.ceph_manager.ceph:clean! 2019-11-28T21:47:25.036 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2019-11-28T21:47:25.036 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2019-11-28T21:47:25.036 INFO:teuthology.orchestra.run.smithi074:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2019-11-28T21:47:25.840 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:47:25.863 INFO:teuthology.orchestra.run.smithi074.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2019-11-28T21:47:25.863 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2019-11-28T21:47:25.863 INFO:teuthology.run_tasks:Running task openssl_keys... 2019-11-28T21:47:26.038 INFO:teuthology.run_tasks:Running task rgw... 2019-11-28T21:47:26.055 DEBUG:tasks.rgw:config is {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2019-11-28T21:47:26.056 DEBUG:tasks.rgw:client list is ['client.0'] 2019-11-28T21:47:26.056 INFO:tasks.rgw:Creating data pools 2019-11-28T21:47:26.056 DEBUG:tasks.rgw:Obtaining remote for client client.0 2019-11-28T21:47:26.056 INFO:teuthology.orchestra.run.smithi074:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=2 m=1 --cluster ceph 2019-11-28T21:47:27.945 INFO:teuthology.orchestra.run.smithi074:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2019-11-28T21:47:30.740 INFO:teuthology.orchestra.run.smithi074.stderr:pool 'default.rgw.buckets.data' created 2019-11-28T21:47:30.757 INFO:teuthology.orchestra.run.smithi074:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2019-11-28T21:47:32.012 INFO:teuthology.orchestra.run.smithi074.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2019-11-28T21:47:32.030 INFO:teuthology.orchestra.run.smithi074:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2019-11-28T21:47:33.272 INFO:teuthology.orchestra.run.smithi074.stderr:pool 'default.rgw.buckets.index' created 2019-11-28T21:47:33.285 INFO:teuthology.orchestra.run.smithi074:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2019-11-28T21:47:34.342 INFO:teuthology.orchestra.run.smithi074.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2019-11-28T21:47:34.357 DEBUG:tasks.rgw:Pools created 2019-11-28T21:47:34.357 INFO:tasks.rgw:Configuring compression type = random 2019-11-28T21:47:34.357 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2019-11-28T21:47:34.357 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2019-11-28T21:47:34.357 INFO:teuthology.orchestra.run.smithi074:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2019-11-28T21:47:34.605 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:34.607+0000 7f28bbee3ec0 20 rados->read ofs=0 len=0 2019-11-28T21:47:37.253 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:37.251+0000 7f28bbee3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:47:37.253 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:37.251+0000 7f28bbee3ec0 20 rados->read ofs=0 len=0 2019-11-28T21:47:37.324 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:37.325+0000 7f28bbee3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:47:37.324 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:37.325+0000 7f28bbee3ec0 20 rados->read ofs=0 len=0 2019-11-28T21:47:37.340 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:37.340+0000 7f28bbee3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:47:37.341 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:37.340+0000 7f28bbee3ec0 20 rados->read ofs=0 len=0 2019-11-28T21:47:37.441 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:37.438+0000 7f28bbee3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:47:38.728 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:38.729+0000 7f28bbee3ec0 20 rados->read ofs=0 len=0 2019-11-28T21:47:38.745 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:38.738+0000 7f28bbee3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:47:38.745 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:38.738+0000 7f28bbee3ec0 20 rados->read ofs=0 len=0 2019-11-28T21:47:38.746 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:38.746+0000 7f28bbee3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:47:38.746 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:38.746+0000 7f28bbee3ec0 20 rados->read ofs=0 len=0 2019-11-28T21:47:38.770 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:38.756+0000 7f28bbee3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:47:38.770 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:38.756+0000 7f28bbee3ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-28T21:47:38.770 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:38.756+0000 7f28bbee3ec0 20 rados->read ofs=0 len=0 2019-11-28T21:47:38.770 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:38.765+0000 7f28bbee3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:47:38.770 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:38.765+0000 7f28bbee3ec0 20 rados->read ofs=0 len=0 2019-11-28T21:47:38.775 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:38.772+0000 7f28bbee3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:47:38.775 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:38.772+0000 7f28bbee3ec0 10 Creating default zonegroup 2019-11-28T21:47:38.775 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:38.772+0000 7f28bbee3ec0 20 get_system_obj_state: rctx=0x7ffe4aa866b0 obj=:.pools.avail state=0x556d92e9d590 s->prefetch_data=0 2019-11-28T21:47:38.779 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:38.776+0000 7f28bbee3ec0 10 couldn't find old data placement pools config, setting up new ones for the zone 2019-11-28T21:47:38.965 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:38.966+0000 7f28bbee3ec0 10 WARNING: store->list_zones() returned r=-2 2019-11-28T21:47:38.965 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:38.966+0000 7f28bbee3ec0 20 rados->read ofs=0 len=0 2019-11-28T21:47:38.980 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:38.979+0000 7f28bbee3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:47:39.903 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:39.905+0000 7f28bbee3ec0 20 rados->read ofs=0 len=0 2019-11-28T21:47:39.911 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:39.912+0000 7f28bbee3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:47:39.911 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:39.912+0000 7f28bbee3ec0 10 could not read realm id: (2) No such file or directory 2019-11-28T21:47:39.911 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:39.913+0000 7f28bbee3ec0 10 WARNING: failed to set zone as default, r=-22 2019-11-28T21:47:39.911 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:39.913+0000 7f28bbee3ec0 20 rados->read ofs=0 len=0 2019-11-28T21:47:39.918 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:39.920+0000 7f28bbee3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:47:40.588 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:40.590+0000 7f28a9110700 0 -- 172.21.15.74:0/3418872754 >> [v2:172.21.15.141:6816/9902,v1:172.21.15.141:6817/9902] conn(0x556d92e96460 msgr2=0x556d92e98880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-28T21:47:40.588 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:40.590+0000 7f28bbee3ec0 20 rados->read ofs=0 len=0 2019-11-28T21:47:40.642 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:40.645+0000 7f28bbee3ec0 20 rados_obj.operate() r=0 bl.length=805 2019-11-28T21:47:40.643 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:40.645+0000 7f28bbee3ec0 20 rados->read ofs=0 len=0 2019-11-28T21:47:40.706 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:40.707+0000 7f28bbee3ec0 20 rados_obj.operate() r=0 bl.length=348 2019-11-28T21:47:40.707 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:40.707+0000 7f28bbee3ec0 20 zonegroup default 2019-11-28T21:47:40.707 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:40.707+0000 7f28bbee3ec0 20 rados->read ofs=0 len=0 2019-11-28T21:47:40.714 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:40.717+0000 7f28bbee3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:47:40.715 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:40.717+0000 7f28bbee3ec0 10 Cannot find current period zone using local zone 2019-11-28T21:47:40.715 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:40.717+0000 7f28bbee3ec0 10 Using default name default 2019-11-28T21:47:40.715 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:40.717+0000 7f28bbee3ec0 20 rados->read ofs=0 len=0 2019-11-28T21:47:40.763 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:40.765+0000 7f28bbee3ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T21:47:40.763 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:40.765+0000 7f28bbee3ec0 20 rados->read ofs=0 len=0 2019-11-28T21:47:40.781 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:40.783+0000 7f28bbee3ec0 20 rados_obj.operate() r=0 bl.length=805 2019-11-28T21:47:40.781 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:40.783+0000 7f28bbee3ec0 20 zone default found 2019-11-28T21:47:40.781 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:40.783+0000 7f28bbee3ec0 20 started sync module instance, tier type = 2019-11-28T21:47:40.781 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:40.783+0000 7f28bbee3ec0 20 started zone id=bd5ae442-b074-4d35-94cc-b1d71bd6ac02 (name=default) with tier type = 2019-11-28T21:47:44.273 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:44.275+0000 7f28a9911700 0 -- 172.21.15.74:0/3418872754 >> [v2:172.21.15.74:6802/10096,v1:172.21.15.74:6803/10096] conn(0x7f289c015ff0 msgr2=0x7f289c017d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-28T21:47:45.156 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:45.157+0000 7f28bbee3ec0 20 add_watcher() i=0 2019-11-28T21:47:45.156 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:45.157+0000 7f28bbee3ec0 20 add_watcher() i=1 2019-11-28T21:47:45.156 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:45.157+0000 7f28bbee3ec0 20 add_watcher() i=2 2019-11-28T21:47:45.156 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:45.157+0000 7f28bbee3ec0 20 add_watcher() i=3 2019-11-28T21:47:45.156 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:45.157+0000 7f28bbee3ec0 20 add_watcher() i=4 2019-11-28T21:47:45.157 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:45.157+0000 7f28bbee3ec0 20 add_watcher() i=5 2019-11-28T21:47:45.177 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:45.178+0000 7f28bbee3ec0 20 add_watcher() i=6 2019-11-28T21:47:45.202 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:45.204+0000 7f28bbee3ec0 20 add_watcher() i=7 2019-11-28T21:47:45.202 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:45.204+0000 7f28bbee3ec0 2 all 8 watchers are set, enabling cache 2019-11-28T21:47:45.202 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:45.204+0000 7f2878fe9700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-28T21:47:49.061 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:49.063+0000 7f28bbee3ec0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2019-11-28T21:47:53.782 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:53.784+0000 7f28bbee3ec0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.log 2019-11-28T21:47:57.907 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:57.909+0000 7f27e2ffd700 20 reqs_thread_entry: start 2019-11-28T21:47:57.907 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:57.910+0000 7f27e0ff9700 20 reqs_thread_entry: start 2019-11-28T21:47:57.907 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:57.910+0000 7f28bbee3ec0 20 init_complete bucket index max shards: 0 2019-11-28T21:47:57.908 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:57.911+0000 7f27ceffd700 20 reqs_thread_entry: start 2019-11-28T21:47:58.190 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:58.193+0000 7f28bbee3ec0 20 remove_watcher() i=0 2019-11-28T21:47:58.191 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:58.193+0000 7f28bbee3ec0 2 removed watcher, disabling cache 2019-11-28T21:47:58.289 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:58.292+0000 7f28bbee3ec0 20 remove_watcher() i=1 2019-11-28T21:47:58.383 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:58.386+0000 7f28bbee3ec0 20 remove_watcher() i=2 2019-11-28T21:47:58.475 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:58.477+0000 7f28bbee3ec0 20 remove_watcher() i=3 2019-11-28T21:47:58.544 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:58.547+0000 7f28bbee3ec0 20 remove_watcher() i=4 2019-11-28T21:47:58.594 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:58.597+0000 7f28bbee3ec0 20 remove_watcher() i=5 2019-11-28T21:47:58.651 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:58.654+0000 7f28bbee3ec0 20 remove_watcher() i=6 2019-11-28T21:47:58.689 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:58.692+0000 7f28bbee3ec0 20 remove_watcher() i=7 2019-11-28T21:47:58.695 INFO:teuthology.orchestra.run.smithi074.stdout:[] 2019-11-28T21:47:58.696 DEBUG:tasks.util.rgw: json result: [] 2019-11-28T21:47:58.696 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2019-11-28T21:47:58.696 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2019-11-28T21:47:58.696 INFO:teuthology.orchestra.run.smithi074:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2019-11-28T21:47:58.882 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:58.884+0000 7fa18dffb700 20 reqs_thread_entry: start 2019-11-28T21:47:58.882 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:58.885+0000 7fa258d78ec0 20 rados->read ofs=0 len=0 2019-11-28T21:47:58.905 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:58.908+0000 7fa258d78ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T21:47:58.905 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:58.908+0000 7fa258d78ec0 20 rados->read ofs=0 len=0 2019-11-28T21:47:58.923 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:58.926+0000 7fa258d78ec0 20 rados_obj.operate() r=0 bl.length=805 2019-11-28T21:47:58.923 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:58.926+0000 7fa258d78ec0 20 rados->read ofs=0 len=0 2019-11-28T21:47:58.939 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:58.942+0000 7fa258d78ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:47:58.939 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:58.942+0000 7fa258d78ec0 20 rados->read ofs=0 len=0 2019-11-28T21:47:58.953 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:58.956+0000 7fa258d78ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T21:47:58.953 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:58.956+0000 7fa258d78ec0 20 rados->read ofs=0 len=0 2019-11-28T21:47:58.964 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:58.966+0000 7fa258d78ec0 20 rados_obj.operate() r=0 bl.length=348 2019-11-28T21:47:59.115 INFO:teuthology.orchestra.run.smithi074.stdout:{"id":"bd5ae442-b074-4d35-94cc-b1d71bd6ac02","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2019-11-28T21:47:59.116 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'bd5ae442-b074-4d35-94cc-b1d71bd6ac02', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2019-11-28T21:47:59.116 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2019-11-28T21:47:59.116 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2019-11-28T21:47:59.116 INFO:teuthology.orchestra.run.smithi074:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2019-11-28T21:47:59.299 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.301+0000 7f18ecb50ec0 20 rados->read ofs=0 len=0 2019-11-28T21:47:59.335 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.338+0000 7f18ecb50ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:47:59.335 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.338+0000 7f18ecb50ec0 20 rados->read ofs=0 len=0 2019-11-28T21:47:59.349 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.349+0000 7f18ecb50ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:47:59.349 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.349+0000 7f18ecb50ec0 20 rados->read ofs=0 len=0 2019-11-28T21:47:59.362 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.364+0000 7f18ecb50ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:47:59.362 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.364+0000 7f18ecb50ec0 20 rados->read ofs=0 len=0 2019-11-28T21:47:59.386 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.388+0000 7f18ecb50ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T21:47:59.686 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.689+0000 7f18ecb50ec0 20 RGWRados::pool_iterate: got zonegroup_info.cb1773b4-411c-4317-a760-df89ca0f54fc 2019-11-28T21:47:59.686 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.689+0000 7f18ecb50ec0 20 RGWRados::pool_iterate: got zone_info.bd5ae442-b074-4d35-94cc-b1d71bd6ac02 2019-11-28T21:47:59.687 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.689+0000 7f18ecb50ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-28T21:47:59.687 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.689+0000 7f18ecb50ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-28T21:47:59.687 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.689+0000 7f18ecb50ec0 20 rados->read ofs=0 len=0 2019-11-28T21:47:59.703 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.706+0000 7f18ecb50ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T21:47:59.703 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.706+0000 7f18ecb50ec0 20 rados->read ofs=0 len=0 2019-11-28T21:47:59.727 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.730+0000 7f18ecb50ec0 20 rados_obj.operate() r=0 bl.length=821 2019-11-28T21:47:59.728 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.730+0000 7f18ecb50ec0 20 rados->read ofs=0 len=0 2019-11-28T21:47:59.741 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.744+0000 7f18ecb50ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T21:47:59.741 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.744+0000 7f18ecb50ec0 20 rados->read ofs=0 len=0 2019-11-28T21:47:59.752 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.755+0000 7f18ecb50ec0 20 rados_obj.operate() r=0 bl.length=348 2019-11-28T21:47:59.753 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.755+0000 7f18ecb50ec0 20 rados->read ofs=0 len=0 2019-11-28T21:47:59.763 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.765+0000 7f18ecb50ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:47:59.763 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.765+0000 7f18ecb50ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-28T21:47:59.763 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.765+0000 7f18ecb50ec0 20 rados->read ofs=0 len=0 2019-11-28T21:47:59.771 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.773+0000 7f18ecb50ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:47:59.771 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.773+0000 7f18ecb50ec0 20 rados->read ofs=0 len=0 2019-11-28T21:47:59.782 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.783+0000 7f18ecb50ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T21:47:59.782 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.783+0000 7f18ecb50ec0 20 rados->read ofs=0 len=0 2019-11-28T21:47:59.790 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.793+0000 7f18ecb50ec0 20 rados_obj.operate() r=0 bl.length=348 2019-11-28T21:47:59.790 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.793+0000 7f18ecb50ec0 20 zonegroup default 2019-11-28T21:47:59.791 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.793+0000 7f18ecb50ec0 20 rados->read ofs=0 len=0 2019-11-28T21:47:59.799 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.802+0000 7f18ecb50ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:47:59.799 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.802+0000 7f18ecb50ec0 10 Cannot find current period zone using local zone 2019-11-28T21:47:59.800 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.802+0000 7f18ecb50ec0 20 rados->read ofs=0 len=0 2019-11-28T21:47:59.807 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.810+0000 7f18ecb50ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:47:59.807 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.810+0000 7f18ecb50ec0 20 rados->read ofs=0 len=0 2019-11-28T21:47:59.819 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.821+0000 7f18ecb50ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T21:47:59.820 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.821+0000 7f18ecb50ec0 20 rados->read ofs=0 len=0 2019-11-28T21:47:59.830 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.832+0000 7f18ecb50ec0 20 rados_obj.operate() r=0 bl.length=821 2019-11-28T21:47:59.831 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.832+0000 7f18ecb50ec0 20 zone default found 2019-11-28T21:47:59.831 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.832+0000 7f18ecb50ec0 20 started sync module instance, tier type = 2019-11-28T21:47:59.831 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:47:59.833+0000 7f18ecb50ec0 20 started zone id=bd5ae442-b074-4d35-94cc-b1d71bd6ac02 (name=default) with tier type = 2019-11-28T21:48:00.316 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:00.319+0000 7f18ecb50ec0 20 add_watcher() i=0 2019-11-28T21:48:00.316 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:00.319+0000 7f18ecb50ec0 20 add_watcher() i=1 2019-11-28T21:48:00.316 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:00.319+0000 7f18ecb50ec0 20 add_watcher() i=2 2019-11-28T21:48:00.316 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:00.319+0000 7f18ecb50ec0 20 add_watcher() i=3 2019-11-28T21:48:00.317 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:00.319+0000 7f18ecb50ec0 20 add_watcher() i=4 2019-11-28T21:48:00.317 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:00.319+0000 7f18ecb50ec0 20 add_watcher() i=5 2019-11-28T21:48:00.319 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:00.322+0000 7f18ecb50ec0 20 add_watcher() i=6 2019-11-28T21:48:00.346 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:00.349+0000 7f18ecb50ec0 20 add_watcher() i=7 2019-11-28T21:48:00.346 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:00.349+0000 7f18ecb50ec0 2 all 8 watchers are set, enabling cache 2019-11-28T21:48:00.346 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:00.349+0000 7f18aa7dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-28T21:48:00.348 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:00.351+0000 7f18da57e700 0 -- 172.21.15.74:0/989891064 >> v2:172.21.15.141:3300/0 conn(0x558d9d055110 msgr2=0x558d9d055520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-28T21:48:00.386 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:00.387+0000 7f18da57e700 0 -- 172.21.15.74:0/3904280592 >> [v2:172.21.15.74:6800/9122,v1:172.21.15.74:6801/9122] conn(0x7f181c0175b0 msgr2=0x7f181c019a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-28T21:48:02.895 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:02.898+0000 7f1820ff9700 20 reqs_thread_entry: start 2019-11-28T21:48:02.933 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:02.898+0000 7f18127fc700 20 reqs_thread_entry: start 2019-11-28T21:48:02.933 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:02.898+0000 7f18ecb50ec0 20 init_complete bucket index max shards: 0 2019-11-28T21:48:02.934 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:02.899+0000 7f1810ff9700 20 reqs_thread_entry: start 2019-11-28T21:48:03.129 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:03.131+0000 7f18ecb50ec0 20 remove_watcher() i=0 2019-11-28T21:48:03.129 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:03.131+0000 7f18ecb50ec0 2 removed watcher, disabling cache 2019-11-28T21:48:03.204 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:03.207+0000 7f18ecb50ec0 20 remove_watcher() i=1 2019-11-28T21:48:03.253 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:03.255+0000 7f18ecb50ec0 20 remove_watcher() i=2 2019-11-28T21:48:03.330 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:03.333+0000 7f18ecb50ec0 20 remove_watcher() i=3 2019-11-28T21:48:03.401 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:03.404+0000 7f18ecb50ec0 20 remove_watcher() i=4 2019-11-28T21:48:03.467 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:03.469+0000 7f18ecb50ec0 20 remove_watcher() i=5 2019-11-28T21:48:03.531 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:03.534+0000 7f18ecb50ec0 20 remove_watcher() i=6 2019-11-28T21:48:03.583 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:03.586+0000 7f18ecb50ec0 20 remove_watcher() i=7 2019-11-28T21:48:03.591 INFO:teuthology.orchestra.run.smithi074.stdout:[] 2019-11-28T21:48:03.591 DEBUG:tasks.util.rgw: json result: [] 2019-11-28T21:48:03.591 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2019-11-28T21:48:03.592 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2019-11-28T21:48:03.592 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2019-11-28T21:48:03.592 INFO:teuthology.orchestra.run.smithi074:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2019-11-28T21:48:03.753 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:03.756+0000 7f2ef27fc700 20 reqs_thread_entry: start 2019-11-28T21:48:03.753 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:03.756+0000 7f2fbced1ec0 20 rados->read ofs=0 len=0 2019-11-28T21:48:03.772 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:03.775+0000 7f2fbced1ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:48:03.773 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:03.775+0000 7f2fbced1ec0 20 rados->read ofs=0 len=0 2019-11-28T21:48:03.798 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:03.801+0000 7f2fbced1ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T21:48:03.799 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:03.801+0000 7f2fbced1ec0 20 rados->read ofs=0 len=0 2019-11-28T21:48:03.813 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:03.817+0000 7f2fbced1ec0 20 rados_obj.operate() r=0 bl.length=348 2019-11-28T21:48:03.814 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:03.817+0000 7f2fbced1ec0 20 rados->read ofs=0 len=0 2019-11-28T21:48:03.838 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:03.841+0000 7f2fbced1ec0 20 rados_obj.operate() r=0 bl.length=821 2019-11-28T21:48:04.010 INFO:teuthology.orchestra.run.smithi074.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2019-11-28T21:48:04.011 DEBUG:tasks.util.rgw: json result: [{u'val': {u'storage_classes': [u'LUKEWARM', u'STANDARD'], u'name': u'default-placement', u'tags': []}, u'key': u'default-placement'}] 2019-11-28T21:48:04.011 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2019-11-28T21:48:04.011 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2019-11-28T21:48:04.011 INFO:teuthology.orchestra.run.smithi074:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2019-11-28T21:48:04.204 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:04.207+0000 7fa61affd700 20 reqs_thread_entry: start 2019-11-28T21:48:04.205 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:04.207+0000 7fa6e58d9ec0 20 rados->read ofs=0 len=0 2019-11-28T21:48:04.233 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:04.236+0000 7fa6e58d9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T21:48:04.233 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:04.236+0000 7fa6e58d9ec0 20 rados->read ofs=0 len=0 2019-11-28T21:48:04.252 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:04.255+0000 7fa6e58d9ec0 20 rados_obj.operate() r=0 bl.length=821 2019-11-28T21:48:04.252 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:04.255+0000 7fa6e58d9ec0 20 rados->read ofs=0 len=0 2019-11-28T21:48:04.263 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:04.266+0000 7fa6e58d9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:48:04.263 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:04.266+0000 7fa6e58d9ec0 20 rados->read ofs=0 len=0 2019-11-28T21:48:04.284 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:04.287+0000 7fa6e58d9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T21:48:04.285 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:04.288+0000 7fa6e58d9ec0 20 rados->read ofs=0 len=0 2019-11-28T21:48:04.301 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:04.304+0000 7fa6e58d9ec0 20 rados_obj.operate() r=0 bl.length=372 2019-11-28T21:48:04.350 INFO:teuthology.orchestra.run.smithi074.stdout:{"id":"bd5ae442-b074-4d35-94cc-b1d71bd6ac02","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2019-11-28T21:48:04.351 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'LUKEWARM': {u'data_pool': u'default.rgw.buckets.data.lukewarm'}, u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'bd5ae442-b074-4d35-94cc-b1d71bd6ac02', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2019-11-28T21:48:04.351 INFO:tasks.rgw:Configuring storage class type = FROZEN 2019-11-28T21:48:04.351 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2019-11-28T21:48:04.351 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2019-11-28T21:48:04.352 INFO:teuthology.orchestra.run.smithi074:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2019-11-28T21:48:04.528 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:04.530+0000 7fa4977fe700 20 reqs_thread_entry: start 2019-11-28T21:48:04.528 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:04.530+0000 7fa5626c3ec0 20 rados->read ofs=0 len=0 2019-11-28T21:48:04.545 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:04.548+0000 7fa5626c3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:48:04.545 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:04.548+0000 7fa5626c3ec0 20 rados->read ofs=0 len=0 2019-11-28T21:48:04.562 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:04.565+0000 7fa5626c3ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T21:48:04.562 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:04.565+0000 7fa5626c3ec0 20 rados->read ofs=0 len=0 2019-11-28T21:48:04.574 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:04.577+0000 7fa5626c3ec0 20 rados_obj.operate() r=0 bl.length=372 2019-11-28T21:48:04.574 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:04.577+0000 7fa5626c3ec0 20 rados->read ofs=0 len=0 2019-11-28T21:48:04.590 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:04.593+0000 7fa5626c3ec0 20 rados_obj.operate() r=0 bl.length=888 2019-11-28T21:48:04.665 INFO:teuthology.orchestra.run.smithi074.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2019-11-28T21:48:04.665 DEBUG:tasks.util.rgw: json result: [{u'val': {u'storage_classes': [u'FROZEN', u'LUKEWARM', u'STANDARD'], u'name': u'default-placement', u'tags': []}, u'key': u'default-placement'}] 2019-11-28T21:48:04.665 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2019-11-28T21:48:04.665 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2019-11-28T21:48:04.666 INFO:teuthology.orchestra.run.smithi074:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2019-11-28T21:48:04.959 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:04.961+0000 7fd6acff9700 20 reqs_thread_entry: start 2019-11-28T21:48:04.959 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:04.961+0000 7fd76fdc7ec0 20 rados->read ofs=0 len=0 2019-11-28T21:48:04.983 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:04.986+0000 7fd76fdc7ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T21:48:04.983 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:04.986+0000 7fd76fdc7ec0 20 rados->read ofs=0 len=0 2019-11-28T21:48:05.008 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:05.011+0000 7fd76fdc7ec0 20 rados_obj.operate() r=0 bl.length=888 2019-11-28T21:48:05.008 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:05.011+0000 7fd76fdc7ec0 20 rados->read ofs=0 len=0 2019-11-28T21:48:05.024 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:05.027+0000 7fd76fdc7ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:48:05.025 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:05.027+0000 7fd76fdc7ec0 20 rados->read ofs=0 len=0 2019-11-28T21:48:05.043 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:05.046+0000 7fd76fdc7ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T21:48:05.044 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:05.046+0000 7fd76fdc7ec0 20 rados->read ofs=0 len=0 2019-11-28T21:48:05.060 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:48:05.063+0000 7fd76fdc7ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T21:48:05.133 INFO:teuthology.orchestra.run.smithi074.stdout:{"id":"bd5ae442-b074-4d35-94cc-b1d71bd6ac02","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2019-11-28T21:48:05.134 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'FROZEN': {u'data_pool': u'default.rgw.buckets.data.frozen'}, u'LUKEWARM': {u'data_pool': u'default.rgw.buckets.data.lukewarm'}, u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'bd5ae442-b074-4d35-94cc-b1d71bd6ac02', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2019-11-28T21:48:05.134 INFO:tasks.rgw:Starting rgw... 2019-11-28T21:48:05.134 INFO:tasks.rgw:rgw client.0 config is {'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2019-11-28T21:48:05.134 INFO:tasks.rgw:Using civetweb as radosgw frontend 2019-11-28T21:48:05.135 DEBUG:teuthology.misc:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--tool=memcheck', '--max-threads=1024'] 2019-11-28T21:48:05.135 INFO:tasks.rgw.client.0:Restarting daemon 2019-11-28T21:48:05.135 INFO:teuthology.orchestra.run.smithi074:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'civetweb port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2019-11-28T21:48:05.140 INFO:tasks.rgw.client.0:Started 2019-11-28T21:48:05.140 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi074.front.sepia.ceph.com:80/ 2019-11-28T21:48:05.141 INFO:teuthology.orchestra.run.smithi074:> curl http://smithi074.front.sepia.ceph.com:80/ 2019-11-28T21:48:05.248 INFO:teuthology.orchestra.run.smithi074.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-11-28T21:48:05.249 INFO:teuthology.orchestra.run.smithi074.stderr: Dload Upload Total Spent Left Speed 2019-11-28T21:48:05.252 INFO:teuthology.orchestra.run.smithi074.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed connect to smithi074.front.sepia.ceph.com:80; Connection refused 2019-11-28T21:48:05.253 DEBUG:teuthology.orchestra.run:got remote process result: 7 2019-11-28T21:48:06.254 INFO:teuthology.orchestra.run.smithi074:> curl http://smithi074.front.sepia.ceph.com:80/ 2019-11-28T21:48:06.323 INFO:teuthology.orchestra.run.smithi074.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-11-28T21:48:06.323 INFO:teuthology.orchestra.run.smithi074.stderr: Dload Upload Total Spent Left Speed 2019-11-28T21:48:06.323 INFO:teuthology.orchestra.run.smithi074.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed connect to smithi074.front.sepia.ceph.com:80; Connection refused 2019-11-28T21:48:06.323 DEBUG:teuthology.orchestra.run:got remote process result: 7 2019-11-28T21:48:08.324 INFO:teuthology.orchestra.run.smithi074:> curl http://smithi074.front.sepia.ceph.com:80/ 2019-11-28T21:48:08.412 INFO:teuthology.orchestra.run.smithi074.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-11-28T21:48:08.414 INFO:teuthology.orchestra.run.smithi074.stderr: Dload Upload Total Spent Left Speed 2019-11-28T21:48:08.415 INFO:teuthology.orchestra.run.smithi074.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed connect to smithi074.front.sepia.ceph.com:80; Connection refused 2019-11-28T21:48:08.415 DEBUG:teuthology.orchestra.run:got remote process result: 7 2019-11-28T21:48:12.415 INFO:teuthology.orchestra.run.smithi074:> curl http://smithi074.front.sepia.ceph.com:80/ 2019-11-28T21:48:12.501 INFO:teuthology.orchestra.run.smithi074.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-11-28T21:48:12.501 INFO:teuthology.orchestra.run.smithi074.stderr: Dload Upload Total Spent Left Speed 2019-11-28T21:48:12.505 INFO:teuthology.orchestra.run.smithi074.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed connect to smithi074.front.sepia.ceph.com:80; Connection refused 2019-11-28T21:48:12.506 DEBUG:teuthology.orchestra.run:got remote process result: 7 2019-11-28T21:48:20.507 INFO:teuthology.orchestra.run.smithi074:> curl http://smithi074.front.sepia.ceph.com:80/ 2019-11-28T21:48:20.560 INFO:teuthology.orchestra.run.smithi074.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-11-28T21:48:20.561 INFO:teuthology.orchestra.run.smithi074.stderr: Dload Upload Total Spent Left Speed 2019-11-28T21:48:21.754 INFO:teuthology.orchestra.run.smithi074.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:01 --:--:-- 0 100 214 0 214 0 0 179 0 --:--:-- 0:00:01 --:--:-- 179 2019-11-28T21:48:21.754 INFO:teuthology.orchestra.run.smithi074.stdout:anonymous 2019-11-28T21:48:21.755 INFO:teuthology.run_tasks:Running task workunit... 2019-11-28T21:48:21.777 INFO:tasks.workunit:Pulling workunits from ref 00732956b62306ff37a7f7c81af9db807aae2dc8 2019-11-28T21:48:21.777 INFO:tasks.workunit:Making a separate scratch dir for every client... 2019-11-28T21:48:21.778 INFO:teuthology.orchestra.run.smithi074:> stat -- /home/ubuntu/cephtest/mnt.0 2019-11-28T21:48:21.849 INFO:teuthology.orchestra.run.smithi074.stderr:stat: cannot stat ‘/home/ubuntu/cephtest/mnt.0’: No such file or directory 2019-11-28T21:48:21.849 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-11-28T21:48:21.849 INFO:teuthology.orchestra.run.smithi074:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T21:48:21.899 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2019-11-28T21:48:21.899 INFO:teuthology.orchestra.run.smithi074:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2019-11-28T21:48:21.950 INFO:tasks.workunit:timeout=3h 2019-11-28T21:48:21.950 INFO:tasks.workunit:cleanup=True 2019-11-28T21:48:21.950 INFO:teuthology.orchestra.run.smithi074:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 00732956b62306ff37a7f7c81af9db807aae2dc8 2019-11-28T21:48:22.050 INFO:tasks.workunit.client.0.smithi074.stdout:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2019-11-28T21:48:57.823 INFO:tasks.workunit.client.0.smithi074.stderr:Note: checking out '00732956b62306ff37a7f7c81af9db807aae2dc8'. 2019-11-28T21:48:57.823 INFO:tasks.workunit.client.0.smithi074.stderr: 2019-11-28T21:48:57.823 INFO:tasks.workunit.client.0.smithi074.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2019-11-28T21:48:57.823 INFO:tasks.workunit.client.0.smithi074.stderr:changes and commit them, and you can discard any commits you make in this 2019-11-28T21:48:57.823 INFO:tasks.workunit.client.0.smithi074.stderr:state without impacting any branches by performing another checkout. 2019-11-28T21:48:57.824 INFO:tasks.workunit.client.0.smithi074.stderr: 2019-11-28T21:48:57.824 INFO:tasks.workunit.client.0.smithi074.stderr:If you want to create a new branch to retain commits you create, you may 2019-11-28T21:48:57.824 INFO:tasks.workunit.client.0.smithi074.stderr:do so (now or later) by using -b with the checkout command again. Example: 2019-11-28T21:48:57.824 INFO:tasks.workunit.client.0.smithi074.stderr: 2019-11-28T21:48:57.824 INFO:tasks.workunit.client.0.smithi074.stderr: git checkout -b new_branch_name 2019-11-28T21:48:57.824 INFO:tasks.workunit.client.0.smithi074.stderr: 2019-11-28T21:48:57.824 INFO:tasks.workunit.client.0.smithi074.stderr:HEAD is now at 0073295... rgw: fix a bug that bucket instance obj can't be removed after resharding completed. 2019-11-28T21:48:57.825 INFO:teuthology.orchestra.run.smithi074:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2019-11-28T21:48:57.880 INFO:tasks.workunit.client.0.smithi074.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2019-11-28T21:48:57.882 INFO:tasks.workunit.client.0.smithi074.stdout:make[1]: Entering directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2019-11-28T21:48:57.882 INFO:tasks.workunit.client.0.smithi074.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2019-11-28T21:48:58.391 INFO:tasks.workunit.client.0.smithi074.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2019-11-28T21:48:58.499 INFO:tasks.workunit.client.0.smithi074.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2019-11-28T21:48:58.537 INFO:tasks.workunit.client.0.smithi074.stdout:make[1]: Leaving directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2019-11-28T21:48:58.539 INFO:tasks.workunit.client.0.smithi074.stdout:make[1]: Entering directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2019-11-28T21:48:58.539 INFO:tasks.workunit.client.0.smithi074.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2019-11-28T21:48:58.576 INFO:tasks.workunit.client.0.smithi074.stdout:make[1]: Leaving directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2019-11-28T21:48:58.630 DEBUG:teuthology.orchestra.remote:smithi074:/home/ubuntu/cephtest/workunits.list.client.0 is 4KB 2019-11-28T21:48:58.678 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2019-11-28T21:48:58.678 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2019-11-28T21:48:58.678 INFO:teuthology.orchestra.run.smithi074:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=00732956b62306ff37a7f7c81af9db807aae2dc8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2019-11-28T21:48:58.732 INFO:tasks.workunit.client.0.smithi074.stdout:Running main() from gmock_main.cc 2019-11-28T21:48:58.732 INFO:tasks.workunit.client.0.smithi074.stdout:[==========] Running 11 tests from 1 test suite. 2019-11-28T21:48:58.732 INFO:tasks.workunit.client.0.smithi074.stdout:[----------] Global test environment set-up. 2019-11-28T21:48:58.732 INFO:tasks.workunit.client.0.smithi074.stdout:[----------] 11 tests from ClsLock 2019-11-28T21:48:58.732 INFO:tasks.workunit.client.0.smithi074.stdout:[ RUN ] ClsLock.TestMultiLocking 2019-11-28T21:49:01.739 INFO:tasks.workunit.client.0.smithi074.stdout:lock: mylock 2019-11-28T21:49:01.739 INFO:tasks.workunit.client.0.smithi074.stdout: lock_type: exclusive 2019-11-28T21:49:01.739 INFO:tasks.workunit.client.0.smithi074.stdout: tag: 2019-11-28T21:49:01.739 INFO:tasks.workunit.client.0.smithi074.stdout: lockers: 2019-11-28T21:49:01.739 INFO:tasks.workunit.client.0.smithi074.stdout: client.4503 expiration=2019-11-28T21:51:01.610398+0000 addr=v1:172.21.15.74:0/1764861853 cookie= 2019-11-28T21:49:01.867 INFO:tasks.workunit.client.0.smithi074.stdout:lock: mylock 2019-11-28T21:49:01.867 INFO:tasks.workunit.client.0.smithi074.stdout: lock_type: shared 2019-11-28T21:49:01.867 INFO:tasks.workunit.client.0.smithi074.stdout: tag: 2019-11-28T21:49:01.868 INFO:tasks.workunit.client.0.smithi074.stdout: lockers: 2019-11-28T21:49:01.868 INFO:tasks.workunit.client.0.smithi074.stdout: client.4503 expiration=2019-11-28T21:51:01.826052+0000 addr=v1:172.21.15.74:0/1764861853 cookie= 2019-11-28T21:49:01.868 INFO:tasks.workunit.client.0.smithi074.stdout: client.4509 expiration=0.000000 addr=v1:172.21.15.74:0/534588553 cookie= 2019-11-28T21:49:01.913 INFO:tasks.workunit.client.0.smithi074.stdout:lock: mylock 2019-11-28T21:49:01.913 INFO:tasks.workunit.client.0.smithi074.stdout: lock_type: shared 2019-11-28T21:49:01.913 INFO:tasks.workunit.client.0.smithi074.stdout: tag: 2019-11-28T21:49:01.914 INFO:tasks.workunit.client.0.smithi074.stdout: lockers: 2019-11-28T21:49:01.914 INFO:tasks.workunit.client.0.smithi074.stdout: client.4509 expiration=0.000000 addr=v1:172.21.15.74:0/534588553 cookie= 2019-11-28T21:49:03.094 INFO:tasks.workunit.client.0.smithi074.stdout:[ OK ] ClsLock.TestMultiLocking (4362 ms) 2019-11-28T21:49:03.094 INFO:tasks.workunit.client.0.smithi074.stdout:[ RUN ] ClsLock.TestMeta 2019-11-28T21:49:05.986 INFO:tasks.workunit.client.0.smithi074.stdout:lock: mylock 2019-11-28T21:49:05.987 INFO:tasks.workunit.client.0.smithi074.stdout: lock_type: shared 2019-11-28T21:49:05.987 INFO:tasks.workunit.client.0.smithi074.stdout: tag: 2019-11-28T21:49:05.987 INFO:tasks.workunit.client.0.smithi074.stdout: lockers: 2019-11-28T21:49:05.987 INFO:tasks.workunit.client.0.smithi074.stdout: client.4521 expiration=0.000000 addr=v1:172.21.15.74:0/239579860 cookie= 2019-11-28T21:49:06.066 INFO:tasks.workunit.client.0.smithi074.stdout:lock: mylock 2019-11-28T21:49:06.066 INFO:tasks.workunit.client.0.smithi074.stdout: lock_type: exclusive 2019-11-28T21:49:06.067 INFO:tasks.workunit.client.0.smithi074.stdout: tag: new_tag 2019-11-28T21:49:06.067 INFO:tasks.workunit.client.0.smithi074.stdout: lockers: 2019-11-28T21:49:06.067 INFO:tasks.workunit.client.0.smithi074.stdout: client.4331 expiration=0.000000 addr=v1:172.21.15.74:0/3357820183 cookie= 2019-11-28T21:49:06.610 INFO:tasks.workunit.client.0.smithi074.stdout:[ OK ] ClsLock.TestMeta (3515 ms) 2019-11-28T21:49:06.610 INFO:tasks.workunit.client.0.smithi074.stdout:[ RUN ] ClsLock.TestCookie 2019-11-28T21:49:09.465 INFO:tasks.workunit.client.0.smithi074.stdout:lock: mylock 2019-11-28T21:49:09.465 INFO:tasks.workunit.client.0.smithi074.stdout: lock_type: exclusive 2019-11-28T21:49:09.465 INFO:tasks.workunit.client.0.smithi074.stdout: tag: 2019-11-28T21:49:09.465 INFO:tasks.workunit.client.0.smithi074.stdout: lockers: 2019-11-28T21:49:09.538 INFO:tasks.workunit.client.0.smithi074.stdout:lock: mylock 2019-11-28T21:49:09.539 INFO:tasks.workunit.client.0.smithi074.stdout: lock_type: shared 2019-11-28T21:49:09.539 INFO:tasks.workunit.client.0.smithi074.stdout: tag: 2019-11-28T21:49:09.539 INFO:tasks.workunit.client.0.smithi074.stdout: lockers: 2019-11-28T21:49:09.539 INFO:tasks.workunit.client.0.smithi074.stdout: client.4340 expiration=0.000000 addr=v1:172.21.15.74:0/772510815 cookie= 2019-11-28T21:49:09.539 INFO:tasks.workunit.client.0.smithi074.stdout: client.4340 expiration=0.000000 addr=v1:172.21.15.74:0/772510815 cookie=new cookie 2019-11-28T21:49:10.105 INFO:tasks.workunit.client.0.smithi074.stdout:[ OK ] ClsLock.TestCookie (3491 ms) 2019-11-28T21:49:10.105 INFO:tasks.workunit.client.0.smithi074.stdout:[ RUN ] ClsLock.TestMultipleLocks 2019-11-28T21:49:13.482 INFO:tasks.workunit.client.0.smithi074.stdout:[ OK ] ClsLock.TestMultipleLocks (3382 ms) 2019-11-28T21:49:13.483 INFO:tasks.workunit.client.0.smithi074.stdout:[ RUN ] ClsLock.TestLockDuration 2019-11-28T21:49:21.530 INFO:tasks.workunit.client.0.smithi074.stdout:[ OK ] ClsLock.TestLockDuration (8048 ms) 2019-11-28T21:49:21.530 INFO:tasks.workunit.client.0.smithi074.stdout:[ RUN ] ClsLock.TestAssertLocked 2019-11-28T21:49:25.033 INFO:tasks.workunit.client.0.smithi074.stdout:[ OK ] ClsLock.TestAssertLocked (3504 ms) 2019-11-28T21:49:25.034 INFO:tasks.workunit.client.0.smithi074.stdout:[ RUN ] ClsLock.TestSetCookie 2019-11-28T21:49:28.426 INFO:tasks.workunit.client.0.smithi074.stdout:[ OK ] ClsLock.TestSetCookie (3391 ms) 2019-11-28T21:49:28.426 INFO:tasks.workunit.client.0.smithi074.stdout:[ RUN ] ClsLock.TestRenew 2019-11-28T21:49:49.989 INFO:tasks.workunit.client.0.smithi074.stdout:[ OK ] ClsLock.TestRenew (21564 ms) 2019-11-28T21:49:49.989 INFO:tasks.workunit.client.0.smithi074.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2019-11-28T21:49:56.986 INFO:tasks.workunit.client.0.smithi074.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (6997 ms) 2019-11-28T21:49:56.986 INFO:tasks.workunit.client.0.smithi074.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2019-11-28T21:50:05.618 INFO:tasks.workunit.client.0.smithi074.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (8632 ms) 2019-11-28T21:50:05.618 INFO:tasks.workunit.client.0.smithi074.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2019-11-28T21:50:13.705 INFO:tasks.workunit.client.0.smithi074.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8087 ms) 2019-11-28T21:50:13.705 INFO:tasks.workunit.client.0.smithi074.stdout:[----------] 11 tests from ClsLock (74973 ms total) 2019-11-28T21:50:13.705 INFO:tasks.workunit.client.0.smithi074.stdout: 2019-11-28T21:50:13.705 INFO:tasks.workunit.client.0.smithi074.stdout:[----------] Global test environment tear-down 2019-11-28T21:50:13.705 INFO:tasks.workunit.client.0.smithi074.stdout:[==========] 11 tests from 1 test suite ran. (74974 ms total) 2019-11-28T21:50:13.706 INFO:tasks.workunit.client.0.smithi074.stdout:[ PASSED ] 11 tests. 2019-11-28T21:50:13.708 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-11-28T21:50:13.708 INFO:teuthology.orchestra.run.smithi074:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-11-28T21:50:13.890 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2019-11-28T21:50:13.890 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2019-11-28T21:50:13.891 INFO:teuthology.orchestra.run.smithi074:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=00732956b62306ff37a7f7c81af9db807aae2dc8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2019-11-28T21:50:13.961 INFO:tasks.workunit.client.0.smithi074.stdout:Running main() from gmock_main.cc 2019-11-28T21:50:13.961 INFO:tasks.workunit.client.0.smithi074.stdout:[==========] Running 4 tests from 1 test suite. 2019-11-28T21:50:13.961 INFO:tasks.workunit.client.0.smithi074.stdout:[----------] Global test environment set-up. 2019-11-28T21:50:13.961 INFO:tasks.workunit.client.0.smithi074.stdout:[----------] 4 tests from cls_log 2019-11-28T21:50:13.961 INFO:tasks.workunit.client.0.smithi074.stdout:[ RUN ] cls_log.test_log_add_same_time 2019-11-28T21:50:17.242 INFO:tasks.workunit.client.0.smithi074.stdout:[ OK ] cls_log.test_log_add_same_time (3282 ms) 2019-11-28T21:50:17.242 INFO:tasks.workunit.client.0.smithi074.stdout:[ RUN ] cls_log.test_log_add_different_time 2019-11-28T21:50:20.738 INFO:tasks.workunit.client.0.smithi074.stdout:[ OK ] cls_log.test_log_add_different_time (3496 ms) 2019-11-28T21:50:20.739 INFO:tasks.workunit.client.0.smithi074.stdout:[ RUN ] cls_log.trim_by_time 2019-11-28T21:50:26.295 INFO:tasks.workunit.client.0.smithi074.stdout:[ OK ] cls_log.trim_by_time (5557 ms) 2019-11-28T21:50:26.295 INFO:tasks.workunit.client.0.smithi074.stdout:[ RUN ] cls_log.trim_by_marker 2019-11-28T21:50:30.657 INFO:tasks.workunit.client.0.smithi074.stdout:[ OK ] cls_log.trim_by_marker (4362 ms) 2019-11-28T21:50:30.657 INFO:tasks.workunit.client.0.smithi074.stdout:[----------] 4 tests from cls_log (16697 ms total) 2019-11-28T21:50:30.657 INFO:tasks.workunit.client.0.smithi074.stdout: 2019-11-28T21:50:30.657 INFO:tasks.workunit.client.0.smithi074.stdout:[----------] Global test environment tear-down 2019-11-28T21:50:30.658 INFO:tasks.workunit.client.0.smithi074.stdout:[==========] 4 tests from 1 test suite ran. (16697 ms total) 2019-11-28T21:50:30.658 INFO:tasks.workunit.client.0.smithi074.stdout:[ PASSED ] 4 tests. 2019-11-28T21:50:30.660 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-11-28T21:50:30.660 INFO:teuthology.orchestra.run.smithi074:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-11-28T21:50:30.834 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2019-11-28T21:50:30.834 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2019-11-28T21:50:30.835 INFO:teuthology.orchestra.run.smithi074:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=00732956b62306ff37a7f7c81af9db807aae2dc8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2019-11-28T21:50:30.913 INFO:tasks.workunit.client.0.smithi074.stdout:Running main() from gmock_main.cc 2019-11-28T21:50:30.913 INFO:tasks.workunit.client.0.smithi074.stdout:[==========] Running 5 tests from 1 test suite. 2019-11-28T21:50:30.913 INFO:tasks.workunit.client.0.smithi074.stdout:[----------] Global test environment set-up. 2019-11-28T21:50:30.913 INFO:tasks.workunit.client.0.smithi074.stdout:[----------] 5 tests from cls_rgw 2019-11-28T21:50:30.914 INFO:tasks.workunit.client.0.smithi074.stdout:[ RUN ] cls_rgw.test_implicit 2019-11-28T21:50:34.143 INFO:tasks.workunit.client.0.smithi074.stdout:[ OK ] cls_rgw.test_implicit (3229 ms) 2019-11-28T21:50:34.143 INFO:tasks.workunit.client.0.smithi074.stdout:[ RUN ] cls_rgw.test_implicit_idempotent 2019-11-28T21:50:38.497 INFO:tasks.workunit.client.0.smithi074.stdout:[ OK ] cls_rgw.test_implicit_idempotent (4355 ms) 2019-11-28T21:50:38.497 INFO:tasks.workunit.client.0.smithi074.stdout:[ RUN ] cls_rgw.test_put_snap 2019-11-28T21:50:46.816 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-28T21:50:46.709+0000 37f90700 -1 osd.5 pg_epoch: 106 pg[25.6( v 105'4 (0'0,105'4] local-lis/les=102/103 n=2 ec=102/102 lis/c=102/102 les/c/f=103/103/0 sis=102) [5,1] r=0 lpr=102 crt=104'3 lcod 104'3 mlcod 104'3 active+clean+snaptrim trimq=[1~1]] removing snap head 2019-11-28T21:50:48.821 INFO:tasks.workunit.client.0.smithi074.stdout:[ OK ] cls_rgw.test_put_snap (10324 ms) 2019-11-28T21:50:48.821 INFO:tasks.workunit.client.0.smithi074.stdout:[ RUN ] cls_rgw.test_explicit 2019-11-28T21:50:52.457 INFO:tasks.workunit.client.0.smithi074.stdout:[ OK ] cls_rgw.test_explicit (3637 ms) 2019-11-28T21:50:52.458 INFO:tasks.workunit.client.0.smithi074.stdout:[ RUN ] cls_rgw.set 2019-11-28T21:50:55.730 INFO:tasks.workunit.client.0.smithi074.stdout:[ OK ] cls_rgw.set (3273 ms) 2019-11-28T21:50:55.730 INFO:tasks.workunit.client.0.smithi074.stdout:[----------] 5 tests from cls_rgw (24818 ms total) 2019-11-28T21:50:55.731 INFO:tasks.workunit.client.0.smithi074.stdout: 2019-11-28T21:50:55.731 INFO:tasks.workunit.client.0.smithi074.stdout:[----------] Global test environment tear-down 2019-11-28T21:50:55.731 INFO:tasks.workunit.client.0.smithi074.stdout:[==========] 5 tests from 1 test suite ran. (24818 ms total) 2019-11-28T21:50:55.731 INFO:tasks.workunit.client.0.smithi074.stdout:[ PASSED ] 5 tests. 2019-11-28T21:50:55.733 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-11-28T21:50:55.733 INFO:teuthology.orchestra.run.smithi074:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-11-28T21:50:55.801 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2019-11-28T21:50:55.801 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2019-11-28T21:50:55.802 INFO:teuthology.orchestra.run.smithi074:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=00732956b62306ff37a7f7c81af9db807aae2dc8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2019-11-28T21:50:55.881 INFO:tasks.workunit.client.0.smithi074.stdout:Running main() from gmock_main.cc 2019-11-28T21:50:55.881 INFO:tasks.workunit.client.0.smithi074.stdout:[==========] Running 13 tests from 1 test suite. 2019-11-28T21:50:55.881 INFO:tasks.workunit.client.0.smithi074.stdout:[----------] Global test environment set-up. 2019-11-28T21:50:55.881 INFO:tasks.workunit.client.0.smithi074.stdout:[----------] 13 tests from cls_rgw 2019-11-28T21:50:58.048 INFO:tasks.workunit.client.0.smithi074.stdout:[ RUN ] cls_rgw.index_basic 2019-11-28T21:50:59.613 INFO:tasks.workunit.client.0.smithi074.stdout:[ OK ] cls_rgw.index_basic (1564 ms) 2019-11-28T21:50:59.613 INFO:tasks.workunit.client.0.smithi074.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2019-11-28T21:51:01.281 INFO:tasks.workunit.client.0.smithi074.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (1668 ms) 2019-11-28T21:51:01.281 INFO:tasks.workunit.client.0.smithi074.stdout:[ RUN ] cls_rgw.index_remove_object 2019-11-28T21:51:03.596 INFO:tasks.workunit.client.0.smithi074.stdout:[ OK ] cls_rgw.index_remove_object (2316 ms) 2019-11-28T21:51:03.597 INFO:tasks.workunit.client.0.smithi074.stdout:[ RUN ] cls_rgw.index_suggest 2019-11-28T21:51:32.131 INFO:tasks.workunit.client.0.smithi074.stdout:[ OK ] cls_rgw.index_suggest (28535 ms) 2019-11-28T21:51:32.132 INFO:tasks.workunit.client.0.smithi074.stdout:[ RUN ] cls_rgw.index_list 2019-11-28T21:51:33.587 INFO:tasks.workunit.client.0.smithi074.stdout:[ OK ] cls_rgw.index_list (1456 ms) 2019-11-28T21:51:33.587 INFO:tasks.workunit.client.0.smithi074.stdout:[ RUN ] cls_rgw.bi_list 2019-11-28T21:51:36.423 INFO:tasks.workunit.client.0.smithi074.stdout:[ OK ] cls_rgw.bi_list (2835 ms) 2019-11-28T21:51:36.423 INFO:tasks.workunit.client.0.smithi074.stdout:[ RUN ] cls_rgw.gc_set 2019-11-28T21:51:37.165 INFO:tasks.workunit.client.0.smithi074.stdout:[ OK ] cls_rgw.gc_set (743 ms) 2019-11-28T21:51:37.165 INFO:tasks.workunit.client.0.smithi074.stdout:[ RUN ] cls_rgw.gc_list 2019-11-28T21:51:37.804 INFO:tasks.workunit.client.0.smithi074.stdout:[ OK ] cls_rgw.gc_list (639 ms) 2019-11-28T21:51:37.804 INFO:tasks.workunit.client.0.smithi074.stdout:[ RUN ] cls_rgw.gc_defer 2019-11-28T21:51:45.912 INFO:tasks.workunit.client.0.smithi074.stdout:[ OK ] cls_rgw.gc_defer (8108 ms) 2019-11-28T21:51:45.913 INFO:tasks.workunit.client.0.smithi074.stdout:[ RUN ] cls_rgw.usage_basic 2019-11-28T21:51:53.691 INFO:tasks.workunit.client.0.smithi074.stdout:[ OK ] cls_rgw.usage_basic (7778 ms) 2019-11-28T21:51:53.691 INFO:tasks.workunit.client.0.smithi074.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2019-11-28T21:51:53.723 INFO:tasks.workunit.client.0.smithi074.stdout:[ OK ] cls_rgw.usage_clear_no_obj (31 ms) 2019-11-28T21:51:53.723 INFO:tasks.workunit.client.0.smithi074.stdout:[ RUN ] cls_rgw.usage_clear 2019-11-28T21:52:05.123 INFO:tasks.workunit.client.0.smithi074.stdout:[ OK ] cls_rgw.usage_clear (11402 ms) 2019-11-28T21:52:05.124 INFO:tasks.workunit.client.0.smithi074.stdout:[ RUN ] cls_rgw.bi_log_trim 2019-11-28T21:52:07.437 INFO:tasks.workunit.client.0.smithi074.stdout:[ OK ] cls_rgw.bi_log_trim (2314 ms) 2019-11-28T21:52:07.701 INFO:tasks.workunit.client.0.smithi074.stdout:[----------] 13 tests from cls_rgw (69390 ms total) 2019-11-28T21:52:07.701 INFO:tasks.workunit.client.0.smithi074.stdout: 2019-11-28T21:52:07.701 INFO:tasks.workunit.client.0.smithi074.stdout:[----------] Global test environment tear-down 2019-11-28T21:52:07.701 INFO:tasks.workunit.client.0.smithi074.stdout:[==========] 13 tests from 1 test suite ran. (71821 ms total) 2019-11-28T21:52:07.701 INFO:tasks.workunit.client.0.smithi074.stdout:[ PASSED ] 13 tests. 2019-11-28T21:52:07.703 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-11-28T21:52:07.703 INFO:teuthology.orchestra.run.smithi074:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-11-28T21:52:07.772 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2019-11-28T21:52:07.772 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2019-11-28T21:52:07.773 INFO:teuthology.orchestra.run.smithi074:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=00732956b62306ff37a7f7c81af9db807aae2dc8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2019-11-28T21:52:07.842 INFO:tasks.workunit.client.0.smithi074.stdout:[==========] Running 6 tests from 1 test suite. 2019-11-28T21:52:07.842 INFO:tasks.workunit.client.0.smithi074.stdout:[----------] Global test environment set-up. 2019-11-28T21:52:09.752 INFO:tasks.workunit.client.0.smithi074.stdout:[----------] 6 tests from rgw_gc_log 2019-11-28T21:52:09.752 INFO:tasks.workunit.client.0.smithi074.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2019-11-28T21:52:10.300 INFO:tasks.workunit.client.0.smithi074.stdout:[ OK ] rgw_gc_log.init_existing_queue (549 ms) 2019-11-28T21:52:10.300 INFO:tasks.workunit.client.0.smithi074.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2019-11-28T21:52:10.508 INFO:tasks.workunit.client.0.smithi074.stdout:[ OK ] rgw_gc_log.init_existing_omap (208 ms) 2019-11-28T21:52:10.509 INFO:tasks.workunit.client.0.smithi074.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2019-11-28T21:52:10.643 INFO:tasks.workunit.client.0.smithi074.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (135 ms) 2019-11-28T21:52:10.643 INFO:tasks.workunit.client.0.smithi074.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2019-11-28T21:52:10.710 INFO:tasks.workunit.client.0.smithi074.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (67 ms) 2019-11-28T21:52:10.710 INFO:tasks.workunit.client.0.smithi074.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2019-11-28T21:52:10.808 INFO:tasks.workunit.client.0.smithi074.stdout:[ OK ] rgw_gc_log.defer1_after_init (97 ms) 2019-11-28T21:52:10.808 INFO:tasks.workunit.client.0.smithi074.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2019-11-28T21:52:10.870 INFO:tasks.workunit.client.0.smithi074.stdout:[ OK ] rgw_gc_log.defer2_before_init (63 ms) 2019-11-28T21:52:10.870 INFO:tasks.workunit.client.0.smithi074.stdout:[----------] 6 tests from rgw_gc_log (1119 ms total) 2019-11-28T21:52:10.870 INFO:tasks.workunit.client.0.smithi074.stdout: 2019-11-28T21:52:10.871 INFO:tasks.workunit.client.0.smithi074.stdout:[----------] Global test environment tear-down 2019-11-28T21:52:11.972 INFO:tasks.workunit.client.0.smithi074.stdout:[==========] 6 tests from 1 test suite ran. (4130 ms total) 2019-11-28T21:52:11.972 INFO:tasks.workunit.client.0.smithi074.stdout:[ PASSED ] 6 tests. 2019-11-28T21:52:11.975 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-11-28T21:52:11.975 INFO:teuthology.orchestra.run.smithi074:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-11-28T21:52:12.102 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'rgw/test_rgw_gc_log.sh'] on client.0... 2019-11-28T21:52:12.103 INFO:teuthology.orchestra.run.smithi074:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2019-11-28T21:52:12.396 DEBUG:teuthology.parallel:result is None 2019-11-28T21:52:12.396 INFO:teuthology.orchestra.run.smithi074:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2019-11-28T21:52:12.457 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2019-11-28T21:52:12.457 INFO:teuthology.orchestra.run.smithi074:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-11-28T21:52:12.531 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2019-11-28T21:52:12.531 INFO:teuthology.run_tasks:Running task ragweed... 2019-11-28T21:52:12.545 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'rgw_server': 'client.0', 'stages': 'prepare,check', 'default-branch': 'ceph-master'}} 2019-11-28T21:52:12.545 INFO:tasks.ragweed:Downloading ragweed... 2019-11-28T21:52:12.546 INFO:tasks.ragweed:Using branch 'wip-mkogan-testing' for ragweed 2019-11-28T21:52:12.546 INFO:teuthology.orchestra.run.smithi074:> git clone -b wip-mkogan-testing git://git.ceph.com/git/ragweed.git /home/ubuntu/cephtest/ragweed 2019-11-28T21:52:12.599 INFO:teuthology.orchestra.run.smithi074.stderr:fatal: Remote branch wip-mkogan-testing not found in upstream origin 2019-11-28T21:52:12.600 INFO:teuthology.orchestra.run.smithi074.stdout:Cloning into '/home/ubuntu/cephtest/ragweed'... 2019-11-28T21:52:12.600 DEBUG:teuthology.orchestra.run:got remote process result: 128 2019-11-28T21:52:12.601 INFO:teuthology.orchestra.run.smithi074:> git clone -b ceph-master git://git.ceph.com/git/ragweed.git /home/ubuntu/cephtest/ragweed 2019-11-28T21:52:12.691 INFO:teuthology.orchestra.run.smithi074.stdout:Cloning into '/home/ubuntu/cephtest/ragweed'... 2019-11-28T21:52:12.930 INFO:tasks.ragweed:Creating rgw users... 2019-11-28T21:52:12.930 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2019-11-28T21:52:12.931 INFO:teuthology.orchestra.run.smithi074:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key MKEIUIJQGGMTLVSCLEOA --secret LZn0IRz7GlmQfJbdi6OA3wz5CoG0aHqM7+vsCtgyyNoVflumy5dHPw== --email sysuser.client.0+test@test.test --system true 2019-11-28T21:52:13.114 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.120+0000 7ffa0e51eec0 20 rados->read ofs=0 len=0 2019-11-28T21:52:13.148 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.154+0000 7ffa0e51eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:52:13.148 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.154+0000 7ffa0e51eec0 20 rados->read ofs=0 len=0 2019-11-28T21:52:13.158 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.164+0000 7ffa0e51eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:52:13.158 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.164+0000 7ffa0e51eec0 20 rados->read ofs=0 len=0 2019-11-28T21:52:13.168 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.174+0000 7ffa0e51eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:52:13.168 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.174+0000 7ffa0e51eec0 20 rados->read ofs=0 len=0 2019-11-28T21:52:13.187 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.193+0000 7ffa0e51eec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T21:52:13.439 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.445+0000 7ffa0e51eec0 20 RGWRados::pool_iterate: got zonegroup_info.cb1773b4-411c-4317-a760-df89ca0f54fc 2019-11-28T21:52:13.439 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.445+0000 7ffa0e51eec0 20 RGWRados::pool_iterate: got zone_info.bd5ae442-b074-4d35-94cc-b1d71bd6ac02 2019-11-28T21:52:13.439 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.445+0000 7ffa0e51eec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-28T21:52:13.439 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.445+0000 7ffa0e51eec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-28T21:52:13.439 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.445+0000 7ffa0e51eec0 20 rados->read ofs=0 len=0 2019-11-28T21:52:13.453 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.459+0000 7ffa0e51eec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T21:52:13.453 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.459+0000 7ffa0e51eec0 20 rados->read ofs=0 len=0 2019-11-28T21:52:13.473 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.479+0000 7ffa0e51eec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T21:52:13.473 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.479+0000 7ffa0e51eec0 20 rados->read ofs=0 len=0 2019-11-28T21:52:13.484 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.490+0000 7ffa0e51eec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T21:52:13.484 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.490+0000 7ffa0e51eec0 20 rados->read ofs=0 len=0 2019-11-28T21:52:13.502 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.509+0000 7ffa0e51eec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T21:52:13.502 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.509+0000 7ffa0e51eec0 20 rados->read ofs=0 len=0 2019-11-28T21:52:13.515 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.522+0000 7ffa0e51eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:52:13.515 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.522+0000 7ffa0e51eec0 10 cannot find current period zonegroup using local zonegroup 2019-11-28T21:52:13.516 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.522+0000 7ffa0e51eec0 20 rados->read ofs=0 len=0 2019-11-28T21:52:13.528 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.534+0000 7ffa0e51eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:52:13.528 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.534+0000 7ffa0e51eec0 20 rados->read ofs=0 len=0 2019-11-28T21:52:13.541 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.548+0000 7ffa0e51eec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T21:52:13.542 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.548+0000 7ffa0e51eec0 20 rados->read ofs=0 len=0 2019-11-28T21:52:13.560 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.566+0000 7ffa0e51eec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T21:52:13.560 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.566+0000 7ffa0e51eec0 20 zonegroup default 2019-11-28T21:52:13.560 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.566+0000 7ffa0e51eec0 20 rados->read ofs=0 len=0 2019-11-28T21:52:13.567 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.573+0000 7ffa0e51eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:52:13.567 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.573+0000 7ffa0e51eec0 10 Cannot find current period zone using local zone 2019-11-28T21:52:13.567 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.573+0000 7ffa0e51eec0 20 rados->read ofs=0 len=0 2019-11-28T21:52:13.580 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.586+0000 7ffa0e51eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:52:13.580 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.586+0000 7ffa0e51eec0 20 rados->read ofs=0 len=0 2019-11-28T21:52:13.595 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.601+0000 7ffa0e51eec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T21:52:13.596 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.601+0000 7ffa0e51eec0 20 rados->read ofs=0 len=0 2019-11-28T21:52:13.608 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.614+0000 7ffa0e51eec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T21:52:13.608 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.614+0000 7ffa0e51eec0 20 zone default found 2019-11-28T21:52:13.609 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.614+0000 7ffa0e51eec0 20 started sync module instance, tier type = 2019-11-28T21:52:13.609 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:13.614+0000 7ffa0e51eec0 20 started zone id=bd5ae442-b074-4d35-94cc-b1d71bd6ac02 (name=default) with tier type = 2019-11-28T21:52:13.994 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:14.001+0000 7ffa0e51eec0 20 add_watcher() i=0 2019-11-28T21:52:13.995 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:14.001+0000 7ffa0e51eec0 20 add_watcher() i=1 2019-11-28T21:52:13.995 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:14.001+0000 7ffa0e51eec0 20 add_watcher() i=2 2019-11-28T21:52:13.995 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:14.001+0000 7ffa0e51eec0 20 add_watcher() i=3 2019-11-28T21:52:13.995 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:14.001+0000 7ffa0e51eec0 20 add_watcher() i=4 2019-11-28T21:52:13.995 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:14.001+0000 7ffa0e51eec0 20 add_watcher() i=5 2019-11-28T21:52:13.995 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:14.001+0000 7ffa0e51eec0 20 add_watcher() i=6 2019-11-28T21:52:14.022 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:14.029+0000 7ffa0e51eec0 20 add_watcher() i=7 2019-11-28T21:52:14.023 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:14.029+0000 7ffa0e51eec0 2 all 8 watchers are set, enabling cache 2019-11-28T21:52:14.023 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:14.029+0000 7ff9cbfdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-28T21:52:14.028 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:14.034+0000 7ff9fb74b700 0 -- 172.21.15.74:0/1614043578 >> [v2:172.21.15.74:3301/0,v1:172.21.15.74:6790/0] conn(0x55b3906aee90 msgr2=0x55b3906b5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-28T21:52:14.232 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:14.237+0000 7ff9fb74b700 0 --2- 172.21.15.74:0/1614043578 >> [v2:172.21.15.74:3301/0,v1:172.21.15.74:6790/0] conn(0x55b3906aee90 0x55b3906b5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-28T21:52:14.337 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:14.343+0000 7ff9fb74b700 0 -- 172.21.15.74:0/3530443283 >> [v2:172.21.15.74:3301/0,v1:172.21.15.74:6790/0] conn(0x55b3906b8f20 msgr2=0x55b3906bb340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-28T21:52:16.009 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:16.015+0000 7ff93a7fc700 20 reqs_thread_entry: start 2019-11-28T21:52:16.009 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:16.015+0000 7ff933fff700 20 reqs_thread_entry: start 2019-11-28T21:52:16.009 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:16.015+0000 7ffa0e51eec0 20 init_complete bucket index max shards: 0 2019-11-28T21:52:16.010 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:16.016+0000 7ff9327fc700 20 reqs_thread_entry: start 2019-11-28T21:52:16.010 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:16.016+0000 7ffa0e51eec0 20 get_system_obj_state: rctx=0x7ffcb0343ce8 obj=default.rgw.meta:users.uid:sysuser.client.0 state=0x55b39072ea80 s->prefetch_data=0 2019-11-28T21:52:16.010 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:16.016+0000 7ffa0e51eec0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2019-11-28T21:52:16.024 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:16.031+0000 7ffa0e51eec0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2019-11-28T21:52:16.025 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:16.031+0000 7ffa0e51eec0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-11-28T21:52:16.025 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:16.031+0000 7ffa0e51eec0 20 get_system_obj_state: rctx=0x7ffcb0343cf8 obj=default.rgw.meta:users.email:sysuser.client.0+test@test.test state=0x55b390730810 s->prefetch_data=0 2019-11-28T21:52:16.025 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:16.031+0000 7ffa0e51eec0 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2019-11-28T21:52:16.037 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:16.044+0000 7ffa0e51eec0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2019-11-28T21:52:16.037 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:16.044+0000 7ffa0e51eec0 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2019-11-28T21:52:16.038 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:16.044+0000 7ffa0e51eec0 20 get_system_obj_state: rctx=0x7ffcb0343cf8 obj=default.rgw.meta:users.keys:MKEIUIJQGGMTLVSCLEOA state=0x55b390730810 s->prefetch_data=0 2019-11-28T21:52:16.038 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:16.044+0000 7ffa0e51eec0 10 cache get: name=default.rgw.meta+users.keys+MKEIUIJQGGMTLVSCLEOA : miss 2019-11-28T21:52:16.069 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:16.075+0000 7ffa0e51eec0 10 cache put: name=default.rgw.meta+users.keys+MKEIUIJQGGMTLVSCLEOA info.flags=0x0 2019-11-28T21:52:16.069 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:16.075+0000 7ffa0e51eec0 10 adding default.rgw.meta+users.keys+MKEIUIJQGGMTLVSCLEOA to cache LRU end 2019-11-28T21:52:16.069 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:16.075+0000 7ffa0e51eec0 20 get_system_obj_state: rctx=0x7ffcb0343908 obj=default.rgw.meta:users.keys:MKEIUIJQGGMTLVSCLEOA state=0x55b390730810 s->prefetch_data=0 2019-11-28T21:52:16.070 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:16.075+0000 7ffa0e51eec0 10 cache get: name=default.rgw.meta+users.keys+MKEIUIJQGGMTLVSCLEOA : type miss (requested=0x6, cached=0x0) 2019-11-28T21:52:16.083 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:16.089+0000 7ffa0e51eec0 10 cache put: name=default.rgw.meta+users.keys+MKEIUIJQGGMTLVSCLEOA info.flags=0x0 2019-11-28T21:52:16.083 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:16.089+0000 7ffa0e51eec0 10 moving default.rgw.meta+users.keys+MKEIUIJQGGMTLVSCLEOA to cache LRU end 2019-11-28T21:52:16.083 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:16.089+0000 7ffa0e51eec0 20 get_system_obj_state: rctx=0x7ffcb0343a88 obj=default.rgw.meta:users.keys:MKEIUIJQGGMTLVSCLEOA state=0x55b390730810 s->prefetch_data=0 2019-11-28T21:52:16.084 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:16.089+0000 7ffa0e51eec0 10 cache get: name=default.rgw.meta+users.keys+MKEIUIJQGGMTLVSCLEOA : type miss (requested=0x6, cached=0x0) 2019-11-28T21:52:16.095 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:16.102+0000 7ffa0e51eec0 10 cache put: name=default.rgw.meta+users.keys+MKEIUIJQGGMTLVSCLEOA info.flags=0x0 2019-11-28T21:52:16.095 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:16.102+0000 7ffa0e51eec0 10 moving default.rgw.meta+users.keys+MKEIUIJQGGMTLVSCLEOA to cache LRU end 2019-11-28T21:52:16.179 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:16.185+0000 7ffa0e51eec0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2019-11-28T21:52:16.179 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:16.185+0000 7ffa0e51eec0 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-11-28T21:52:16.179 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:16.185+0000 7ffa0e51eec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=637 2019-11-28T21:52:16.248 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:16.252+0000 7ff9e0ff9700 10 RGWWatcher::handle_notify() notify_id 541165879296 cookie 94229710365600 notifier 4427 bl.length()=637 2019-11-28T21:52:16.248 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:16.253+0000 7ff9e0ff9700 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2019-11-28T21:52:16.248 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:16.253+0000 7ff9e0ff9700 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-11-28T21:52:16.999 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:17.005+0000 7ffa0e51eec0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2019-11-28T21:52:16.999 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:17.005+0000 7ffa0e51eec0 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2019-11-28T21:52:16.999 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:17.005+0000 7ffa0e51eec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=202 2019-11-28T21:52:17.027 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:17.034+0000 7ff9e0ff9700 10 RGWWatcher::handle_notify() notify_id 541165879297 cookie 94229710370704 notifier 4427 bl.length()=202 2019-11-28T21:52:17.027 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:17.034+0000 7ff9e0ff9700 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2019-11-28T21:52:17.028 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:17.034+0000 7ff9e0ff9700 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2019-11-28T21:52:17.281 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:17.286+0000 7ffa0e51eec0 10 cache put: name=default.rgw.meta+users.keys+MKEIUIJQGGMTLVSCLEOA info.flags=0x7 2019-11-28T21:52:17.281 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:17.286+0000 7ffa0e51eec0 10 moving default.rgw.meta+users.keys+MKEIUIJQGGMTLVSCLEOA to cache LRU end 2019-11-28T21:52:17.281 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:17.286+0000 7ffa0e51eec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=190 2019-11-28T21:52:17.342 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:17.348+0000 7ff9e0ff9700 10 RGWWatcher::handle_notify() notify_id 541165879296 cookie 94229710360400 notifier 4427 bl.length()=190 2019-11-28T21:52:17.342 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:17.348+0000 7ff9e0ff9700 10 cache put: name=default.rgw.meta+users.keys+MKEIUIJQGGMTLVSCLEOA info.flags=0x7 2019-11-28T21:52:17.343 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:17.348+0000 7ff9e0ff9700 10 moving default.rgw.meta+users.keys+MKEIUIJQGGMTLVSCLEOA to cache LRU end 2019-11-28T21:52:17.388 INFO:teuthology.orchestra.run.smithi074.stdout:{ 2019-11-28T21:52:17.389 INFO:teuthology.orchestra.run.smithi074.stdout: "user_id": "sysuser.client.0", 2019-11-28T21:52:17.389 INFO:teuthology.orchestra.run.smithi074.stdout: "display_name": "Mr. sysuser.client.0", 2019-11-28T21:52:17.389 INFO:teuthology.orchestra.run.smithi074.stdout: "email": "sysuser.client.0+test@test.test", 2019-11-28T21:52:17.389 INFO:teuthology.orchestra.run.smithi074.stdout: "suspended": 0, 2019-11-28T21:52:17.389 INFO:teuthology.orchestra.run.smithi074.stdout: "max_buckets": 1000, 2019-11-28T21:52:17.389 INFO:teuthology.orchestra.run.smithi074.stdout: "subusers": [], 2019-11-28T21:52:17.390 INFO:teuthology.orchestra.run.smithi074.stdout: "keys": [ 2019-11-28T21:52:17.390 INFO:teuthology.orchestra.run.smithi074.stdout: { 2019-11-28T21:52:17.390 INFO:teuthology.orchestra.run.smithi074.stdout: "user": "sysuser.client.0", 2019-11-28T21:52:17.390 INFO:teuthology.orchestra.run.smithi074.stdout: "access_key": "MKEIUIJQGGMTLVSCLEOA", 2019-11-28T21:52:17.390 INFO:teuthology.orchestra.run.smithi074.stdout: "secret_key": "LZn0IRz7GlmQfJbdi6OA3wz5CoG0aHqM7+vsCtgyyNoVflumy5dHPw==" 2019-11-28T21:52:17.390 INFO:teuthology.orchestra.run.smithi074.stdout: } 2019-11-28T21:52:17.390 INFO:teuthology.orchestra.run.smithi074.stdout: ], 2019-11-28T21:52:17.391 INFO:teuthology.orchestra.run.smithi074.stdout: "swift_keys": [], 2019-11-28T21:52:17.391 INFO:teuthology.orchestra.run.smithi074.stdout: "caps": [], 2019-11-28T21:52:17.391 INFO:teuthology.orchestra.run.smithi074.stdout: "op_mask": "read, write, delete", 2019-11-28T21:52:17.391 INFO:teuthology.orchestra.run.smithi074.stdout: "system": "true", 2019-11-28T21:52:17.391 INFO:teuthology.orchestra.run.smithi074.stdout: "default_placement": "", 2019-11-28T21:52:17.391 INFO:teuthology.orchestra.run.smithi074.stdout: "default_storage_class": "", 2019-11-28T21:52:17.391 INFO:teuthology.orchestra.run.smithi074.stdout: "placement_tags": [], 2019-11-28T21:52:17.392 INFO:teuthology.orchestra.run.smithi074.stdout: "bucket_quota": { 2019-11-28T21:52:17.392 INFO:teuthology.orchestra.run.smithi074.stdout: "enabled": false, 2019-11-28T21:52:17.392 INFO:teuthology.orchestra.run.smithi074.stdout: "check_on_raw": false, 2019-11-28T21:52:17.392 INFO:teuthology.orchestra.run.smithi074.stdout: "max_size": -1, 2019-11-28T21:52:17.392 INFO:teuthology.orchestra.run.smithi074.stdout: "max_size_kb": 0, 2019-11-28T21:52:17.392 INFO:teuthology.orchestra.run.smithi074.stdout: "max_objects": -1 2019-11-28T21:52:17.393 INFO:teuthology.orchestra.run.smithi074.stdout: }, 2019-11-28T21:52:17.393 INFO:teuthology.orchestra.run.smithi074.stdout: "user_quota": { 2019-11-28T21:52:17.393 INFO:teuthology.orchestra.run.smithi074.stdout: "enabled": false, 2019-11-28T21:52:17.393 INFO:teuthology.orchestra.run.smithi074.stdout: "check_on_raw": false, 2019-11-28T21:52:17.394 INFO:teuthology.orchestra.run.smithi074.stdout: "max_size": -1, 2019-11-28T21:52:17.394 INFO:teuthology.orchestra.run.smithi074.stdout: "max_size_kb": 0, 2019-11-28T21:52:17.394 INFO:teuthology.orchestra.run.smithi074.stdout: "max_objects": -1 2019-11-28T21:52:17.394 INFO:teuthology.orchestra.run.smithi074.stdout: }, 2019-11-28T21:52:17.394 INFO:teuthology.orchestra.run.smithi074.stdout: "temp_url_keys": [], 2019-11-28T21:52:17.394 INFO:teuthology.orchestra.run.smithi074.stdout: "type": "rgw", 2019-11-28T21:52:17.394 INFO:teuthology.orchestra.run.smithi074.stdout: "mfa_ids": [] 2019-11-28T21:52:17.395 INFO:teuthology.orchestra.run.smithi074.stdout:} 2019-11-28T21:52:17.395 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:52:17.431 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:17.438+0000 7ffa0e51eec0 20 remove_watcher() i=0 2019-11-28T21:52:17.431 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:17.438+0000 7ffa0e51eec0 2 removed watcher, disabling cache 2019-11-28T21:52:17.505 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:17.511+0000 7ffa0e51eec0 20 remove_watcher() i=1 2019-11-28T21:52:17.576 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:17.583+0000 7ffa0e51eec0 20 remove_watcher() i=2 2019-11-28T21:52:17.634 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:17.640+0000 7ffa0e51eec0 20 remove_watcher() i=3 2019-11-28T21:52:17.682 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:17.689+0000 7ffa0e51eec0 20 remove_watcher() i=4 2019-11-28T21:52:17.730 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:17.736+0000 7ffa0e51eec0 20 remove_watcher() i=5 2019-11-28T21:52:17.780 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:17.787+0000 7ffa0e51eec0 20 remove_watcher() i=6 2019-11-28T21:52:17.826 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:17.832+0000 7ffa0e51eec0 20 remove_watcher() i=7 2019-11-28T21:52:17.836 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2019-11-28T21:52:17.836 INFO:teuthology.orchestra.run.smithi074:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key FRLRNKHPBTSOAEMQUXDP --secret EuvpUB3erSAHyfAYiaHnudmOSytYSe07WYe7NCRGVZ3uHLTz0lA0eQ== --email ragweed.client.0+test@test.test --system false 2019-11-28T21:52:17.979 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:17.985+0000 7f189488fec0 20 rados->read ofs=0 len=0 2019-11-28T21:52:18.018 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.024+0000 7f189488fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:52:18.018 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.024+0000 7f189488fec0 20 rados->read ofs=0 len=0 2019-11-28T21:52:18.032 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.038+0000 7f189488fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:52:18.032 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.038+0000 7f189488fec0 20 rados->read ofs=0 len=0 2019-11-28T21:52:18.040 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.046+0000 7f189488fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:52:18.040 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.046+0000 7f189488fec0 20 rados->read ofs=0 len=0 2019-11-28T21:52:18.062 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.068+0000 7f189488fec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T21:52:18.305 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.311+0000 7f189488fec0 20 RGWRados::pool_iterate: got zonegroup_info.cb1773b4-411c-4317-a760-df89ca0f54fc 2019-11-28T21:52:18.305 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.311+0000 7f189488fec0 20 RGWRados::pool_iterate: got zone_info.bd5ae442-b074-4d35-94cc-b1d71bd6ac02 2019-11-28T21:52:18.305 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.311+0000 7f189488fec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-28T21:52:18.305 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.311+0000 7f189488fec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-28T21:52:18.306 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.311+0000 7f189488fec0 20 rados->read ofs=0 len=0 2019-11-28T21:52:18.321 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.327+0000 7f189488fec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T21:52:18.321 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.327+0000 7f189488fec0 20 rados->read ofs=0 len=0 2019-11-28T21:52:18.338 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.344+0000 7f189488fec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T21:52:18.339 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.344+0000 7f189488fec0 20 rados->read ofs=0 len=0 2019-11-28T21:52:18.352 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.358+0000 7f189488fec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T21:52:18.352 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.358+0000 7f189488fec0 20 rados->read ofs=0 len=0 2019-11-28T21:52:18.366 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.373+0000 7f189488fec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T21:52:18.367 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.373+0000 7f189488fec0 20 rados->read ofs=0 len=0 2019-11-28T21:52:18.380 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.384+0000 7f189488fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:52:18.380 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.384+0000 7f189488fec0 10 cannot find current period zonegroup using local zonegroup 2019-11-28T21:52:18.380 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.384+0000 7f189488fec0 20 rados->read ofs=0 len=0 2019-11-28T21:52:18.388 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.394+0000 7f189488fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:52:18.389 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.394+0000 7f189488fec0 20 rados->read ofs=0 len=0 2019-11-28T21:52:18.402 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.408+0000 7f189488fec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T21:52:18.402 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.408+0000 7f189488fec0 20 rados->read ofs=0 len=0 2019-11-28T21:52:18.413 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.419+0000 7f189488fec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T21:52:18.413 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.419+0000 7f189488fec0 20 zonegroup default 2019-11-28T21:52:18.413 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.419+0000 7f189488fec0 20 rados->read ofs=0 len=0 2019-11-28T21:52:18.424 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.430+0000 7f189488fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:52:18.424 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.430+0000 7f189488fec0 10 Cannot find current period zone using local zone 2019-11-28T21:52:18.424 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.430+0000 7f189488fec0 20 rados->read ofs=0 len=0 2019-11-28T21:52:18.434 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.440+0000 7f189488fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:52:18.434 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.440+0000 7f189488fec0 20 rados->read ofs=0 len=0 2019-11-28T21:52:18.447 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.453+0000 7f189488fec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T21:52:18.447 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.453+0000 7f189488fec0 20 rados->read ofs=0 len=0 2019-11-28T21:52:18.459 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.466+0000 7f189488fec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T21:52:18.460 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.466+0000 7f189488fec0 20 zone default found 2019-11-28T21:52:18.460 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.466+0000 7f189488fec0 20 started sync module instance, tier type = 2019-11-28T21:52:18.460 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.466+0000 7f189488fec0 20 started zone id=bd5ae442-b074-4d35-94cc-b1d71bd6ac02 (name=default) with tier type = 2019-11-28T21:52:18.825 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.831+0000 7f189488fec0 20 add_watcher() i=0 2019-11-28T21:52:18.825 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.831+0000 7f189488fec0 20 add_watcher() i=1 2019-11-28T21:52:18.825 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.831+0000 7f189488fec0 20 add_watcher() i=2 2019-11-28T21:52:18.825 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.831+0000 7f189488fec0 20 add_watcher() i=3 2019-11-28T21:52:18.825 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.831+0000 7f189488fec0 20 add_watcher() i=4 2019-11-28T21:52:18.826 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.831+0000 7f189488fec0 20 add_watcher() i=5 2019-11-28T21:52:18.826 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.831+0000 7f189488fec0 20 add_watcher() i=6 2019-11-28T21:52:18.855 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.861+0000 7f189488fec0 20 add_watcher() i=7 2019-11-28T21:52:18.855 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.861+0000 7f189488fec0 2 all 8 watchers are set, enabling cache 2019-11-28T21:52:18.855 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.861+0000 7f18517ea700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-28T21:52:18.857 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.864+0000 7f1881abc700 0 -- 172.21.15.74:0/2082739912 >> v2:172.21.15.141:3300/0 conn(0x55790c0bdc60 msgr2=0x55790c0c0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-28T21:52:18.893 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:18.900+0000 7f18812bb700 0 -- 172.21.15.74:0/4225605736 >> [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] conn(0x55790c0d2cc0 msgr2=0x55790c0d50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-28T21:52:20.606 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:20.611+0000 7f17c37fe700 20 reqs_thread_entry: start 2019-11-28T21:52:20.606 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:20.611+0000 7f17c17fa700 20 reqs_thread_entry: start 2019-11-28T21:52:20.607 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:20.612+0000 7f189488fec0 20 init_complete bucket index max shards: 0 2019-11-28T21:52:20.607 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:20.612+0000 7f17af7fe700 20 reqs_thread_entry: start 2019-11-28T21:52:20.607 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:20.612+0000 7f189488fec0 20 get_system_obj_state: rctx=0x7ffd5e813938 obj=default.rgw.meta:users.uid:ragweed.client.0 state=0x55790c13c510 s->prefetch_data=0 2019-11-28T21:52:20.607 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:20.612+0000 7f189488fec0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2019-11-28T21:52:20.615 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:20.620+0000 7f189488fec0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2019-11-28T21:52:20.615 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:20.620+0000 7f189488fec0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-11-28T21:52:20.615 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:20.620+0000 7f189488fec0 20 get_system_obj_state: rctx=0x7ffd5e813948 obj=default.rgw.meta:users.email:ragweed.client.0+test@test.test state=0x55790c13e2a0 s->prefetch_data=0 2019-11-28T21:52:20.615 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:20.620+0000 7f189488fec0 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2019-11-28T21:52:20.622 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:20.627+0000 7f189488fec0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2019-11-28T21:52:20.622 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:20.627+0000 7f189488fec0 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2019-11-28T21:52:20.622 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:20.627+0000 7f189488fec0 20 get_system_obj_state: rctx=0x7ffd5e813948 obj=default.rgw.meta:users.keys:FRLRNKHPBTSOAEMQUXDP state=0x55790c13e2a0 s->prefetch_data=0 2019-11-28T21:52:20.622 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:20.627+0000 7f189488fec0 10 cache get: name=default.rgw.meta+users.keys+FRLRNKHPBTSOAEMQUXDP : miss 2019-11-28T21:52:20.628 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:20.633+0000 7f189488fec0 10 cache put: name=default.rgw.meta+users.keys+FRLRNKHPBTSOAEMQUXDP info.flags=0x0 2019-11-28T21:52:20.629 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:20.633+0000 7f189488fec0 10 adding default.rgw.meta+users.keys+FRLRNKHPBTSOAEMQUXDP to cache LRU end 2019-11-28T21:52:20.629 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:20.634+0000 7f189488fec0 20 get_system_obj_state: rctx=0x7ffd5e813558 obj=default.rgw.meta:users.keys:FRLRNKHPBTSOAEMQUXDP state=0x55790c13e2a0 s->prefetch_data=0 2019-11-28T21:52:20.629 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:20.634+0000 7f189488fec0 10 cache get: name=default.rgw.meta+users.keys+FRLRNKHPBTSOAEMQUXDP : type miss (requested=0x6, cached=0x0) 2019-11-28T21:52:20.634 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:20.639+0000 7f189488fec0 10 cache put: name=default.rgw.meta+users.keys+FRLRNKHPBTSOAEMQUXDP info.flags=0x0 2019-11-28T21:52:20.634 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:20.639+0000 7f189488fec0 10 moving default.rgw.meta+users.keys+FRLRNKHPBTSOAEMQUXDP to cache LRU end 2019-11-28T21:52:20.634 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:20.639+0000 7f189488fec0 20 get_system_obj_state: rctx=0x7ffd5e8136d8 obj=default.rgw.meta:users.keys:FRLRNKHPBTSOAEMQUXDP state=0x55790c13e2a0 s->prefetch_data=0 2019-11-28T21:52:20.634 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:20.639+0000 7f189488fec0 10 cache get: name=default.rgw.meta+users.keys+FRLRNKHPBTSOAEMQUXDP : type miss (requested=0x6, cached=0x0) 2019-11-28T21:52:20.640 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:20.645+0000 7f189488fec0 10 cache put: name=default.rgw.meta+users.keys+FRLRNKHPBTSOAEMQUXDP info.flags=0x0 2019-11-28T21:52:20.640 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:20.645+0000 7f189488fec0 10 moving default.rgw.meta+users.keys+FRLRNKHPBTSOAEMQUXDP to cache LRU end 2019-11-28T21:52:20.695 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:20.701+0000 7f189488fec0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2019-11-28T21:52:20.696 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:20.701+0000 7f189488fec0 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-11-28T21:52:20.696 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:20.701+0000 7f189488fec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=637 2019-11-28T21:52:20.708 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:20.714+0000 7f1872ffd700 10 RGWWatcher::handle_notify() notify_id 541165879298 cookie 93978381437696 notifier 4645 bl.length()=637 2019-11-28T21:52:20.709 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:20.714+0000 7f1872ffd700 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2019-11-28T21:52:20.709 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:20.714+0000 7f1872ffd700 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-11-28T21:52:21.382 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:21.387+0000 7f189488fec0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2019-11-28T21:52:21.382 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:21.387+0000 7f189488fec0 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2019-11-28T21:52:21.382 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:21.387+0000 7f189488fec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=202 2019-11-28T21:52:21.400 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:21.406+0000 7f1872ffd700 10 RGWWatcher::handle_notify() notify_id 541165879299 cookie 93978381435024 notifier 4645 bl.length()=202 2019-11-28T21:52:21.400 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:21.406+0000 7f1872ffd700 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2019-11-28T21:52:21.401 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:21.406+0000 7f1872ffd700 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2019-11-28T21:52:21.729 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:21.735+0000 7f189488fec0 10 cache put: name=default.rgw.meta+users.keys+FRLRNKHPBTSOAEMQUXDP info.flags=0x7 2019-11-28T21:52:21.729 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:21.735+0000 7f189488fec0 10 moving default.rgw.meta+users.keys+FRLRNKHPBTSOAEMQUXDP to cache LRU end 2019-11-28T21:52:21.730 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:21.735+0000 7f189488fec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=190 2019-11-28T21:52:21.751 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:21.756+0000 7f1872ffd700 10 RGWWatcher::handle_notify() notify_id 541165879300 cookie 93978381437696 notifier 4645 bl.length()=190 2019-11-28T21:52:21.751 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:21.756+0000 7f1872ffd700 10 cache put: name=default.rgw.meta+users.keys+FRLRNKHPBTSOAEMQUXDP info.flags=0x7 2019-11-28T21:52:21.751 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:21.756+0000 7f1872ffd700 10 moving default.rgw.meta+users.keys+FRLRNKHPBTSOAEMQUXDP to cache LRU end 2019-11-28T21:52:21.997 INFO:teuthology.orchestra.run.smithi074.stdout:{ 2019-11-28T21:52:21.997 INFO:teuthology.orchestra.run.smithi074.stdout: "user_id": "ragweed.client.0", 2019-11-28T21:52:21.997 INFO:teuthology.orchestra.run.smithi074.stdout: "display_name": "Mr. ragweed.client.0", 2019-11-28T21:52:21.998 INFO:teuthology.orchestra.run.smithi074.stdout: "email": "ragweed.client.0+test@test.test", 2019-11-28T21:52:21.998 INFO:teuthology.orchestra.run.smithi074.stdout: "suspended": 0, 2019-11-28T21:52:21.998 INFO:teuthology.orchestra.run.smithi074.stdout: "max_buckets": 1000, 2019-11-28T21:52:21.998 INFO:teuthology.orchestra.run.smithi074.stdout: "subusers": [], 2019-11-28T21:52:21.998 INFO:teuthology.orchestra.run.smithi074.stdout: "keys": [ 2019-11-28T21:52:21.998 INFO:teuthology.orchestra.run.smithi074.stdout: { 2019-11-28T21:52:21.998 INFO:teuthology.orchestra.run.smithi074.stdout: "user": "ragweed.client.0", 2019-11-28T21:52:21.999 INFO:teuthology.orchestra.run.smithi074.stdout: "access_key": "FRLRNKHPBTSOAEMQUXDP", 2019-11-28T21:52:21.999 INFO:teuthology.orchestra.run.smithi074.stdout: "secret_key": "EuvpUB3erSAHyfAYiaHnudmOSytYSe07WYe7NCRGVZ3uHLTz0lA0eQ==" 2019-11-28T21:52:21.999 INFO:teuthology.orchestra.run.smithi074.stdout: } 2019-11-28T21:52:21.999 INFO:teuthology.orchestra.run.smithi074.stdout: ], 2019-11-28T21:52:21.999 INFO:teuthology.orchestra.run.smithi074.stdout: "swift_keys": [], 2019-11-28T21:52:21.999 INFO:teuthology.orchestra.run.smithi074.stdout: "caps": [], 2019-11-28T21:52:21.999 INFO:teuthology.orchestra.run.smithi074.stdout: "op_mask": "read, write, delete", 2019-11-28T21:52:21.999 INFO:teuthology.orchestra.run.smithi074.stdout: "system": "true", 2019-11-28T21:52:22.000 INFO:teuthology.orchestra.run.smithi074.stdout: "default_placement": "", 2019-11-28T21:52:22.000 INFO:teuthology.orchestra.run.smithi074.stdout: "default_storage_class": "", 2019-11-28T21:52:22.000 INFO:teuthology.orchestra.run.smithi074.stdout: "placement_tags": [], 2019-11-28T21:52:22.000 INFO:teuthology.orchestra.run.smithi074.stdout: "bucket_quota": { 2019-11-28T21:52:22.000 INFO:teuthology.orchestra.run.smithi074.stdout: "enabled": false, 2019-11-28T21:52:22.000 INFO:teuthology.orchestra.run.smithi074.stdout: "check_on_raw": false, 2019-11-28T21:52:22.000 INFO:teuthology.orchestra.run.smithi074.stdout: "max_size": -1, 2019-11-28T21:52:22.001 INFO:teuthology.orchestra.run.smithi074.stdout: "max_size_kb": 0, 2019-11-28T21:52:22.001 INFO:teuthology.orchestra.run.smithi074.stdout: "max_objects": -1 2019-11-28T21:52:22.001 INFO:teuthology.orchestra.run.smithi074.stdout: }, 2019-11-28T21:52:22.001 INFO:teuthology.orchestra.run.smithi074.stdout: "user_quota": { 2019-11-28T21:52:22.001 INFO:teuthology.orchestra.run.smithi074.stdout: "enabled": false, 2019-11-28T21:52:22.001 INFO:teuthology.orchestra.run.smithi074.stdout: "check_on_raw": false, 2019-11-28T21:52:22.001 INFO:teuthology.orchestra.run.smithi074.stdout: "max_size": -1, 2019-11-28T21:52:22.001 INFO:teuthology.orchestra.run.smithi074.stdout: "max_size_kb": 0, 2019-11-28T21:52:22.002 INFO:teuthology.orchestra.run.smithi074.stdout: "max_objects": -1 2019-11-28T21:52:22.002 INFO:teuthology.orchestra.run.smithi074.stdout: }, 2019-11-28T21:52:22.002 INFO:teuthology.orchestra.run.smithi074.stdout: "temp_url_keys": [], 2019-11-28T21:52:22.002 INFO:teuthology.orchestra.run.smithi074.stdout: "type": "rgw", 2019-11-28T21:52:22.002 INFO:teuthology.orchestra.run.smithi074.stdout: "mfa_ids": [] 2019-11-28T21:52:22.002 INFO:teuthology.orchestra.run.smithi074.stdout:} 2019-11-28T21:52:22.002 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:52:22.051 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:22.057+0000 7f189488fec0 20 remove_watcher() i=0 2019-11-28T21:52:22.051 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:22.057+0000 7f189488fec0 2 removed watcher, disabling cache 2019-11-28T21:52:22.123 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:22.128+0000 7f189488fec0 20 remove_watcher() i=1 2019-11-28T21:52:22.186 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:22.191+0000 7f189488fec0 20 remove_watcher() i=2 2019-11-28T21:52:22.224 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:22.230+0000 7f189488fec0 20 remove_watcher() i=3 2019-11-28T21:52:22.268 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:22.272+0000 7f189488fec0 20 remove_watcher() i=4 2019-11-28T21:52:22.307 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:22.311+0000 7f189488fec0 20 remove_watcher() i=5 2019-11-28T21:52:22.340 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:22.346+0000 7f189488fec0 20 remove_watcher() i=6 2019-11-28T21:52:22.378 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:52:22.383+0000 7f189488fec0 20 remove_watcher() i=7 2019-11-28T21:52:22.383 INFO:tasks.ragweed:Configuring ragweed... 2019-11-28T21:52:22.384 INFO:teuthology.orchestra.run.smithi074:> cd /home/ubuntu/cephtest/ragweed && ./bootstrap 2019-11-28T21:52:28.356 INFO:teuthology.orchestra.run.smithi074.stderr:./bootstrap: missing required RPM packages. Installing via sudo. 2019-11-28T21:52:28.460 INFO:teuthology.orchestra.run.smithi074.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T21:52:28.499 INFO:teuthology.orchestra.run.smithi074.stdout:Loading mirror speeds from cached hostfile 2019-11-28T21:52:28.500 INFO:teuthology.orchestra.run.smithi074.stdout: * base: mirror.cogentco.com 2019-11-28T21:52:28.500 INFO:teuthology.orchestra.run.smithi074.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T21:52:28.500 INFO:teuthology.orchestra.run.smithi074.stdout: * extras: mirror.linux.duke.edu 2019-11-28T21:52:28.501 INFO:teuthology.orchestra.run.smithi074.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-11-28T21:52:29.154 INFO:teuthology.orchestra.run.smithi074.stdout:7 packages excluded due to repository priority protections 2019-11-28T21:52:29.604 INFO:teuthology.orchestra.run.smithi074.stdout:Package python2-pip-8.1.2-10.el7.noarch already installed and latest version 2019-11-28T21:52:30.472 INFO:teuthology.orchestra.run.smithi074.stdout:Resolving Dependencies 2019-11-28T21:52:30.473 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:52:30.473 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package libevent-devel.x86_64 0:2.0.21-4.el7 will be installed 2019-11-28T21:52:30.475 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package libxml2-devel.x86_64 0:2.9.1-6.el7_2.3 will be installed 2019-11-28T21:52:30.477 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: xz-devel for package: libxml2-devel-2.9.1-6.el7_2.3.x86_64 2019-11-28T21:52:30.510 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package libxslt-devel.x86_64 0:1.1.28-5.el7 will be installed 2019-11-28T21:52:30.511 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: libgcrypt-devel for package: libxslt-devel-1.1.28-5.el7.x86_64 2019-11-28T21:52:30.514 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package zlib-devel.x86_64 0:1.2.7-18.el7 will be installed 2019-11-28T21:52:30.514 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:52:30.514 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package libgcrypt-devel.x86_64 0:1.5.3-14.el7 will be installed 2019-11-28T21:52:30.516 INFO:teuthology.orchestra.run.smithi074.stdout:--> Processing Dependency: libgpg-error-devel for package: libgcrypt-devel-1.5.3-14.el7.x86_64 2019-11-28T21:52:30.519 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package xz-devel.x86_64 0:5.2.2-1.el7 will be installed 2019-11-28T21:52:30.520 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T21:52:30.520 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package libgpg-error-devel.x86_64 0:1.12-3.el7 will be installed 2019-11-28T21:52:30.919 INFO:teuthology.orchestra.run.smithi074.stdout:--> Finished Dependency Resolution 2019-11-28T21:52:31.110 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:52:31.110 INFO:teuthology.orchestra.run.smithi074.stdout:Dependencies Resolved 2019-11-28T21:52:31.112 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:52:31.112 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:52:31.112 INFO:teuthology.orchestra.run.smithi074.stdout: Package Arch Version Repository Size 2019-11-28T21:52:31.112 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:52:31.112 INFO:teuthology.orchestra.run.smithi074.stdout:Installing: 2019-11-28T21:52:31.113 INFO:teuthology.orchestra.run.smithi074.stdout: libevent-devel x86_64 2.0.21-4.el7 base 85 k 2019-11-28T21:52:31.113 INFO:teuthology.orchestra.run.smithi074.stdout: libxml2-devel x86_64 2.9.1-6.el7_2.3 base 1.0 M 2019-11-28T21:52:31.113 INFO:teuthology.orchestra.run.smithi074.stdout: libxslt-devel x86_64 1.1.28-5.el7 base 309 k 2019-11-28T21:52:31.113 INFO:teuthology.orchestra.run.smithi074.stdout: zlib-devel x86_64 1.2.7-18.el7 base 50 k 2019-11-28T21:52:31.113 INFO:teuthology.orchestra.run.smithi074.stdout:Installing for dependencies: 2019-11-28T21:52:31.113 INFO:teuthology.orchestra.run.smithi074.stdout: libgcrypt-devel x86_64 1.5.3-14.el7 base 129 k 2019-11-28T21:52:31.114 INFO:teuthology.orchestra.run.smithi074.stdout: libgpg-error-devel x86_64 1.12-3.el7 base 16 k 2019-11-28T21:52:31.114 INFO:teuthology.orchestra.run.smithi074.stdout: xz-devel x86_64 5.2.2-1.el7 base 46 k 2019-11-28T21:52:31.114 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:52:31.114 INFO:teuthology.orchestra.run.smithi074.stdout:Transaction Summary 2019-11-28T21:52:31.114 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T21:52:31.114 INFO:teuthology.orchestra.run.smithi074.stdout:Install 4 Packages (+3 Dependent packages) 2019-11-28T21:52:31.114 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:52:31.114 INFO:teuthology.orchestra.run.smithi074.stdout:Total download size: 1.7 M 2019-11-28T21:52:31.115 INFO:teuthology.orchestra.run.smithi074.stdout:Installed size: 12 M 2019-11-28T21:52:31.115 INFO:teuthology.orchestra.run.smithi074.stdout:Downloading packages: 2019-11-28T21:52:31.520 INFO:teuthology.orchestra.run.smithi074.stdout:-------------------------------------------------------------------------------- 2019-11-28T21:52:31.520 INFO:teuthology.orchestra.run.smithi074.stdout:Total 4.1 MB/s | 1.7 MB 00:00 2019-11-28T21:52:31.527 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction check 2019-11-28T21:52:31.539 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction test 2019-11-28T21:52:31.587 INFO:teuthology.orchestra.run.smithi074.stdout:Transaction test succeeded 2019-11-28T21:52:31.587 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction 2019-11-28T21:52:32.165 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : libgpg-error-devel-1.12-3.el7.x86_64 1/7 2019-11-28T21:52:32.472 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : libgcrypt-devel-1.5.3-14.el7.x86_64 2/7 2019-11-28T21:52:32.761 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : zlib-devel-1.2.7-18.el7.x86_64 3/7 2019-11-28T21:52:33.350 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : xz-devel-5.2.2-1.el7.x86_64 4/7 2019-11-28T21:52:33.741 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : libxml2-devel-2.9.1-6.el7_2.3.x86_64 5/7 2019-11-28T21:52:34.099 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : libxslt-devel-1.1.28-5.el7.x86_64 6/7 2019-11-28T21:52:34.365 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : libevent-devel-2.0.21-4.el7.x86_64 7/7 2019-11-28T21:52:34.460 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : xz-devel-5.2.2-1.el7.x86_64 1/7 2019-11-28T21:52:34.586 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : libxml2-devel-2.9.1-6.el7_2.3.x86_64 2/7 2019-11-28T21:52:34.711 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : zlib-devel-1.2.7-18.el7.x86_64 3/7 2019-11-28T21:52:34.862 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : libxslt-devel-1.1.28-5.el7.x86_64 4/7 2019-11-28T21:52:34.963 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : libgpg-error-devel-1.12-3.el7.x86_64 5/7 2019-11-28T21:52:35.080 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : libevent-devel-2.0.21-4.el7.x86_64 6/7 2019-11-28T21:52:35.566 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : libgcrypt-devel-1.5.3-14.el7.x86_64 7/7 2019-11-28T21:52:35.566 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:52:35.566 INFO:teuthology.orchestra.run.smithi074.stdout:Installed: 2019-11-28T21:52:35.566 INFO:teuthology.orchestra.run.smithi074.stdout: libevent-devel.x86_64 0:2.0.21-4.el7 libxml2-devel.x86_64 0:2.9.1-6.el7_2.3 2019-11-28T21:52:35.567 INFO:teuthology.orchestra.run.smithi074.stdout: libxslt-devel.x86_64 0:1.1.28-5.el7 zlib-devel.x86_64 0:1.2.7-18.el7 2019-11-28T21:52:35.567 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:52:35.567 INFO:teuthology.orchestra.run.smithi074.stdout:Dependency Installed: 2019-11-28T21:52:35.567 INFO:teuthology.orchestra.run.smithi074.stdout: libgcrypt-devel.x86_64 0:1.5.3-14.el7 libgpg-error-devel.x86_64 0:1.12-3.el7 2019-11-28T21:52:35.567 INFO:teuthology.orchestra.run.smithi074.stdout: xz-devel.x86_64 0:5.2.2-1.el7 2019-11-28T21:52:35.567 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:52:35.567 INFO:teuthology.orchestra.run.smithi074.stdout:Complete! 2019-11-28T21:52:35.783 INFO:teuthology.orchestra.run.smithi074.stdout:New python executable in /home/ubuntu/cephtest/ragweed/virtualenv/bin/python 2019-11-28T21:52:37.682 INFO:teuthology.orchestra.run.smithi074.stdout:Installing setuptools, pip, wheel...done. 2019-11-28T21:52:38.245 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting pip 2019-11-28T21:52:38.353 INFO:teuthology.orchestra.run.smithi074.stdout: Downloading https://files.pythonhosted.org/packages/00/b6/9cfa56b4081ad13874b0c6f96af8ce16cfbc1cb06bedf8e9164ce5551ec1/pip-19.3.1-py2.py3-none-any.whl (1.4MB) 2019-11-28T21:52:38.607 INFO:teuthology.orchestra.run.smithi074.stdout:Installing collected packages: pip 2019-11-28T21:52:38.608 INFO:teuthology.orchestra.run.smithi074.stdout: Found existing installation: pip 9.0.1 2019-11-28T21:52:38.671 INFO:teuthology.orchestra.run.smithi074.stdout: Uninstalling pip-9.0.1: 2019-11-28T21:52:38.720 INFO:teuthology.orchestra.run.smithi074.stdout: Successfully uninstalled pip-9.0.1 2019-11-28T21:52:39.342 INFO:teuthology.orchestra.run.smithi074.stdout:Successfully installed pip-19.3.1 2019-11-28T21:52:40.026 INFO:teuthology.orchestra.run.smithi074.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-28T21:52:40.102 INFO:teuthology.orchestra.run.smithi074.stdout:Requirement already satisfied: six in /usr/lib/python2.7/site-packages (1.9.0) 2019-11-28T21:52:40.953 INFO:teuthology.orchestra.run.smithi074.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-28T21:52:41.175 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting nose 2019-11-28T21:52:41.207 INFO:teuthology.orchestra.run.smithi074.stdout: Downloading https://files.pythonhosted.org/packages/99/4f/13fb671119e65c4dce97c60e67d3fd9e6f7f809f2b307e2611f4701205cb/nose-1.3.7-py2-none-any.whl (154kB) 2019-11-28T21:52:41.318 INFO:teuthology.orchestra.run.smithi074.stdout:Installing collected packages: nose 2019-11-28T21:52:41.387 INFO:teuthology.orchestra.run.smithi074.stdout:Successfully installed nose-1.3.7 2019-11-28T21:52:41.867 INFO:teuthology.orchestra.run.smithi074.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-28T21:52:42.397 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting setuptools==32.3.1 2019-11-28T21:52:42.444 INFO:teuthology.orchestra.run.smithi074.stdout: Downloading https://files.pythonhosted.org/packages/69/19/b1dff551058ce79d88b1e3688f1c735590d7ddf44d10681512133b35019f/setuptools-32.3.1-py2.py3-none-any.whl (479kB) 2019-11-28T21:52:42.725 INFO:teuthology.orchestra.run.smithi074.stderr:ERROR: kubernetes 10.0.1 has requirement ipaddress>=1.0.17, but you'll have ipaddress 1.0.16 which is incompatible. 2019-11-28T21:52:42.725 INFO:teuthology.orchestra.run.smithi074.stdout:Installing collected packages: setuptools 2019-11-28T21:52:42.725 INFO:teuthology.orchestra.run.smithi074.stdout: Found existing installation: setuptools 28.8.0 2019-11-28T21:52:42.742 INFO:teuthology.orchestra.run.smithi074.stdout: Uninstalling setuptools-28.8.0: 2019-11-28T21:52:42.753 INFO:teuthology.orchestra.run.smithi074.stdout: Successfully uninstalled setuptools-28.8.0 2019-11-28T21:52:42.877 INFO:teuthology.orchestra.run.smithi074.stdout:Successfully installed setuptools-32.3.1 2019-11-28T21:52:43.388 INFO:teuthology.orchestra.run.smithi074.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-28T21:52:43.718 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting PyYAML 2019-11-28T21:52:43.769 INFO:teuthology.orchestra.run.smithi074.stdout: Downloading https://files.pythonhosted.org/packages/e3/e8/b3212641ee2718d556df0f23f78de8303f068fe29cdaa7a91018849582fe/PyYAML-5.1.2.tar.gz (265kB) 2019-11-28T21:52:44.385 INFO:teuthology.orchestra.run.smithi074.stdout:Requirement already up-to-date: nose>=1.0.0 in ./virtualenv/lib/python2.7/site-packages (from -r requirements.txt (line 2)) (1.3.7) 2019-11-28T21:52:44.569 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting boto!=2.46.0,>=2.6.0 2019-11-28T21:52:44.580 INFO:teuthology.orchestra.run.smithi074.stdout: Downloading https://files.pythonhosted.org/packages/23/10/c0b78c27298029e4454a472a1919bde20cb182dab1662cec7f2ca1dcc523/boto-2.49.0-py2.py3-none-any.whl (1.4MB) 2019-11-28T21:52:44.837 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting bunch>=1.0.0 2019-11-28T21:52:44.847 INFO:teuthology.orchestra.run.smithi074.stdout: Downloading https://files.pythonhosted.org/packages/ef/bf/a4cf1779a4ffb4f610903fa08e15d1f4a8a2f4e3353a02afbe097c5bf4a8/bunch-1.0.1.tar.gz 2019-11-28T21:52:45.527 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting gevent>=1.0 2019-11-28T21:52:45.544 INFO:teuthology.orchestra.run.smithi074.stdout: Downloading https://files.pythonhosted.org/packages/e6/e9/3a693414f706e12abe60554cd73c5ae8f848b182ae58018f93d86c9eb418/gevent-1.4.0-cp27-cp27mu-manylinux1_x86_64.whl (5.0MB) 2019-11-28T21:52:45.989 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting httplib2 2019-11-28T21:52:45.999 INFO:teuthology.orchestra.run.smithi074.stdout: Downloading https://files.pythonhosted.org/packages/ce/2e/87461bfbb7e561203b759b3f7f639e2144226604372830d00a8279960ae1/httplib2-0.14.0.tar.gz (219kB) 2019-11-28T21:52:47.139 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting lxml 2019-11-28T21:52:47.156 INFO:teuthology.orchestra.run.smithi074.stdout: Downloading https://files.pythonhosted.org/packages/25/73/730ad7249847f741c7e622f52b971daa5540f6fb87589bc92c717f5aafba/lxml-4.4.2-cp27-cp27mu-manylinux1_x86_64.whl (5.7MB) 2019-11-28T21:52:47.957 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting greenlet>=0.4.14; platform_python_implementation == "CPython" 2019-11-28T21:52:47.967 INFO:teuthology.orchestra.run.smithi074.stdout: Downloading https://files.pythonhosted.org/packages/8b/6e/f2d25875713ad0885c8d3c69269697406652e6f64e1a6bd8264f7a609327/greenlet-0.4.15-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-28T21:52:48.034 INFO:teuthology.orchestra.run.smithi074.stdout:Building wheels for collected packages: PyYAML, bunch, httplib2 2019-11-28T21:52:48.034 INFO:teuthology.orchestra.run.smithi074.stdout: Building wheel for PyYAML (setup.py): started 2019-11-28T21:52:48.655 INFO:teuthology.orchestra.run.smithi074.stdout: Building wheel for PyYAML (setup.py): finished with status 'done' 2019-11-28T21:52:48.655 INFO:teuthology.orchestra.run.smithi074.stdout: Created wheel for PyYAML: filename=PyYAML-5.1.2-cp27-cp27mu-linux_x86_64.whl size=46204 sha256=984e4ee1ef70ea1e205e182498c66cc336275a40cd56a8c4b954a1a39a203844 2019-11-28T21:52:48.656 INFO:teuthology.orchestra.run.smithi074.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/d9/45/dd/65f0b38450c47cf7e5312883deb97d065e030c5cca0a365030 2019-11-28T21:52:48.678 INFO:teuthology.orchestra.run.smithi074.stdout: Building wheel for bunch (setup.py): started 2019-11-28T21:52:48.974 INFO:teuthology.orchestra.run.smithi074.stdout: Building wheel for bunch (setup.py): finished with status 'done' 2019-11-28T21:52:48.974 INFO:teuthology.orchestra.run.smithi074.stdout: Created wheel for bunch: filename=bunch-1.0.1-cp27-none-any.whl size=8347 sha256=cdb8c488720932706c06d7cf0857234ee00b9706d42fd372205cb99cd81c5e86 2019-11-28T21:52:48.975 INFO:teuthology.orchestra.run.smithi074.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/56/0f/19/fbbf81e5764e6d8b74501c4357a88c14c94466ec777c03734c 2019-11-28T21:52:48.980 INFO:teuthology.orchestra.run.smithi074.stdout: Building wheel for httplib2 (setup.py): started 2019-11-28T21:52:49.322 INFO:teuthology.orchestra.run.smithi074.stdout: Building wheel for httplib2 (setup.py): finished with status 'done' 2019-11-28T21:52:49.322 INFO:teuthology.orchestra.run.smithi074.stdout: Created wheel for httplib2: filename=httplib2-0.14.0-cp27-none-any.whl size=96742 sha256=d0004a9538e3919e86777d2c27f70e5c58c71c1020b5fd2c0f3e2fb7b929322f 2019-11-28T21:52:49.322 INFO:teuthology.orchestra.run.smithi074.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/51/ab/65/f318b4271019823cf7d7c178ac76a8ea4d6e6271fe9f5ba488 2019-11-28T21:52:49.327 INFO:teuthology.orchestra.run.smithi074.stdout:Successfully built PyYAML bunch httplib2 2019-11-28T21:52:49.436 INFO:teuthology.orchestra.run.smithi074.stderr:ERROR: kubernetes 10.0.1 has requirement ipaddress>=1.0.17, but you'll have ipaddress 1.0.16 which is incompatible. 2019-11-28T21:52:49.437 INFO:teuthology.orchestra.run.smithi074.stdout:Installing collected packages: PyYAML, boto, bunch, greenlet, gevent, httplib2, lxml 2019-11-28T21:52:49.437 INFO:teuthology.orchestra.run.smithi074.stdout: Found existing installation: PyYAML 3.10 2019-11-28T21:52:49.437 INFO:teuthology.orchestra.run.smithi074.stdout: Not uninstalling pyyaml at /usr/lib64/python2.7/site-packages, outside environment /home/ubuntu/cephtest/ragweed/virtualenv 2019-11-28T21:52:49.437 INFO:teuthology.orchestra.run.smithi074.stdout: Can't uninstall 'PyYAML'. No files were found to uninstall. 2019-11-28T21:52:50.467 INFO:teuthology.orchestra.run.smithi074.stdout: Found existing installation: lxml 3.2.1 2019-11-28T21:52:50.469 INFO:teuthology.orchestra.run.smithi074.stdout: Not uninstalling lxml at /usr/lib64/python2.7/site-packages, outside environment /home/ubuntu/cephtest/ragweed/virtualenv 2019-11-28T21:52:50.469 INFO:teuthology.orchestra.run.smithi074.stdout: Can't uninstall 'lxml'. No files were found to uninstall. 2019-11-28T21:52:50.571 INFO:teuthology.orchestra.run.smithi074.stdout:Successfully installed PyYAML-5.1.2 boto-2.49.0 bunch-1.0.1 gevent-1.4.0 greenlet-0.4.15 httplib2-0.14.0 lxml-4.4.2 2019-11-28T21:52:51.015 INFO:teuthology.orchestra.run.smithi074.stdout:running develop 2019-11-28T21:52:51.085 INFO:teuthology.orchestra.run.smithi074.stdout:running egg_info 2019-11-28T21:52:51.085 INFO:teuthology.orchestra.run.smithi074.stdout:creating ragweed.egg-info 2019-11-28T21:52:51.086 INFO:teuthology.orchestra.run.smithi074.stdout:writing requirements to ragweed.egg-info/requires.txt 2019-11-28T21:52:51.086 INFO:teuthology.orchestra.run.smithi074.stdout:writing ragweed.egg-info/PKG-INFO 2019-11-28T21:52:51.086 INFO:teuthology.orchestra.run.smithi074.stdout:writing top-level names to ragweed.egg-info/top_level.txt 2019-11-28T21:52:51.086 INFO:teuthology.orchestra.run.smithi074.stdout:writing dependency_links to ragweed.egg-info/dependency_links.txt 2019-11-28T21:52:51.086 INFO:teuthology.orchestra.run.smithi074.stdout:writing manifest file 'ragweed.egg-info/SOURCES.txt' 2019-11-28T21:52:51.087 INFO:teuthology.orchestra.run.smithi074.stdout:reading manifest file 'ragweed.egg-info/SOURCES.txt' 2019-11-28T21:52:51.087 INFO:teuthology.orchestra.run.smithi074.stdout:writing manifest file 'ragweed.egg-info/SOURCES.txt' 2019-11-28T21:52:51.088 INFO:teuthology.orchestra.run.smithi074.stdout:running build_ext 2019-11-28T21:52:51.089 INFO:teuthology.orchestra.run.smithi074.stdout:Creating /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages/ragweed.egg-link (link to .) 2019-11-28T21:52:51.089 INFO:teuthology.orchestra.run.smithi074.stdout:Adding ragweed 0.0.1 to easy-install.pth file 2019-11-28T21:52:51.089 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:52:51.089 INFO:teuthology.orchestra.run.smithi074.stdout:Installed /home/ubuntu/cephtest/ragweed 2019-11-28T21:52:51.090 INFO:teuthology.orchestra.run.smithi074.stdout:Processing dependencies for ragweed==0.0.1 2019-11-28T21:52:51.093 INFO:teuthology.orchestra.run.smithi074.stdout:Searching for isodate>=0.4.4 2019-11-28T21:52:51.094 INFO:teuthology.orchestra.run.smithi074.stdout:Reading https://pypi.python.org/simple/isodate/ 2019-11-28T21:52:51.185 INFO:teuthology.orchestra.run.smithi074.stdout:Downloading https://files.pythonhosted.org/packages/b1/80/fb8c13a4cd38eb5021dc3741a9e588e4d1de88d895c1910c6fc8a08b7a70/isodate-0.6.0.tar.gz#sha256=2e364a3d5759479cdb2d37cce6b9376ea504db2ff90252a2e5b7cc89cc9ff2d8 2019-11-28T21:52:51.234 INFO:teuthology.orchestra.run.smithi074.stdout:Best match: isodate 0.6.0 2019-11-28T21:52:51.234 INFO:teuthology.orchestra.run.smithi074.stdout:Processing isodate-0.6.0.tar.gz 2019-11-28T21:52:51.241 INFO:teuthology.orchestra.run.smithi074.stdout:Writing /tmp/easy_install-HO4HMW/isodate-0.6.0/setup.cfg 2019-11-28T21:52:51.241 INFO:teuthology.orchestra.run.smithi074.stdout:Running isodate-0.6.0/setup.py -q bdist_egg --dist-dir /tmp/easy_install-HO4HMW/isodate-0.6.0/egg-dist-tmp-EezXql 2019-11-28T21:52:51.518 INFO:teuthology.orchestra.run.smithi074.stderr:zip_safe flag not set; analyzing archive contents... 2019-11-28T21:52:51.532 INFO:teuthology.orchestra.run.smithi074.stdout:Moving isodate-0.6.0-py2.7.egg to /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-11-28T21:52:51.533 INFO:teuthology.orchestra.run.smithi074.stdout:Adding isodate 0.6.0 to easy-install.pth file 2019-11-28T21:52:51.534 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:52:51.534 INFO:teuthology.orchestra.run.smithi074.stdout:Installed /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages/isodate-0.6.0-py2.7.egg 2019-11-28T21:52:51.558 INFO:teuthology.orchestra.run.smithi074.stdout:Searching for gevent==1.4.0 2019-11-28T21:52:51.558 INFO:teuthology.orchestra.run.smithi074.stdout:Best match: gevent 1.4.0 2019-11-28T21:52:51.558 INFO:teuthology.orchestra.run.smithi074.stdout:Adding gevent 1.4.0 to easy-install.pth file 2019-11-28T21:52:51.562 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:52:51.562 INFO:teuthology.orchestra.run.smithi074.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-11-28T21:52:51.562 INFO:teuthology.orchestra.run.smithi074.stdout:Searching for bunch==1.0.1 2019-11-28T21:52:51.563 INFO:teuthology.orchestra.run.smithi074.stdout:Best match: bunch 1.0.1 2019-11-28T21:52:51.563 INFO:teuthology.orchestra.run.smithi074.stdout:Adding bunch 1.0.1 to easy-install.pth file 2019-11-28T21:52:51.563 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:52:51.564 INFO:teuthology.orchestra.run.smithi074.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-11-28T21:52:51.564 INFO:teuthology.orchestra.run.smithi074.stdout:Searching for PyYAML==5.1.2 2019-11-28T21:52:51.564 INFO:teuthology.orchestra.run.smithi074.stdout:Best match: PyYAML 5.1.2 2019-11-28T21:52:51.564 INFO:teuthology.orchestra.run.smithi074.stdout:Adding PyYAML 5.1.2 to easy-install.pth file 2019-11-28T21:52:51.565 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:52:51.565 INFO:teuthology.orchestra.run.smithi074.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-11-28T21:52:51.565 INFO:teuthology.orchestra.run.smithi074.stdout:Searching for boto==2.49.0 2019-11-28T21:52:51.565 INFO:teuthology.orchestra.run.smithi074.stdout:Best match: boto 2.49.0 2019-11-28T21:52:51.566 INFO:teuthology.orchestra.run.smithi074.stdout:Adding boto 2.49.0 to easy-install.pth file 2019-11-28T21:52:51.566 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:52:51.566 INFO:teuthology.orchestra.run.smithi074.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-11-28T21:52:51.566 INFO:teuthology.orchestra.run.smithi074.stdout:Searching for six==1.9.0 2019-11-28T21:52:51.566 INFO:teuthology.orchestra.run.smithi074.stdout:Best match: six 1.9.0 2019-11-28T21:52:51.567 INFO:teuthology.orchestra.run.smithi074.stdout:Adding six 1.9.0 to easy-install.pth file 2019-11-28T21:52:51.567 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:52:51.567 INFO:teuthology.orchestra.run.smithi074.stdout:Using /usr/lib/python2.7/site-packages 2019-11-28T21:52:51.572 INFO:teuthology.orchestra.run.smithi074.stdout:Searching for greenlet==0.4.15 2019-11-28T21:52:51.572 INFO:teuthology.orchestra.run.smithi074.stdout:Best match: greenlet 0.4.15 2019-11-28T21:52:51.572 INFO:teuthology.orchestra.run.smithi074.stdout:Adding greenlet 0.4.15 to easy-install.pth file 2019-11-28T21:52:51.573 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:52:51.573 INFO:teuthology.orchestra.run.smithi074.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-11-28T21:52:51.573 INFO:teuthology.orchestra.run.smithi074.stdout:Finished processing dependencies for ragweed==0.0.1 2019-11-28T21:52:51.587 INFO:teuthology.orchestra.run.smithi074:> cat > /home/ubuntu/cephtest/archive/ragweed.client.0.conf 2019-11-28T21:52:51.655 INFO:tasks.ragweed:Configuring boto... 2019-11-28T21:52:51.655 INFO:teuthology.orchestra.run.smithi074:> cat > /home/ubuntu/cephtest/boto.cfg 2019-11-28T21:52:51.771 INFO:teuthology.orchestra.run.smithi074:ragweed tests against rgw> RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg /home/ubuntu/cephtest/ragweed/virtualenv/bin/nosetests -w /home/ubuntu/cephtest/ragweed -v -a '!fails_on_rgw' 2019-11-28T21:53:20.464 INFO:teuthology.orchestra.run.smithi074.stderr:ragweed.tests.tests.r_test_multipart_defer_complete.test ... ok 2019-11-28T21:53:43.204 INFO:teuthology.orchestra.run.smithi074.stderr:ragweed.tests.tests.r_test_multipart_defer_update_complete.test ... ok 2019-11-28T21:54:05.884 INFO:teuthology.orchestra.run.smithi074.stderr:ragweed.tests.tests.r_test_multipart_index_versioning.test ... ok 2019-11-28T21:54:25.530 INFO:teuthology.orchestra.run.smithi074.stderr:ragweed.tests.tests.r_test_multipart_simple.test ... ok 2019-11-28T21:54:50.847 INFO:teuthology.orchestra.run.smithi074.stderr:ragweed.tests.tests.r_test_obj_storage_class.test ... ok 2019-11-28T21:55:24.848 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:09:07.077 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T21:55:24.922 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:09:07.162 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T21:55:24.967 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:09:07.195 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T21:55:24.976 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:09:07.206 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T21:55:25.000 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:09:07.241 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T21:55:25.041 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:09:07.271 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T21:55:25.632 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:09:07.861 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T21:55:25.647 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:09:07.877 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T21:55:25.709 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:09:07.949 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T21:56:01.929 INFO:teuthology.orchestra.run.smithi074.stderr:ragweed.tests.tests.r_test_obj_storage_class_copy.test ... ok 2019-11-28T21:57:00.226 INFO:teuthology.orchestra.run.smithi074.stderr:ragweed.tests.tests.r_test_obj_storage_class_multipart.test ... ok 2019-11-28T21:57:28.077 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:11:10.308 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T21:57:28.089 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:11:10.320 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T21:57:28.096 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:11:10.339 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T21:57:28.097 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:11:10.329 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T21:57:28.103 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:11:10.336 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T21:57:28.107 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:11:10.349 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T21:57:28.197 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:11:10.428 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T21:57:28.217 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:11:10.450 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T21:57:28.253 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:11:10.495 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T21:58:46.478 INFO:teuthology.orchestra.run.smithi074.stderr:ragweed.tests.tests.r_test_obj_storage_class_multipart_copy.test ... ok 2019-11-28T21:59:16.661 INFO:teuthology.orchestra.run.smithi074.stderr:ragweed.tests.tests.r_test_small_obj_data.test ... ok 2019-11-28T21:59:16.662 INFO:teuthology.orchestra.run.smithi074.stderr: 2019-11-28T21:59:16.662 INFO:teuthology.orchestra.run.smithi074.stderr:---------------------------------------------------------------------- 2019-11-28T21:59:16.662 INFO:teuthology.orchestra.run.smithi074.stderr:Ran 9 tests in 384.490s 2019-11-28T21:59:16.663 INFO:teuthology.orchestra.run.smithi074.stderr: 2019-11-28T21:59:16.663 INFO:teuthology.orchestra.run.smithi074.stderr:OK 2019-11-28T21:59:16.685 INFO:tasks.ragweed:Cleaning up boto... 2019-11-28T21:59:16.685 INFO:teuthology.orchestra.run.smithi074:> rm /home/ubuntu/cephtest/boto.cfg 2019-11-28T21:59:16.738 INFO:teuthology.orchestra.run.smithi074:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2019-11-28T21:59:16.849 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:16.862+0000 7f5308217ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:16.873 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:16.887+0000 7f5308217ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:59:16.874 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:16.887+0000 7f5308217ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:16.880 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:16.894+0000 7f5308217ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:59:16.880 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:16.894+0000 7f5308217ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:16.887 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:16.900+0000 7f5308217ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:59:16.887 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:16.900+0000 7f5308217ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:16.899 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:16.913+0000 7f5308217ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T21:59:17.109 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.122+0000 7f5308217ec0 20 RGWRados::pool_iterate: got zonegroup_info.cb1773b4-411c-4317-a760-df89ca0f54fc 2019-11-28T21:59:17.109 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.122+0000 7f5308217ec0 20 RGWRados::pool_iterate: got zone_info.bd5ae442-b074-4d35-94cc-b1d71bd6ac02 2019-11-28T21:59:17.109 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.122+0000 7f5308217ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-28T21:59:17.109 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.122+0000 7f5308217ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-28T21:59:17.110 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.122+0000 7f5308217ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:17.125 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.139+0000 7f5308217ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T21:59:17.125 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.139+0000 7f5308217ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:17.140 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.153+0000 7f5308217ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T21:59:17.140 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.153+0000 7f5308217ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:17.150 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.163+0000 7f5308217ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T21:59:17.150 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.163+0000 7f5308217ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:17.163 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.177+0000 7f5308217ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T21:59:17.164 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.177+0000 7f5308217ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:17.172 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.185+0000 7f5308217ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:59:17.172 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.185+0000 7f5308217ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-28T21:59:17.172 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.185+0000 7f5308217ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:17.182 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.195+0000 7f5308217ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:59:17.182 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.195+0000 7f5308217ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:17.194 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.207+0000 7f5308217ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T21:59:17.195 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.207+0000 7f5308217ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:17.205 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.218+0000 7f5308217ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T21:59:17.205 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.218+0000 7f5308217ec0 20 zonegroup default 2019-11-28T21:59:17.205 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.218+0000 7f5308217ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:17.212 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.226+0000 7f5308217ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:59:17.213 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.226+0000 7f5308217ec0 10 Cannot find current period zone using local zone 2019-11-28T21:59:17.213 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.226+0000 7f5308217ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:17.223 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.237+0000 7f5308217ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:59:17.224 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.237+0000 7f5308217ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:17.232 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.245+0000 7f5308217ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T21:59:17.232 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.245+0000 7f5308217ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:17.251 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.263+0000 7f5308217ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T21:59:17.251 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.263+0000 7f5308217ec0 20 zone default found 2019-11-28T21:59:17.251 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.263+0000 7f5308217ec0 20 started sync module instance, tier type = 2019-11-28T21:59:17.252 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.263+0000 7f5308217ec0 20 started zone id=bd5ae442-b074-4d35-94cc-b1d71bd6ac02 (name=default) with tier type = 2019-11-28T21:59:17.589 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.602+0000 7f5308217ec0 20 add_watcher() i=0 2019-11-28T21:59:17.589 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.602+0000 7f5308217ec0 20 add_watcher() i=1 2019-11-28T21:59:17.589 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.602+0000 7f5308217ec0 20 add_watcher() i=2 2019-11-28T21:59:17.590 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.602+0000 7f5308217ec0 20 add_watcher() i=3 2019-11-28T21:59:17.590 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.602+0000 7f5308217ec0 20 add_watcher() i=4 2019-11-28T21:59:17.590 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.602+0000 7f5308217ec0 20 add_watcher() i=5 2019-11-28T21:59:17.590 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.602+0000 7f5308217ec0 20 add_watcher() i=6 2019-11-28T21:59:17.621 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.635+0000 7f5308217ec0 20 add_watcher() i=7 2019-11-28T21:59:17.622 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.635+0000 7f5308217ec0 2 all 8 watchers are set, enabling cache 2019-11-28T21:59:17.622 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.635+0000 7f52c5fdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-28T21:59:17.632 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.645+0000 7f52f5444700 0 -- 172.21.15.74:0/3720588198 >> [v2:172.21.15.74:3301/0,v1:172.21.15.74:6790/0] conn(0x5642a9743b00 msgr2=0x5642a9749ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-28T21:59:17.664 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:17.678+0000 7f52f5c45700 0 -- 172.21.15.74:0/1226634393 >> [v2:172.21.15.74:6800/9122,v1:172.21.15.74:6801/9122] conn(0x7f5238017570 msgr2=0x7f5238019a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-28T21:59:18.810 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:18.822+0000 7f5237fff700 20 reqs_thread_entry: start 2019-11-28T21:59:18.810 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:18.823+0000 7f5235ffb700 20 reqs_thread_entry: start 2019-11-28T21:59:18.810 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:18.823+0000 7f5308217ec0 20 init_complete bucket index max shards: 0 2019-11-28T21:59:18.810 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:18.823+0000 7f5223fff700 20 reqs_thread_entry: start 2019-11-28T21:59:18.810 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:18.823+0000 7f5308217ec0 20 get_system_obj_state: rctx=0x7ffcf8c56998 obj=default.rgw.meta:users.uid:sysuser.client.0 state=0x5642a97c4f60 s->prefetch_data=0 2019-11-28T21:59:18.810 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:18.823+0000 7f5308217ec0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2019-11-28T21:59:18.827 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:18.840+0000 7f5308217ec0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x16 2019-11-28T21:59:18.827 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:18.840+0000 7f5308217ec0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-11-28T21:59:18.827 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:18.840+0000 7f5308217ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:18.828 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:18.840+0000 7f5308217ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T21:59:18.828 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:18.840+0000 7f5308217ec0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-28T21:59:18.828 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:18.840+0000 7f5308217ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:18.841 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:18.853+0000 7f5308217ec0 20 rados_obj.operate() r=0 bl.length=448 2019-11-28T21:59:18.841 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:18.853+0000 7f5308217ec0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x11 2019-11-28T21:59:18.841 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:18.853+0000 7f5308217ec0 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-11-28T21:59:18.846 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:18.860+0000 7f5308217ec0 10 removing key index: MKEIUIJQGGMTLVSCLEOA 2019-11-28T21:59:18.846 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:18.860+0000 7f5308217ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=170 2019-11-28T21:59:18.854 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:18.868+0000 7f52d67fc700 10 RGWWatcher::handle_notify() notify_id 579820584961 cookie 94844310727760 notifier 4659 bl.length()=170 2019-11-28T21:59:19.382 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:19.396+0000 7f5308217ec0 10 removing email index: sysuser.client.0+test@test.test 2019-11-28T21:59:19.382 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:19.396+0000 7f5308217ec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=182 2019-11-28T21:59:19.394 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:19.407+0000 7f52d67fc700 10 RGWWatcher::handle_notify() notify_id 579820584965 cookie 94844310734800 notifier 4659 bl.length()=182 2019-11-28T21:59:19.588 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:19.601+0000 7f5308217ec0 10 removing user buckets index 2019-11-28T21:59:19.588 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:19.601+0000 7f5308217ec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=173 2019-11-28T21:59:19.614 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:19.627+0000 7f52d67fc700 10 RGWWatcher::handle_notify() notify_id 579820584960 cookie 94844310735680 notifier 4659 bl.length()=173 2019-11-28T21:59:19.960 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:19.974+0000 7f5308217ec0 10 removing user index: sysuser.client.0 2019-11-28T21:59:19.961 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:19.974+0000 7f5308217ec0 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2019-11-28T21:59:19.961 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:19.974+0000 7f5308217ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=165 2019-11-28T21:59:19.976 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:19.990+0000 7f52d67fc700 10 RGWWatcher::handle_notify() notify_id 579820584966 cookie 94844310733264 notifier 4659 bl.length()=165 2019-11-28T21:59:20.215 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.228+0000 7f5308217ec0 20 remove_watcher() i=0 2019-11-28T21:59:20.215 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.228+0000 7f5308217ec0 2 removed watcher, disabling cache 2019-11-28T21:59:20.252 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.265+0000 7f5308217ec0 20 remove_watcher() i=1 2019-11-28T21:59:20.309 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.322+0000 7f5308217ec0 20 remove_watcher() i=2 2019-11-28T21:59:20.346 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.360+0000 7f5308217ec0 20 remove_watcher() i=3 2019-11-28T21:59:20.383 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.397+0000 7f5308217ec0 20 remove_watcher() i=4 2019-11-28T21:59:20.416 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.430+0000 7f5308217ec0 20 remove_watcher() i=5 2019-11-28T21:59:20.464 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.478+0000 7f5308217ec0 20 remove_watcher() i=6 2019-11-28T21:59:20.495 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.509+0000 7f5308217ec0 20 remove_watcher() i=7 2019-11-28T21:59:20.501 INFO:teuthology.orchestra.run.smithi074:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2019-11-28T21:59:20.610 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.624+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:20.638 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.651+0000 7ff56cd56ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:59:20.638 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.651+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:20.647 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.661+0000 7ff56cd56ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:59:20.647 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.661+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:20.656 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.669+0000 7ff56cd56ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:59:20.656 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.669+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:20.674 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.688+0000 7ff56cd56ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T21:59:20.876 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.890+0000 7ff56cd56ec0 20 RGWRados::pool_iterate: got zonegroup_info.cb1773b4-411c-4317-a760-df89ca0f54fc 2019-11-28T21:59:20.877 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.890+0000 7ff56cd56ec0 20 RGWRados::pool_iterate: got zone_info.bd5ae442-b074-4d35-94cc-b1d71bd6ac02 2019-11-28T21:59:20.877 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.890+0000 7ff56cd56ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-28T21:59:20.877 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.890+0000 7ff56cd56ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-28T21:59:20.877 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.890+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:20.892 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.906+0000 7ff56cd56ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T21:59:20.892 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.906+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:20.905 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.918+0000 7ff56cd56ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T21:59:20.905 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.918+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:20.915 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.928+0000 7ff56cd56ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T21:59:20.915 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.928+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:20.931 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.944+0000 7ff56cd56ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T21:59:20.931 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.944+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:20.941 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.955+0000 7ff56cd56ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:59:20.941 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.955+0000 7ff56cd56ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-28T21:59:20.941 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.955+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:20.950 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.964+0000 7ff56cd56ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:59:20.951 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.964+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:20.962 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.976+0000 7ff56cd56ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T21:59:20.963 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.976+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:20.976 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.989+0000 7ff56cd56ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T21:59:20.976 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.989+0000 7ff56cd56ec0 20 zonegroup default 2019-11-28T21:59:20.976 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.989+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:20.985 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.999+0000 7ff56cd56ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:59:20.985 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.999+0000 7ff56cd56ec0 10 Cannot find current period zone using local zone 2019-11-28T21:59:20.986 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:20.999+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:20.995 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:21.008+0000 7ff56cd56ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:59:20.995 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:21.008+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:21.004 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:21.018+0000 7ff56cd56ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T21:59:21.004 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:21.018+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:21.014 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:21.028+0000 7ff56cd56ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T21:59:21.015 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:21.028+0000 7ff56cd56ec0 20 zone default found 2019-11-28T21:59:21.015 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:21.028+0000 7ff56cd56ec0 20 started sync module instance, tier type = 2019-11-28T21:59:21.015 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:21.028+0000 7ff56cd56ec0 20 started zone id=bd5ae442-b074-4d35-94cc-b1d71bd6ac02 (name=default) with tier type = 2019-11-28T21:59:21.388 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:21.401+0000 7ff56cd56ec0 20 add_watcher() i=0 2019-11-28T21:59:21.388 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:21.401+0000 7ff56cd56ec0 20 add_watcher() i=1 2019-11-28T21:59:21.388 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:21.401+0000 7ff56cd56ec0 20 add_watcher() i=2 2019-11-28T21:59:21.388 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:21.401+0000 7ff56cd56ec0 20 add_watcher() i=3 2019-11-28T21:59:21.388 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:21.401+0000 7ff56cd56ec0 20 add_watcher() i=4 2019-11-28T21:59:21.389 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:21.401+0000 7ff56cd56ec0 20 add_watcher() i=5 2019-11-28T21:59:21.400 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:21.414+0000 7ff56cd56ec0 20 add_watcher() i=6 2019-11-28T21:59:21.419 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:21.432+0000 7ff56cd56ec0 20 add_watcher() i=7 2019-11-28T21:59:21.419 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:21.432+0000 7ff56cd56ec0 2 all 8 watchers are set, enabling cache 2019-11-28T21:59:21.419 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:21.432+0000 7ff52a7dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-28T21:59:21.422 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:21.435+0000 7ff559f83700 0 -- 172.21.15.74:0/1425984689 >> v1:172.21.15.141:6789/0 conn(0x5604aa518d00 legacy=0x5604aa51f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-28T21:59:21.460 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:21.474+0000 7ff559f83700 0 -- 172.21.15.74:0/1859331320 >> [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] conn(0x5604aa532100 msgr2=0x5604aa534520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-28T21:59:23.235 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.248+0000 7ff4a0ff9700 20 reqs_thread_entry: start 2019-11-28T21:59:23.235 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.248+0000 7ff49a7fc700 20 reqs_thread_entry: start 2019-11-28T21:59:23.235 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.249+0000 7ff56cd56ec0 20 init_complete bucket index max shards: 0 2019-11-28T21:59:23.236 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.249+0000 7ff498ff9700 20 reqs_thread_entry: start 2019-11-28T21:59:23.236 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.250+0000 7ff56cd56ec0 20 get_system_obj_state: rctx=0x7ffeb06e5cd8 obj=default.rgw.meta:users.uid:ragweed.client.0 state=0x5604aa59b6c0 s->prefetch_data=0 2019-11-28T21:59:23.236 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.250+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2019-11-28T21:59:23.247 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.260+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x16 2019-11-28T21:59:23.247 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.260+0000 7ff56cd56ec0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-11-28T21:59:23.247 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.260+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:23.247 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.260+0000 7ff56cd56ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T21:59:23.248 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.260+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-28T21:59:23.248 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.260+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:23.269 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.283+0000 7ff56cd56ec0 20 rados_obj.operate() r=0 bl.length=448 2019-11-28T21:59:23.269 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.283+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x11 2019-11-28T21:59:23.269 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.283+0000 7ff56cd56ec0 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-11-28T21:59:23.304 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.317+0000 7ff56cd56ec0 20 get_system_obj_state: rctx=0x7ffeb06e5aa0 obj=default.rgw.meta:root:test-client.0-conf state=0x5604aa59cfe0 s->prefetch_data=0 2019-11-28T21:59:23.304 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.317+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2019-11-28T21:59:23.313 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.327+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x6 2019-11-28T21:59:23.314 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.327+0000 7ff56cd56ec0 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2019-11-28T21:59:23.314 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.327+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:23.314 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.327+0000 7ff56cd56ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T21:59:23.314 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.327+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : type miss (requested=0x1, cached=0x6) 2019-11-28T21:59:23.314 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.327+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:23.328 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.342+0000 7ff56cd56ec0 20 rados_obj.operate() r=0 bl.length=200 2019-11-28T21:59:23.328 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.342+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x1 2019-11-28T21:59:23.328 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.342+0000 7ff56cd56ec0 10 moving default.rgw.meta+root+test-client.0-conf to cache LRU end 2019-11-28T21:59:23.329 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.342+0000 7ff56cd56ec0 20 get_system_obj_state: rctx=0x7ffeb06e5aa0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-conf:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.1 state=0x5604aa59f5b0 s->prefetch_data=0 2019-11-28T21:59:23.329 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.342+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.1 : miss 2019-11-28T21:59:23.342 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.355+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.1 info.flags=0x16 2019-11-28T21:59:23.342 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.355+0000 7ff56cd56ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.1 to cache LRU end 2019-11-28T21:59:23.342 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.355+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:23.342 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.355+0000 7ff56cd56ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-28T21:59:23.343 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.355+0000 7ff56cd56ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T21:59:23.343 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.355+0000 7ff56cd56ec0 20 Read xattr: user.rgw.acl 2019-11-28T21:59:23.343 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.355+0000 7ff56cd56ec0 20 Read xattr: user.rgw.idtag 2019-11-28T21:59:23.343 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.355+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.1 : type miss (requested=0x13, cached=0x16) 2019-11-28T21:59:23.343 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.355+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:23.361 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.375+0000 7ff56cd56ec0 20 rados_obj.operate() r=0 bl.length=292 2019-11-28T21:59:23.361 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.375+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.1 info.flags=0x13 2019-11-28T21:59:23.362 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.375+0000 7ff56cd56ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-conf:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.1 to cache LRU end 2019-11-28T21:59:23.362 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.375+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:23.362 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.375+0000 7ff56cd56ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-28T21:59:23.362 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.375+0000 7ff56cd56ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.1 2019-11-28T21:59:23.391 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.405+0000 7ff56cd56ec0 10 cls_bucket_list_unordered :test-client.0-conf[bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.1]) start [] num_entries 1100 2019-11-28T21:59:23.438 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.451+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete[] 2019-11-28T21:59:23.438 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.451+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete[] 2019-11-28T21:59:23.439 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.451+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning[] 2019-11-28T21:59:23.439 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.451+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_simple[] 2019-11-28T21:59:23.439 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.451+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class[] 2019-11-28T21:59:23.439 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.451+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy[] 2019-11-28T21:59:23.439 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.452+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart[] 2019-11-28T21:59:23.441 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.452+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy[] 2019-11-28T21:59:23.441 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.452+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_small_obj_data[] 2019-11-28T21:59:23.441 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.452+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x5604aa5a5a38 s->prefetch_data=0 2019-11-28T21:59:23.458 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.470+0000 7ff56cd56ec0 10 manifest: total_size = 9895 2019-11-28T21:59:23.458 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.470+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.13 2019-11-28T21:59:23.458 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.470+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x5604aa5a5a38 s->prefetch_data=0 2019-11-28T21:59:23.459 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.470+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5a5a38 2019-11-28T21:59:23.459 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.470+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.1 2019-11-28T21:59:23.727 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.741+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x5604aa5a5b98 s->prefetch_data=0 2019-11-28T21:59:23.743 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.757+0000 7ff56cd56ec0 10 manifest: total_size = 5848 2019-11-28T21:59:23.744 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.757+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.30 2019-11-28T21:59:23.744 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.757+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x5604aa5a5b98 s->prefetch_data=0 2019-11-28T21:59:23.744 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.757+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5a5b98 2019-11-28T21:59:23.744 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.757+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.1 2019-11-28T21:59:23.933 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.947+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x5604aa5a5b98 s->prefetch_data=0 2019-11-28T21:59:23.942 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.955+0000 7ff56cd56ec0 10 manifest: total_size = 3807 2019-11-28T21:59:23.942 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.955+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.56 2019-11-28T21:59:23.942 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.955+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x5604aa5a5b98 s->prefetch_data=0 2019-11-28T21:59:23.942 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.955+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5a5b98 2019-11-28T21:59:23.942 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:23.955+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.1 2019-11-28T21:59:24.125 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:24.139+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x5604aa5a5b98 s->prefetch_data=0 2019-11-28T21:59:24.141 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:24.154+0000 7ff56cd56ec0 10 manifest: total_size = 5809 2019-11-28T21:59:24.141 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:24.154+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.72 2019-11-28T21:59:24.141 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:24.154+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x5604aa5a5b98 s->prefetch_data=0 2019-11-28T21:59:24.141 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:24.154+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5a5b98 2019-11-28T21:59:24.141 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:24.154+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.1 2019-11-28T21:59:24.361 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:24.375+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x5604aa5a5b98 s->prefetch_data=0 2019-11-28T21:59:24.371 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:24.385+0000 7ff56cd56ec0 10 manifest: total_size = 5968 2019-11-28T21:59:24.371 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:24.385+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.87 2019-11-28T21:59:24.371 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:24.385+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x5604aa5a5b98 s->prefetch_data=0 2019-11-28T21:59:24.372 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:24.385+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5a5b98 2019-11-28T21:59:24.372 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:24.385+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.1 2019-11-28T21:59:24.498 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:24.511+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x5604aa5a5b98 s->prefetch_data=0 2019-11-28T21:59:24.507 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:24.520+0000 7ff56cd56ec0 10 manifest: total_size = 3949 2019-11-28T21:59:24.507 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:24.520+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.120 2019-11-28T21:59:24.507 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:24.520+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x5604aa5a5b98 s->prefetch_data=0 2019-11-28T21:59:24.507 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:24.521+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5a5b98 2019-11-28T21:59:24.507 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:24.521+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.1 2019-11-28T21:59:24.658 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:24.672+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x5604aa5a5b98 s->prefetch_data=0 2019-11-28T21:59:24.675 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:24.689+0000 7ff56cd56ec0 10 manifest: total_size = 4066 2019-11-28T21:59:24.676 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:24.689+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.189 2019-11-28T21:59:24.676 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:24.689+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x5604aa5a5b98 s->prefetch_data=0 2019-11-28T21:59:24.676 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:24.689+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5a5b98 2019-11-28T21:59:24.676 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:24.689+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.1 2019-11-28T21:59:24.826 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:24.840+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x5604aa5a5b98 s->prefetch_data=0 2019-11-28T21:59:24.835 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:24.849+0000 7ff56cd56ec0 10 manifest: total_size = 6093 2019-11-28T21:59:24.835 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:24.849+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.246 2019-11-28T21:59:24.836 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:24.849+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x5604aa5a5b98 s->prefetch_data=0 2019-11-28T21:59:24.836 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:24.849+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5a5b98 2019-11-28T21:59:24.836 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:24.849+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.1 2019-11-28T21:59:25.048 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:25.061+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x5604aa5a5b98 s->prefetch_data=0 2019-11-28T21:59:25.117 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:25.130+0000 7ff56cd56ec0 10 manifest: total_size = 6020 2019-11-28T21:59:25.117 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:25.130+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.322 2019-11-28T21:59:25.117 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:25.130+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x5604aa5a5b98 s->prefetch_data=0 2019-11-28T21:59:25.117 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:25.130+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5a5b98 2019-11-28T21:59:25.117 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:25.130+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.1 2019-11-28T21:59:25.310 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:25.324+0000 7ff56cd56ec0 10 cls_bucket_list_ordered :test-client.0-conf[bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.1]) start _multipart_[] num_entries 1001 2019-11-28T21:59:25.311 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:25.324+0000 7ff56cd56ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-28T21:59:25.407 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:25.421+0000 7ff56cd56ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.1])"; objs.size()=0; is_truncated=0 2019-11-28T21:59:25.490 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:25.503+0000 7ff56cd56ec0 20 get_system_obj_state: rctx=0x7ffeb06e5458 obj=default.rgw.meta:root:test-client.0-conf state=0x5604aa5a69f0 s->prefetch_data=0 2019-11-28T21:59:25.490 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:25.503+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : type miss (requested=0x16, cached=0x3) 2019-11-28T21:59:25.510 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:25.523+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x16 2019-11-28T21:59:25.510 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:25.523+0000 7ff56cd56ec0 10 moving default.rgw.meta+root+test-client.0-conf to cache LRU end 2019-11-28T21:59:25.510 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:25.523+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:25.510 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:25.523+0000 7ff56cd56ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T21:59:25.510 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:25.523+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : hit (requested=0x11, cached=0x17) 2019-11-28T21:59:25.510 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:25.523+0000 7ff56cd56ec0 10 removing default.rgw.meta+root+test-client.0-conf from cache 2019-11-28T21:59:25.511 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:25.523+0000 7ff56cd56ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=162 2019-11-28T21:59:25.521 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:25.535+0000 7ff53affd700 10 RGWWatcher::handle_notify() notify_id 579820584962 cookie 94578037260544 notifier 4451 bl.length()=162 2019-11-28T21:59:26.036 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.049+0000 7ff56cd56ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.1 from cache 2019-11-28T21:59:26.036 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.049+0000 7ff56cd56ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=219 2019-11-28T21:59:26.051 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.065+0000 7ff53affd700 10 RGWWatcher::handle_notify() notify_id 579820584961 cookie 94578037263808 notifier 4451 bl.length()=219 2019-11-28T21:59:26.437 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.450+0000 7ff56cd56ec0 20 get_system_obj_state: rctx=0x7ffeb06e5aa0 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1 state=0x5604aa59f170 s->prefetch_data=0 2019-11-28T21:59:26.437 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.450+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2019-11-28T21:59:26.445 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.458+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x6 2019-11-28T21:59:26.445 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.458+0000 7ff56cd56ec0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2019-11-28T21:59:26.445 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.458+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:26.445 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.458+0000 7ff56cd56ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T21:59:26.445 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.458+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : type miss (requested=0x1, cached=0x6) 2019-11-28T21:59:26.445 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.458+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:26.457 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.471+0000 7ff56cd56ec0 20 rados_obj.operate() r=0 bl.length=229 2019-11-28T21:59:26.457 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.471+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x1 2019-11-28T21:59:26.458 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.471+0000 7ff56cd56ec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2019-11-28T21:59:26.458 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.471+0000 7ff56cd56ec0 20 get_system_obj_state: rctx=0x7ffeb06e5aa0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.2 state=0x5604aa5a3ac0 s->prefetch_data=0 2019-11-28T21:59:26.458 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.471+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.2 : miss 2019-11-28T21:59:26.474 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.488+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.2 info.flags=0x16 2019-11-28T21:59:26.475 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.488+0000 7ff56cd56ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.2 to cache LRU end 2019-11-28T21:59:26.475 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.488+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:26.475 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.488+0000 7ff56cd56ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-28T21:59:26.475 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.488+0000 7ff56cd56ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T21:59:26.475 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.488+0000 7ff56cd56ec0 20 Read xattr: user.rgw.acl 2019-11-28T21:59:26.475 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.488+0000 7ff56cd56ec0 20 Read xattr: user.rgw.idtag 2019-11-28T21:59:26.475 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.488+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.2 : type miss (requested=0x13, cached=0x16) 2019-11-28T21:59:26.476 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.488+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:26.493 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.507+0000 7ff56cd56ec0 20 rados_obj.operate() r=0 bl.length=321 2019-11-28T21:59:26.494 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.507+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.2 info.flags=0x13 2019-11-28T21:59:26.494 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.507+0000 7ff56cd56ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.2 to cache LRU end 2019-11-28T21:59:26.494 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.507+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:26.494 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.507+0000 7ff56cd56ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-28T21:59:26.495 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.507+0000 7ff56cd56ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.2 2019-11-28T21:59:26.511 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.525+0000 7ff56cd56ec0 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-defer-complete.1[bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.2]) start [] num_entries 1100 2019-11-28T21:59:26.531 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.544+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got foo[] 2019-11-28T21:59:26.531 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.544+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x5604aa5a5a38 s->prefetch_data=0 2019-11-28T21:59:26.549 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.563+0000 7ff56cd56ec0 10 manifest: total_size = 1848 2019-11-28T21:59:26.549 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.563+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.20 2019-11-28T21:59:26.550 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.563+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x5604aa5a5a38 s->prefetch_data=0 2019-11-28T21:59:26.550 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.563+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5a5a38 2019-11-28T21:59:26.550 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.563+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.2 2019-11-28T21:59:26.725 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.738+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-11-28T21:59:26.725 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.738+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=515 2019-11-28T21:59:26.725 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.738+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=515 stripe_ofs=515 part_ofs=515 rule->part_size=515 2019-11-28T21:59:26.725 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.738+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-11-28T21:59:26.725 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.738+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194819 part_ofs=515 rule->part_size=515 2019-11-28T21:59:26.725 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.738+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=1030 stripe_ofs=1030 part_ofs=1030 rule->part_size=515 2019-11-28T21:59:26.726 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.738+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-11-28T21:59:26.726 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.738+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=4195334 part_ofs=1030 rule->part_size=515 2019-11-28T21:59:26.726 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.738+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=1545 stripe_ofs=1545 part_ofs=1545 rule->part_size=303 2019-11-28T21:59:26.726 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.738+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=303 rules.size()=2 2019-11-28T21:59:26.726 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.738+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=4195849 part_ofs=1545 rule->part_size=303 2019-11-28T21:59:26.726 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.738+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=1848 stripe_ofs=1848 part_ofs=1848 rule->part_size=303 2019-11-28T21:59:26.726 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.738+0000 7ff56cd56ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.20 2019-11-28T21:59:26.834 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.847+0000 7ff56cd56ec0 10 cls_bucket_list_ordered :test-client.0-r-test-multipart-defer-complete.1[bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.2]) start _multipart_[] num_entries 1001 2019-11-28T21:59:26.834 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.847+0000 7ff56cd56ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-28T21:59:26.850 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.864+0000 7ff56cd56ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.2])"; objs.size()=0; is_truncated=0 2019-11-28T21:59:26.921 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.935+0000 7ff56cd56ec0 20 get_system_obj_state: rctx=0x7ffeb06e5458 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1 state=0x5604aa59f170 s->prefetch_data=0 2019-11-28T21:59:26.921 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.935+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : type miss (requested=0x16, cached=0x3) 2019-11-28T21:59:26.933 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.946+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x16 2019-11-28T21:59:26.933 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.946+0000 7ff56cd56ec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2019-11-28T21:59:26.933 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.946+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:26.933 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.946+0000 7ff56cd56ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T21:59:26.933 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.946+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : hit (requested=0x11, cached=0x17) 2019-11-28T21:59:26.933 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.946+0000 7ff56cd56ec0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2019-11-28T21:59:26.933 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.946+0000 7ff56cd56ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=191 2019-11-28T21:59:26.945 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:26.959+0000 7ff53affd700 10 RGWWatcher::handle_notify() notify_id 579820584962 cookie 94578037263808 notifier 4451 bl.length()=191 2019-11-28T21:59:27.631 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:27.645+0000 7ff56cd56ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.2 from cache 2019-11-28T21:59:27.632 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:27.645+0000 7ff56cd56ec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=248 2019-11-28T21:59:27.650 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:27.664+0000 7ff53affd700 10 RGWWatcher::handle_notify() notify_id 579820584967 cookie 94578037270816 notifier 4451 bl.length()=248 2019-11-28T21:59:28.125 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.139+0000 7ff56cd56ec0 20 get_system_obj_state: rctx=0x7ffeb06e5aa0 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1 state=0x5604aa59f170 s->prefetch_data=0 2019-11-28T21:59:28.125 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.139+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2019-11-28T21:59:28.142 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.155+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x6 2019-11-28T21:59:28.142 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.155+0000 7ff56cd56ec0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2019-11-28T21:59:28.142 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.155+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:28.142 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.155+0000 7ff56cd56ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T21:59:28.142 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.155+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : type miss (requested=0x1, cached=0x6) 2019-11-28T21:59:28.142 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.155+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:28.159 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.173+0000 7ff56cd56ec0 20 rados_obj.operate() r=0 bl.length=236 2019-11-28T21:59:28.160 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.173+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x1 2019-11-28T21:59:28.160 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.173+0000 7ff56cd56ec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2019-11-28T21:59:28.160 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.173+0000 7ff56cd56ec0 20 get_system_obj_state: rctx=0x7ffeb06e5aa0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.3 state=0x5604aa5a3ac0 s->prefetch_data=0 2019-11-28T21:59:28.160 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.173+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.3 : miss 2019-11-28T21:59:28.173 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.187+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.3 info.flags=0x16 2019-11-28T21:59:28.173 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.187+0000 7ff56cd56ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.3 to cache LRU end 2019-11-28T21:59:28.173 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.187+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:28.173 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.187+0000 7ff56cd56ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-28T21:59:28.174 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.187+0000 7ff56cd56ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T21:59:28.174 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.187+0000 7ff56cd56ec0 20 Read xattr: user.rgw.acl 2019-11-28T21:59:28.174 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.187+0000 7ff56cd56ec0 20 Read xattr: user.rgw.idtag 2019-11-28T21:59:28.174 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.187+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.3 : type miss (requested=0x13, cached=0x16) 2019-11-28T21:59:28.174 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.187+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:28.189 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.203+0000 7ff56cd56ec0 20 rados_obj.operate() r=0 bl.length=328 2019-11-28T21:59:28.189 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.203+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.3 info.flags=0x13 2019-11-28T21:59:28.190 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.203+0000 7ff56cd56ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.3 to cache LRU end 2019-11-28T21:59:28.190 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.203+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:28.190 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.203+0000 7ff56cd56ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-28T21:59:28.190 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.203+0000 7ff56cd56ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.3 2019-11-28T21:59:28.206 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.220+0000 7ff56cd56ec0 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-defer-update-complete.1[bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.3]) start [] num_entries 1100 2019-11-28T21:59:28.224 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.237+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got foo[] 2019-11-28T21:59:28.224 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.237+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x5604aa5a5a38 s->prefetch_data=0 2019-11-28T21:59:28.240 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.254+0000 7ff56cd56ec0 10 manifest: total_size = 1848 2019-11-28T21:59:28.241 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.254+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.40 2019-11-28T21:59:28.241 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.254+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x5604aa5a5a38 s->prefetch_data=0 2019-11-28T21:59:28.241 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.254+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5a5a38 2019-11-28T21:59:28.241 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.254+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.3 2019-11-28T21:59:28.387 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.401+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-11-28T21:59:28.388 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.401+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=515 2019-11-28T21:59:28.388 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.401+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=515 stripe_ofs=515 part_ofs=515 rule->part_size=515 2019-11-28T21:59:28.388 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.401+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-11-28T21:59:28.388 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.401+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194819 part_ofs=515 rule->part_size=515 2019-11-28T21:59:28.388 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.401+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=1030 stripe_ofs=1030 part_ofs=1030 rule->part_size=515 2019-11-28T21:59:28.388 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.401+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-11-28T21:59:28.389 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.401+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=4195334 part_ofs=1030 rule->part_size=515 2019-11-28T21:59:28.389 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.401+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=1545 stripe_ofs=1545 part_ofs=1545 rule->part_size=303 2019-11-28T21:59:28.389 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.401+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=303 rules.size()=2 2019-11-28T21:59:28.389 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.401+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=4195849 part_ofs=1545 rule->part_size=303 2019-11-28T21:59:28.389 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.401+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=1848 stripe_ofs=1848 part_ofs=1848 rule->part_size=303 2019-11-28T21:59:28.389 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.401+0000 7ff56cd56ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.40 2019-11-28T21:59:28.520 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.534+0000 7ff56cd56ec0 10 cls_bucket_list_ordered :test-client.0-r-test-multipart-defer-update-complete.1[bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.3]) start _multipart_[] num_entries 1001 2019-11-28T21:59:28.521 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.534+0000 7ff56cd56ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-28T21:59:28.533 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.547+0000 7ff56cd56ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.3])"; objs.size()=0; is_truncated=0 2019-11-28T21:59:28.608 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.622+0000 7ff56cd56ec0 20 get_system_obj_state: rctx=0x7ffeb06e5458 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1 state=0x5604aa59f170 s->prefetch_data=0 2019-11-28T21:59:28.608 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.622+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : type miss (requested=0x16, cached=0x3) 2019-11-28T21:59:28.629 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.642+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x16 2019-11-28T21:59:28.629 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.642+0000 7ff56cd56ec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2019-11-28T21:59:28.629 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.642+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:28.629 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.642+0000 7ff56cd56ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T21:59:28.629 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.642+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : hit (requested=0x11, cached=0x17) 2019-11-28T21:59:28.629 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.642+0000 7ff56cd56ec0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2019-11-28T21:59:28.629 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.642+0000 7ff56cd56ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=198 2019-11-28T21:59:28.645 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:28.659+0000 7ff53affd700 10 RGWWatcher::handle_notify() notify_id 579820584968 cookie 94578037267328 notifier 4451 bl.length()=198 2019-11-28T21:59:29.004 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.018+0000 7ff56cd56ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.3 from cache 2019-11-28T21:59:29.005 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.018+0000 7ff56cd56ec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=255 2019-11-28T21:59:29.021 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.035+0000 7ff53affd700 10 RGWWatcher::handle_notify() notify_id 579820584961 cookie 94578037269008 notifier 4451 bl.length()=255 2019-11-28T21:59:29.406 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.420+0000 7ff56cd56ec0 20 get_system_obj_state: rctx=0x7ffeb06e5aa0 obj=default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1 state=0x5604aa59f170 s->prefetch_data=0 2019-11-28T21:59:29.407 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.420+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2019-11-28T21:59:29.414 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.428+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x6 2019-11-28T21:59:29.414 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.428+0000 7ff56cd56ec0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2019-11-28T21:59:29.414 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.428+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:29.414 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.428+0000 7ff56cd56ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T21:59:29.414 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.428+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : type miss (requested=0x1, cached=0x6) 2019-11-28T21:59:29.415 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.428+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:29.422 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.436+0000 7ff56cd56ec0 20 rados_obj.operate() r=0 bl.length=231 2019-11-28T21:59:29.422 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.436+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x1 2019-11-28T21:59:29.422 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.436+0000 7ff56cd56ec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2019-11-28T21:59:29.422 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.436+0000 7ff56cd56ec0 20 get_system_obj_state: rctx=0x7ffeb06e5aa0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.4 state=0x5604aa5a3ac0 s->prefetch_data=0 2019-11-28T21:59:29.423 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.436+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.4 : miss 2019-11-28T21:59:29.431 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.444+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.4 info.flags=0x16 2019-11-28T21:59:29.431 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.444+0000 7ff56cd56ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.4 to cache LRU end 2019-11-28T21:59:29.431 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.444+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:29.431 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.444+0000 7ff56cd56ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-28T21:59:29.431 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.444+0000 7ff56cd56ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T21:59:29.432 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.444+0000 7ff56cd56ec0 20 Read xattr: user.rgw.acl 2019-11-28T21:59:29.432 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.444+0000 7ff56cd56ec0 20 Read xattr: user.rgw.idtag 2019-11-28T21:59:29.432 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.444+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.4 : type miss (requested=0x13, cached=0x16) 2019-11-28T21:59:29.432 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.444+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:29.442 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.456+0000 7ff56cd56ec0 20 rados_obj.operate() r=0 bl.length=323 2019-11-28T21:59:29.443 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.456+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.4 info.flags=0x13 2019-11-28T21:59:29.443 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.456+0000 7ff56cd56ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.4 to cache LRU end 2019-11-28T21:59:29.443 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.456+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:29.443 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.456+0000 7ff56cd56ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-28T21:59:29.443 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.456+0000 7ff56cd56ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.4 2019-11-28T21:59:29.485 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.498+0000 7ff56cd56ec0 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-index-versioning.1[bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.4]) start [] num_entries 1100 2019-11-28T21:59:29.523 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.537+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got foo[3jVfoMnMmUcR6psoEMmuP1y.YVH-Q6M] 2019-11-28T21:59:29.524 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.537+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.4 2019-11-28T21:59:29.544 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.558+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x5604aa5a6d78 s->prefetch_data=0 2019-11-28T21:59:29.556 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.570+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to mvatrdmb1ill5lx6he4ovbnae2diox2i 2019-11-28T21:59:29.556 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.570+0000 7ff56cd56ec0 20 get_obj_state_impl: setting s->olh_tag to xj1v158zw02v0gy9lyv59pl6fwkyh310 2019-11-28T21:59:29.556 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.570+0000 7ff56cd56ec0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=xj1v158zw02v0gy9lyv59pl6fwkyh310 2019-11-28T21:59:29.662 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.676+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.4 2019-11-28T21:59:29.762 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.775+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.4 2019-11-28T21:59:29.762 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.776+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.4 2019-11-28T21:59:29.783 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.796+0000 7ff56cd56ec0 20 olh_log_entry: epoch=3 op=2 key=[] 2019-11-28T21:59:29.783 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.796+0000 7ff56cd56ec0 20 olh_log_entry: epoch=3 op=3 key=foo[3jVfoMnMmUcR6psoEMmuP1y.YVH-Q6M] 2019-11-28T21:59:29.783 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.796+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-multipart-index-versioning.1:_:3jVfoMnMmUcR6psoEMmuP1y.YVH-Q6M_foo state=0x5604aa5ab428 s->prefetch_data=0 2019-11-28T21:59:29.795 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.808+0000 7ff56cd56ec0 10 manifest: total_size = 1848 2019-11-28T21:59:29.795 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.808+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.55 2019-11-28T21:59:29.795 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.808+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-multipart-index-versioning.1:_:3jVfoMnMmUcR6psoEMmuP1y.YVH-Q6M_foo state=0x5604aa5ab428 s->prefetch_data=0 2019-11-28T21:59:29.795 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.808+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5ab428 2019-11-28T21:59:29.795 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.808+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.4 2019-11-28T21:59:29.966 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.980+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-11-28T21:59:29.967 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.980+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=515 2019-11-28T21:59:29.967 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.980+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=515 stripe_ofs=515 part_ofs=515 rule->part_size=515 2019-11-28T21:59:29.967 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.980+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-11-28T21:59:29.967 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.980+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194819 part_ofs=515 rule->part_size=515 2019-11-28T21:59:29.967 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.980+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=1030 stripe_ofs=1030 part_ofs=1030 rule->part_size=515 2019-11-28T21:59:29.967 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.980+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-11-28T21:59:29.968 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.980+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=4195334 part_ofs=1030 rule->part_size=515 2019-11-28T21:59:29.968 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.980+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=1545 stripe_ofs=1545 part_ofs=1545 rule->part_size=303 2019-11-28T21:59:29.968 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.980+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=303 rules.size()=2 2019-11-28T21:59:29.968 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.980+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=4195849 part_ofs=1545 rule->part_size=303 2019-11-28T21:59:29.968 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.980+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=1848 stripe_ofs=1848 part_ofs=1848 rule->part_size=303 2019-11-28T21:59:29.968 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:29.980+0000 7ff56cd56ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.55 2019-11-28T21:59:30.134 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:30.148+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.4 2019-11-28T21:59:30.134 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:30.148+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.4 2019-11-28T21:59:30.247 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:30.261+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.4 2019-11-28T21:59:30.305 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:30.319+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.4 2019-11-28T21:59:30.305 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:30.319+0000 7ff56cd56ec0 10 cls_bucket_list_ordered :test-client.0-r-test-multipart-index-versioning.1[bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.4]) start _multipart_[] num_entries 1001 2019-11-28T21:59:30.305 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:30.319+0000 7ff56cd56ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-28T21:59:30.329 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:30.343+0000 7ff56cd56ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.4])"; objs.size()=0; is_truncated=0 2019-11-28T21:59:30.395 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:30.409+0000 7ff56cd56ec0 20 get_system_obj_state: rctx=0x7ffeb06e5458 obj=default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1 state=0x5604aa59f170 s->prefetch_data=0 2019-11-28T21:59:30.395 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:30.409+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : type miss (requested=0x16, cached=0x3) 2019-11-28T21:59:30.407 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:30.421+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x16 2019-11-28T21:59:30.407 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:30.421+0000 7ff56cd56ec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2019-11-28T21:59:30.407 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:30.421+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:30.407 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:30.421+0000 7ff56cd56ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T21:59:30.408 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:30.421+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : hit (requested=0x11, cached=0x17) 2019-11-28T21:59:30.408 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:30.421+0000 7ff56cd56ec0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2019-11-28T21:59:30.408 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:30.421+0000 7ff56cd56ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=193 2019-11-28T21:59:30.414 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:30.428+0000 7ff53affd700 10 RGWWatcher::handle_notify() notify_id 579820584969 cookie 94578037267328 notifier 4451 bl.length()=193 2019-11-28T21:59:30.523 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:30.536+0000 7ff56cd56ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.4 from cache 2019-11-28T21:59:30.524 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:30.536+0000 7ff56cd56ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=250 2019-11-28T21:59:30.530 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:30.544+0000 7ff53affd700 10 RGWWatcher::handle_notify() notify_id 579820584963 cookie 94578037269648 notifier 4451 bl.length()=250 2019-11-28T21:59:31.186 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.200+0000 7ff56cd56ec0 20 get_system_obj_state: rctx=0x7ffeb06e5aa0 obj=default.rgw.meta:root:test-client.0-r-test-multipart-simple.1 state=0x5604aa5a3ac0 s->prefetch_data=0 2019-11-28T21:59:31.187 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.200+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2019-11-28T21:59:31.196 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.210+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x6 2019-11-28T21:59:31.196 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.210+0000 7ff56cd56ec0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2019-11-28T21:59:31.196 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.210+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:31.197 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.210+0000 7ff56cd56ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T21:59:31.197 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.210+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : type miss (requested=0x1, cached=0x6) 2019-11-28T21:59:31.197 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.210+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:31.205 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.219+0000 7ff56cd56ec0 20 rados_obj.operate() r=0 bl.length=221 2019-11-28T21:59:31.205 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.219+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x1 2019-11-28T21:59:31.205 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.219+0000 7ff56cd56ec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2019-11-28T21:59:31.206 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.219+0000 7ff56cd56ec0 20 get_system_obj_state: rctx=0x7ffeb06e5aa0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.5 state=0x5604aa59f170 s->prefetch_data=0 2019-11-28T21:59:31.206 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.219+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.5 : miss 2019-11-28T21:59:31.221 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.234+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.5 info.flags=0x16 2019-11-28T21:59:31.221 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.234+0000 7ff56cd56ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.5 to cache LRU end 2019-11-28T21:59:31.221 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.234+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:31.221 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.234+0000 7ff56cd56ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-28T21:59:31.221 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.234+0000 7ff56cd56ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T21:59:31.221 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.234+0000 7ff56cd56ec0 20 Read xattr: user.rgw.acl 2019-11-28T21:59:31.221 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.234+0000 7ff56cd56ec0 20 Read xattr: user.rgw.idtag 2019-11-28T21:59:31.222 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.234+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.5 : type miss (requested=0x13, cached=0x16) 2019-11-28T21:59:31.222 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.234+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:31.242 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.256+0000 7ff56cd56ec0 20 rados_obj.operate() r=0 bl.length=313 2019-11-28T21:59:31.242 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.256+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.5 info.flags=0x13 2019-11-28T21:59:31.242 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.256+0000 7ff56cd56ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.5 to cache LRU end 2019-11-28T21:59:31.243 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.256+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:31.243 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.256+0000 7ff56cd56ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-28T21:59:31.243 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.256+0000 7ff56cd56ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.5 2019-11-28T21:59:31.254 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.268+0000 7ff56cd56ec0 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-simple.1[bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.5]) start [] num_entries 1100 2019-11-28T21:59:31.273 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.286+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got foo[] 2019-11-28T21:59:31.273 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.286+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x5604aa5a6d78 s->prefetch_data=0 2019-11-28T21:59:31.301 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.314+0000 7ff56cd56ec0 10 manifest: total_size = 74198 2019-11-28T21:59:31.301 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.314+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.71 2019-11-28T21:59:31.301 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.314+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x5604aa5a6d78 s->prefetch_data=0 2019-11-28T21:59:31.301 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.314+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5a6d78 2019-11-28T21:59:31.301 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.314+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.5 2019-11-28T21:59:31.411 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.424+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2019-11-28T21:59:31.411 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.424+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2019-11-28T21:59:31.411 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.424+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2019-11-28T21:59:31.411 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.424+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2019-11-28T21:59:31.412 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.424+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2019-11-28T21:59:31.412 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.424+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2019-11-28T21:59:31.412 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.424+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2019-11-28T21:59:31.412 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.424+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=20613 2019-11-28T21:59:31.412 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.424+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2019-11-28T21:59:31.412 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.424+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2019-11-28T21:59:31.412 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.424+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=4256143 part_ofs=61839 rule->part_size=12359 2019-11-28T21:59:31.413 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.424+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2019-11-28T21:59:31.413 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.425+0000 7ff56cd56ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.71 2019-11-28T21:59:31.471 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.485+0000 7ff56cd56ec0 10 cls_bucket_list_ordered :test-client.0-r-test-multipart-simple.1[bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.5]) start _multipart_[] num_entries 1001 2019-11-28T21:59:31.471 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.485+0000 7ff56cd56ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-28T21:59:31.483 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.497+0000 7ff56cd56ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.5])"; objs.size()=0; is_truncated=0 2019-11-28T21:59:31.534 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.547+0000 7ff56cd56ec0 20 get_system_obj_state: rctx=0x7ffeb06e5458 obj=default.rgw.meta:root:test-client.0-r-test-multipart-simple.1 state=0x5604aa5a5d50 s->prefetch_data=0 2019-11-28T21:59:31.534 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.547+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : type miss (requested=0x16, cached=0x3) 2019-11-28T21:59:31.542 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.555+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x16 2019-11-28T21:59:31.542 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.555+0000 7ff56cd56ec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2019-11-28T21:59:31.542 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.555+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:31.542 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.555+0000 7ff56cd56ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T21:59:31.542 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.555+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : hit (requested=0x11, cached=0x17) 2019-11-28T21:59:31.543 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.555+0000 7ff56cd56ec0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2019-11-28T21:59:31.543 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.555+0000 7ff56cd56ec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=183 2019-11-28T21:59:31.556 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.569+0000 7ff53affd700 10 RGWWatcher::handle_notify() notify_id 579820584970 cookie 94578037270816 notifier 4451 bl.length()=183 2019-11-28T21:59:31.747 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.761+0000 7ff56cd56ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.5 from cache 2019-11-28T21:59:31.748 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.761+0000 7ff56cd56ec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=240 2019-11-28T21:59:31.759 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:31.772+0000 7ff53affd700 10 RGWWatcher::handle_notify() notify_id 579820584963 cookie 94578037273552 notifier 4451 bl.length()=240 2019-11-28T21:59:32.108 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.122+0000 7ff56cd56ec0 20 get_system_obj_state: rctx=0x7ffeb06e5aa0 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1 state=0x5604aa5a3ac0 s->prefetch_data=0 2019-11-28T21:59:32.108 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.122+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2019-11-28T21:59:32.134 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.147+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x6 2019-11-28T21:59:32.134 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.147+0000 7ff56cd56ec0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2019-11-28T21:59:32.134 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.147+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:32.134 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.147+0000 7ff56cd56ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T21:59:32.134 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.147+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x1, cached=0x6) 2019-11-28T21:59:32.134 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.147+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:32.146 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.160+0000 7ff56cd56ec0 20 rados_obj.operate() r=0 bl.length=227 2019-11-28T21:59:32.147 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.160+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x1 2019-11-28T21:59:32.147 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.160+0000 7ff56cd56ec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2019-11-28T21:59:32.147 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.160+0000 7ff56cd56ec0 20 get_system_obj_state: rctx=0x7ffeb06e5aa0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.7 state=0x5604aa5a5d50 s->prefetch_data=0 2019-11-28T21:59:32.147 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.160+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.7 : miss 2019-11-28T21:59:32.161 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.175+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.7 info.flags=0x16 2019-11-28T21:59:32.161 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.175+0000 7ff56cd56ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.7 to cache LRU end 2019-11-28T21:59:32.161 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.175+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:32.162 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.175+0000 7ff56cd56ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-28T21:59:32.162 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.175+0000 7ff56cd56ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T21:59:32.162 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.175+0000 7ff56cd56ec0 20 Read xattr: user.rgw.acl 2019-11-28T21:59:32.162 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.175+0000 7ff56cd56ec0 20 Read xattr: user.rgw.idtag 2019-11-28T21:59:32.162 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.175+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.7 : type miss (requested=0x13, cached=0x16) 2019-11-28T21:59:32.162 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.175+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:32.178 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.192+0000 7ff56cd56ec0 20 rados_obj.operate() r=0 bl.length=319 2019-11-28T21:59:32.178 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.192+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.7 info.flags=0x13 2019-11-28T21:59:32.178 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.192+0000 7ff56cd56ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.7 to cache LRU end 2019-11-28T21:59:32.178 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.192+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:32.178 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.192+0000 7ff56cd56ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-28T21:59:32.179 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.192+0000 7ff56cd56ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.7 2019-11-28T21:59:32.195 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.209+0000 7ff56cd56ec0 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-copy.1[bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.7]) start [] num_entries 1100 2019-11-28T21:59:32.231 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.244+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2019-11-28T21:59:32.231 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.244+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-FROZEN[] 2019-11-28T21:59:32.231 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.244+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM[] 2019-11-28T21:59:32.231 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.244+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-STANDARD[] 2019-11-28T21:59:32.231 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.244+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2019-11-28T21:59:32.231 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.244+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN[] 2019-11-28T21:59:32.232 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.244+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM[] 2019-11-28T21:59:32.232 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.244+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD[] 2019-11-28T21:59:32.232 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.244+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2019-11-28T21:59:32.232 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.244+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-FROZEN[] 2019-11-28T21:59:32.232 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.244+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM[] 2019-11-28T21:59:32.232 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.244+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-STANDARD[] 2019-11-28T21:59:32.232 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.244+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x5604aa5a3398 s->prefetch_data=0 2019-11-28T21:59:32.247 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.261+0000 7ff56cd56ec0 10 manifest: total_size = 5242880 2019-11-28T21:59:32.247 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.261+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.108 2019-11-28T21:59:32.248 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.261+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x5604aa5a3398 s->prefetch_data=0 2019-11-28T21:59:32.248 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.261+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5a3398 2019-11-28T21:59:32.250 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.261+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.7 2019-11-28T21:59:32.410 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.424+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-28T21:59:32.410 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.424+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-28T21:59:32.410 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.424+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-28T21:59:32.411 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.424+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-28T21:59:32.411 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.424+0000 7ff56cd56ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.108 2019-11-28T21:59:32.479 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.492+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x5604aa5a3398 s->prefetch_data=0 2019-11-28T21:59:32.495 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.508+0000 7ff56cd56ec0 10 manifest: total_size = 5242880 2019-11-28T21:59:32.495 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.508+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.109 2019-11-28T21:59:32.495 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.508+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x5604aa5a3398 s->prefetch_data=0 2019-11-28T21:59:32.495 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.508+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5a3398 2019-11-28T21:59:32.496 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.508+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.7 2019-11-28T21:59:32.616 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.629+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-28T21:59:32.616 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.629+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-28T21:59:32.616 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.629+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-28T21:59:32.616 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.629+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-28T21:59:32.616 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.629+0000 7ff56cd56ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.109 2019-11-28T21:59:32.677 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.690+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x5604aa5a3398 s->prefetch_data=0 2019-11-28T21:59:32.689 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.703+0000 7ff56cd56ec0 10 manifest: total_size = 5242880 2019-11-28T21:59:32.689 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.703+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to _Sq95DGM3Xh-BnsDYGemWdwUn7q3rkMD 2019-11-28T21:59:32.689 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.703+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x5604aa5a3398 s->prefetch_data=0 2019-11-28T21:59:32.690 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.703+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5a3398 2019-11-28T21:59:32.690 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.703+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.7 2019-11-28T21:59:32.787 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.801+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-28T21:59:32.788 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.801+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-28T21:59:32.788 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.801+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-28T21:59:32.788 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.801+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-28T21:59:32.788 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.801+0000 7ff56cd56ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: _Sq95DGM3Xh-BnsDYGemWdwUn7q3rkMD 2019-11-28T21:59:32.840 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.853+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:32.848 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.862+0000 7ff56cd56ec0 10 manifest: total_size = 5242880 2019-11-28T21:59:32.848 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.862+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to _zxRKISFc_tl2St0MRpkZtGgpm_hIm6I 2019-11-28T21:59:32.848 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.862+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:32.849 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.862+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5b5b48 2019-11-28T21:59:32.849 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.862+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.7 2019-11-28T21:59:32.968 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.981+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-28T21:59:32.968 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.981+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-28T21:59:32.968 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:32.981+0000 7ff56cd56ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: _zxRKISFc_tl2St0MRpkZtGgpm_hIm6I 2019-11-28T21:59:33.085 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.098+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:33.095 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.109+0000 7ff56cd56ec0 10 manifest: total_size = 5242880 2019-11-28T21:59:33.096 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.109+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.112 2019-11-28T21:59:33.096 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.109+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:33.096 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.109+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5b5b48 2019-11-28T21:59:33.096 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.109+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.7 2019-11-28T21:59:33.192 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.206+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-28T21:59:33.192 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.206+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-28T21:59:33.192 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.206+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-28T21:59:33.193 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.206+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-28T21:59:33.193 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.206+0000 7ff56cd56ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.112 2019-11-28T21:59:33.243 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.257+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:33.255 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.269+0000 7ff56cd56ec0 10 manifest: total_size = 5242880 2019-11-28T21:59:33.255 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.269+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to _0hqE0yKCoCL1IAmEhY26pFjfo1dDRds 2019-11-28T21:59:33.256 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.269+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:33.256 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.269+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5b5b48 2019-11-28T21:59:33.256 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.269+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.7 2019-11-28T21:59:33.368 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.382+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-28T21:59:33.369 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.382+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-28T21:59:33.369 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.382+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-28T21:59:33.369 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.382+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-28T21:59:33.369 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.382+0000 7ff56cd56ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: _0hqE0yKCoCL1IAmEhY26pFjfo1dDRds 2019-11-28T21:59:33.452 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.465+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:33.466 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.480+0000 7ff56cd56ec0 10 manifest: total_size = 5242880 2019-11-28T21:59:33.467 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.480+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.114 2019-11-28T21:59:33.467 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.480+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:33.467 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.480+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5b5b48 2019-11-28T21:59:33.467 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.480+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.7 2019-11-28T21:59:33.591 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.605+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-28T21:59:33.592 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.605+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-28T21:59:33.592 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.605+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-28T21:59:33.592 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.605+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-28T21:59:33.592 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.605+0000 7ff56cd56ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.114 2019-11-28T21:59:33.665 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.678+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:33.673 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.687+0000 7ff56cd56ec0 10 manifest: total_size = 5242880 2019-11-28T21:59:33.673 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.687+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to _yrnaNfVBAs60y7CHO7x31b1HHge4f3N 2019-11-28T21:59:33.674 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.687+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:33.674 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.687+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5b5b48 2019-11-28T21:59:33.674 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.687+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.7 2019-11-28T21:59:33.822 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.836+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-28T21:59:33.822 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.836+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-28T21:59:33.823 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.836+0000 7ff56cd56ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: _yrnaNfVBAs60y7CHO7x31b1HHge4f3N 2019-11-28T21:59:33.948 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.959+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:33.953 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.967+0000 7ff56cd56ec0 10 manifest: total_size = 2037 2019-11-28T21:59:33.953 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.967+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.116 2019-11-28T21:59:33.954 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.967+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:33.954 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.967+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5b5b48 2019-11-28T21:59:33.954 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:33.967+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.7 2019-11-28T21:59:34.099 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:34.112+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:34.121 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:34.135+0000 7ff56cd56ec0 10 manifest: total_size = 2037 2019-11-28T21:59:34.121 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:34.135+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to _0Fs3jJY9vi0z3omNxbzogEaTAGp59oa 2019-11-28T21:59:34.121 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:34.135+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:34.122 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:34.135+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5b5b48 2019-11-28T21:59:34.122 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:34.135+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.7 2019-11-28T21:59:34.373 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:34.387+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-28T21:59:34.374 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:34.387+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=2037 stripe_ofs=2037 part_ofs=0 rule->part_size=0 2019-11-28T21:59:34.374 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:34.387+0000 7ff56cd56ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: _0Fs3jJY9vi0z3omNxbzogEaTAGp59oa 2019-11-28T21:59:34.445 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:34.459+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:34.457 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:34.470+0000 7ff56cd56ec0 10 manifest: total_size = 2037 2019-11-28T21:59:34.457 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:34.470+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to _NQHrbkXtrZC5mQP_UIfCJXTh-hjsKho 2019-11-28T21:59:34.457 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:34.470+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:34.457 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:34.470+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5b5b48 2019-11-28T21:59:34.457 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:34.470+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.7 2019-11-28T21:59:34.570 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:34.584+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-28T21:59:34.571 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:34.584+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=2037 stripe_ofs=2037 part_ofs=0 rule->part_size=0 2019-11-28T21:59:34.571 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:34.584+0000 7ff56cd56ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: _NQHrbkXtrZC5mQP_UIfCJXTh-hjsKho 2019-11-28T21:59:34.633 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:34.646+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:34.645 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:34.659+0000 7ff56cd56ec0 10 manifest: total_size = 2037 2019-11-28T21:59:34.646 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:34.659+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to _bKREL5HwTwEp5qkA-7xqZZe1EdN0iX8 2019-11-28T21:59:34.646 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:34.659+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:34.646 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:34.659+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5b5b48 2019-11-28T21:59:34.646 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:34.659+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.7 2019-11-28T21:59:34.749 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:34.763+0000 7ff56cd56ec0 10 cls_bucket_list_ordered :test-client.0-r-test-obj-storage-class-copy.1[bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.7]) start _multipart_[] num_entries 1001 2019-11-28T21:59:34.750 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:34.763+0000 7ff56cd56ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-28T21:59:34.803 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:34.817+0000 7ff56cd56ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.7])"; objs.size()=0; is_truncated=0 2019-11-28T21:59:34.860 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:34.873+0000 7ff56cd56ec0 20 get_system_obj_state: rctx=0x7ffeb06e5458 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1 state=0x5604aa5b5800 s->prefetch_data=0 2019-11-28T21:59:34.861 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:34.873+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x16, cached=0x3) 2019-11-28T21:59:34.872 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:34.886+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x16 2019-11-28T21:59:34.872 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:34.886+0000 7ff56cd56ec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2019-11-28T21:59:34.873 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:34.886+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:34.873 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:34.886+0000 7ff56cd56ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T21:59:34.873 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:34.886+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : hit (requested=0x11, cached=0x17) 2019-11-28T21:59:34.873 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:34.886+0000 7ff56cd56ec0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2019-11-28T21:59:34.873 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:34.886+0000 7ff56cd56ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=189 2019-11-28T21:59:34.883 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:34.896+0000 7ff53affd700 10 RGWWatcher::handle_notify() notify_id 579820584971 cookie 94578037267328 notifier 4451 bl.length()=189 2019-11-28T21:59:35.033 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.046+0000 7ff56cd56ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.7 from cache 2019-11-28T21:59:35.033 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.046+0000 7ff56cd56ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=246 2019-11-28T21:59:35.048 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.062+0000 7ff53affd700 10 RGWWatcher::handle_notify() notify_id 579820584964 cookie 94578037269648 notifier 4451 bl.length()=246 2019-11-28T21:59:35.476 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.490+0000 7ff56cd56ec0 20 get_system_obj_state: rctx=0x7ffeb06e5aa0 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1 state=0x5604aa5a6580 s->prefetch_data=0 2019-11-28T21:59:35.477 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.490+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2019-11-28T21:59:35.487 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.501+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x6 2019-11-28T21:59:35.488 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.501+0000 7ff56cd56ec0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2019-11-28T21:59:35.488 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.501+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:35.488 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.501+0000 7ff56cd56ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T21:59:35.488 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.501+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x1, cached=0x6) 2019-11-28T21:59:35.488 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.501+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:35.498 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.512+0000 7ff56cd56ec0 20 rados_obj.operate() r=0 bl.length=237 2019-11-28T21:59:35.498 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.512+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x1 2019-11-28T21:59:35.498 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.512+0000 7ff56cd56ec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2019-11-28T21:59:35.499 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.512+0000 7ff56cd56ec0 20 get_system_obj_state: rctx=0x7ffeb06e5aa0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9 state=0x5604aa59f170 s->prefetch_data=0 2019-11-28T21:59:35.499 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.512+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9 : miss 2019-11-28T21:59:35.511 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.524+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9 info.flags=0x16 2019-11-28T21:59:35.511 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.524+0000 7ff56cd56ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9 to cache LRU end 2019-11-28T21:59:35.511 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.524+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:35.511 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.524+0000 7ff56cd56ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-28T21:59:35.511 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.524+0000 7ff56cd56ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T21:59:35.511 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.524+0000 7ff56cd56ec0 20 Read xattr: user.rgw.acl 2019-11-28T21:59:35.512 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.524+0000 7ff56cd56ec0 20 Read xattr: user.rgw.idtag 2019-11-28T21:59:35.512 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.524+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9 : type miss (requested=0x13, cached=0x16) 2019-11-28T21:59:35.512 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.524+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:35.526 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.539+0000 7ff56cd56ec0 20 rados_obj.operate() r=0 bl.length=329 2019-11-28T21:59:35.526 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.539+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9 info.flags=0x13 2019-11-28T21:59:35.526 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.539+0000 7ff56cd56ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9 to cache LRU end 2019-11-28T21:59:35.526 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.539+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:35.526 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.539+0000 7ff56cd56ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-28T21:59:35.526 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.539+0000 7ff56cd56ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9 2019-11-28T21:59:35.547 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.561+0000 7ff56cd56ec0 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-multipart-copy.1[bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9]) start [] num_entries 1100 2019-11-28T21:59:35.574 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.587+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2019-11-28T21:59:35.574 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.587+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-FROZEN[] 2019-11-28T21:59:35.574 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.587+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM[] 2019-11-28T21:59:35.574 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.587+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-STANDARD[] 2019-11-28T21:59:35.575 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.587+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2019-11-28T21:59:35.575 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.587+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN[] 2019-11-28T21:59:35.575 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.587+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM[] 2019-11-28T21:59:35.575 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.587+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD[] 2019-11-28T21:59:35.575 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.587+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2019-11-28T21:59:35.576 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.587+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-FROZEN[] 2019-11-28T21:59:35.576 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.587+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM[] 2019-11-28T21:59:35.576 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.587+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-STANDARD[] 2019-11-28T21:59:35.576 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.587+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:35.584 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.598+0000 7ff56cd56ec0 10 manifest: total_size = 11534336 2019-11-28T21:59:35.584 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.598+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.224 2019-11-28T21:59:35.584 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.598+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:35.584 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.598+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5b5b48 2019-11-28T21:59:35.584 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.598+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9 2019-11-28T21:59:35.709 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.723+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-28T21:59:35.710 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.723+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-28T21:59:35.710 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.723+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-28T21:59:35.710 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.723+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-28T21:59:35.710 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.723+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-28T21:59:35.710 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.723+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-28T21:59:35.710 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.723+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-28T21:59:35.710 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.723+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-28T21:59:35.711 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.723+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-28T21:59:35.711 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.723+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-28T21:59:35.711 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.723+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-28T21:59:35.711 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.723+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-11-28T21:59:35.711 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.723+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-11-28T21:59:35.711 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.723+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-11-28T21:59:35.711 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.723+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-11-28T21:59:35.712 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.723+0000 7ff56cd56ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.224 2019-11-28T21:59:35.826 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.840+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:35.836 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.848+0000 7ff56cd56ec0 10 manifest: total_size = 11534336 2019-11-28T21:59:35.836 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.848+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.225 2019-11-28T21:59:35.836 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.848+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:35.836 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.848+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5b5b48 2019-11-28T21:59:35.837 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.848+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9 2019-11-28T21:59:35.941 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.954+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-28T21:59:35.941 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.954+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-28T21:59:35.941 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.954+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-28T21:59:35.941 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.954+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-28T21:59:35.941 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.954+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-28T21:59:35.941 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.954+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-28T21:59:35.942 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.954+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-28T21:59:35.942 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.954+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-28T21:59:35.942 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.954+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-28T21:59:35.942 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.954+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-28T21:59:35.942 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.954+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-28T21:59:35.942 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.954+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-11-28T21:59:35.942 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.954+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-11-28T21:59:35.943 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.954+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-11-28T21:59:35.943 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.954+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-11-28T21:59:35.943 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:35.954+0000 7ff56cd56ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.225 2019-11-28T21:59:35.996 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.010+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:36.007 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.021+0000 7ff56cd56ec0 10 manifest: total_size = 11534336 2019-11-28T21:59:36.007 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.021+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to _IEATfTzS-h3E8dK63Zq8tUreTSzNGgk 2019-11-28T21:59:36.007 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.021+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:36.007 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.021+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5b5b48 2019-11-28T21:59:36.007 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.021+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9 2019-11-28T21:59:36.134 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.145+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-28T21:59:36.134 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.145+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-28T21:59:36.134 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.145+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-28T21:59:36.134 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.145+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-11-28T21:59:36.134 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.145+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-28T21:59:36.134 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.145+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-11-28T21:59:36.135 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.145+0000 7ff56cd56ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: _IEATfTzS-h3E8dK63Zq8tUreTSzNGgk 2019-11-28T21:59:36.214 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.228+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:36.222 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.236+0000 7ff56cd56ec0 10 manifest: total_size = 11534336 2019-11-28T21:59:36.222 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.236+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to _mSI5bECG4F72uTKoG4jyZgunwUfYfQ9 2019-11-28T21:59:36.222 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.236+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:36.222 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.236+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5b5b48 2019-11-28T21:59:36.223 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.236+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9 2019-11-28T21:59:36.331 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.344+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-28T21:59:36.331 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.344+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-11-28T21:59:36.331 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.344+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-28T21:59:36.331 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.344+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-11-28T21:59:36.331 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.344+0000 7ff56cd56ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: _mSI5bECG4F72uTKoG4jyZgunwUfYfQ9 2019-11-28T21:59:36.399 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.413+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:36.411 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.424+0000 7ff56cd56ec0 10 manifest: total_size = 11534336 2019-11-28T21:59:36.411 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.425+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.233 2019-11-28T21:59:36.411 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.425+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:36.411 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.425+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5b5b48 2019-11-28T21:59:36.411 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.425+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9 2019-11-28T21:59:36.521 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.535+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-28T21:59:36.522 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.535+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-28T21:59:36.522 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.535+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-28T21:59:36.522 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.535+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-28T21:59:36.522 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.535+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-28T21:59:36.522 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.535+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-28T21:59:36.522 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.535+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-28T21:59:36.523 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.535+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-28T21:59:36.523 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.535+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-28T21:59:36.523 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.535+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-28T21:59:36.523 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.535+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-28T21:59:36.523 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.535+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-11-28T21:59:36.523 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.535+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-11-28T21:59:36.523 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.535+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-11-28T21:59:36.524 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.535+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-11-28T21:59:36.524 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.535+0000 7ff56cd56ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.233 2019-11-28T21:59:36.569 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.583+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:36.577 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.591+0000 7ff56cd56ec0 10 manifest: total_size = 11534336 2019-11-28T21:59:36.578 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.591+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to _SVQYoSH2-U0choYlwvay4vk3biJbCq9 2019-11-28T21:59:36.578 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.591+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:36.578 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.591+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5b5b48 2019-11-28T21:59:36.578 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.591+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9 2019-11-28T21:59:36.678 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.692+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-28T21:59:36.679 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.692+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-28T21:59:36.679 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.692+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-28T21:59:36.679 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.692+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-11-28T21:59:36.679 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.692+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-28T21:59:36.679 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.692+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-11-28T21:59:36.680 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.692+0000 7ff56cd56ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: _SVQYoSH2-U0choYlwvay4vk3biJbCq9 2019-11-28T21:59:36.743 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.757+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:36.752 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.766+0000 7ff56cd56ec0 10 manifest: total_size = 11534336 2019-11-28T21:59:36.752 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.766+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.235 2019-11-28T21:59:36.752 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.766+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:36.752 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.766+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5b5b48 2019-11-28T21:59:36.752 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.766+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9 2019-11-28T21:59:36.878 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.891+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-28T21:59:36.878 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.891+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-28T21:59:36.878 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.891+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-28T21:59:36.878 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.891+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-28T21:59:36.878 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.891+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-28T21:59:36.878 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.891+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-28T21:59:36.879 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.891+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-28T21:59:36.879 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.891+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-28T21:59:36.879 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.891+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-28T21:59:36.879 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.891+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-28T21:59:36.879 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.891+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-28T21:59:36.879 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.891+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-11-28T21:59:36.880 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.891+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-11-28T21:59:36.880 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.891+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-11-28T21:59:36.880 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.891+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-11-28T21:59:36.880 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.891+0000 7ff56cd56ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.235 2019-11-28T21:59:36.929 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.943+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:36.937 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.951+0000 7ff56cd56ec0 10 manifest: total_size = 11534336 2019-11-28T21:59:36.938 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.951+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to _ReRNX686st47kmYceMnoZ6AkPpWPINo 2019-11-28T21:59:36.938 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.951+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:36.938 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.951+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5b5b48 2019-11-28T21:59:36.938 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:36.951+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9 2019-11-28T21:59:37.069 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.083+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-28T21:59:37.069 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.083+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-11-28T21:59:37.069 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.083+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-28T21:59:37.069 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.083+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-11-28T21:59:37.069 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.083+0000 7ff56cd56ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: _ReRNX686st47kmYceMnoZ6AkPpWPINo 2019-11-28T21:59:37.149 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.162+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:37.161 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.175+0000 7ff56cd56ec0 10 manifest: total_size = 541681 2019-11-28T21:59:37.161 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.175+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.242 2019-11-28T21:59:37.161 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.175+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:37.161 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.175+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5b5b48 2019-11-28T21:59:37.162 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.175+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9 2019-11-28T21:59:37.267 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.281+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2019-11-28T21:59:37.267 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.281+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2019-11-28T21:59:37.267 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.281+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2019-11-28T21:59:37.267 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.281+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2019-11-28T21:59:37.268 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.281+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2019-11-28T21:59:37.268 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.281+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2019-11-28T21:59:37.268 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.281+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2019-11-28T21:59:37.268 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.281+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=49187 2019-11-28T21:59:37.268 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.281+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2019-11-28T21:59:37.268 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.281+0000 7ff56cd56ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.242 2019-11-28T21:59:37.354 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.368+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:37.364 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.378+0000 7ff56cd56ec0 10 manifest: total_size = 541681 2019-11-28T21:59:37.364 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.378+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to _0cJGMy8xh1j_HmTT_CWNO_ryHSg-lP4 2019-11-28T21:59:37.364 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.378+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:37.365 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.378+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5b5b48 2019-11-28T21:59:37.365 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.378+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9 2019-11-28T21:59:37.466 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.479+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-28T21:59:37.466 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.479+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=0 rule->part_size=0 2019-11-28T21:59:37.466 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.480+0000 7ff56cd56ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: _0cJGMy8xh1j_HmTT_CWNO_ryHSg-lP4 2019-11-28T21:59:37.541 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.555+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:37.549 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.563+0000 7ff56cd56ec0 10 manifest: total_size = 541681 2019-11-28T21:59:37.549 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.563+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to _QZicgdBI3bBFDcZlsysrGgYUuLEamB8 2019-11-28T21:59:37.549 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.563+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:37.549 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.563+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5b5b48 2019-11-28T21:59:37.549 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.563+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9 2019-11-28T21:59:37.647 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.661+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-28T21:59:37.647 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.661+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=0 rule->part_size=0 2019-11-28T21:59:37.647 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.661+0000 7ff56cd56ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: _QZicgdBI3bBFDcZlsysrGgYUuLEamB8 2019-11-28T21:59:37.724 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.738+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:37.733 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.746+0000 7ff56cd56ec0 10 manifest: total_size = 541681 2019-11-28T21:59:37.733 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.746+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.245 2019-11-28T21:59:37.733 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.746+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:37.733 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.746+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5b5b48 2019-11-28T21:59:37.733 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.746+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9 2019-11-28T21:59:37.824 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.838+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2019-11-28T21:59:37.824 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.838+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2019-11-28T21:59:37.825 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.838+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2019-11-28T21:59:37.825 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.838+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2019-11-28T21:59:37.831 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.838+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2019-11-28T21:59:37.831 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.838+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2019-11-28T21:59:37.831 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.838+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2019-11-28T21:59:37.831 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.838+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=49187 2019-11-28T21:59:37.831 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.838+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2019-11-28T21:59:37.831 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.838+0000 7ff56cd56ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.245 2019-11-28T21:59:37.894 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.908+0000 7ff56cd56ec0 10 cls_bucket_list_ordered :test-client.0-r-test-obj-storage-class-multipart-copy.1[bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9]) start _multipart_[] num_entries 1001 2019-11-28T21:59:37.894 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.908+0000 7ff56cd56ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-28T21:59:37.915 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.929+0000 7ff56cd56ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9])"; objs.size()=0; is_truncated=0 2019-11-28T21:59:37.977 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.990+0000 7ff56cd56ec0 20 get_system_obj_state: rctx=0x7ffeb06e5458 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1 state=0x5604aa5acea0 s->prefetch_data=0 2019-11-28T21:59:37.977 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:37.990+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x16, cached=0x3) 2019-11-28T21:59:37.987 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.000+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x16 2019-11-28T21:59:37.987 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.001+0000 7ff56cd56ec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2019-11-28T21:59:37.987 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.001+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:37.987 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.001+0000 7ff56cd56ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T21:59:37.988 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.001+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : hit (requested=0x11, cached=0x17) 2019-11-28T21:59:37.988 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.001+0000 7ff56cd56ec0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2019-11-28T21:59:37.988 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.001+0000 7ff56cd56ec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=199 2019-11-28T21:59:38.000 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.014+0000 7ff53affd700 10 RGWWatcher::handle_notify() notify_id 579820584962 cookie 94578037269008 notifier 4451 bl.length()=199 2019-11-28T21:59:38.204 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.218+0000 7ff56cd56ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9 from cache 2019-11-28T21:59:38.204 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.218+0000 7ff56cd56ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=256 2019-11-28T21:59:38.249 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.263+0000 7ff53affd700 10 RGWWatcher::handle_notify() notify_id 579820584960 cookie 94578037276160 notifier 4451 bl.length()=256 2019-11-28T21:59:38.487 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.501+0000 7ff56cd56ec0 20 get_system_obj_state: rctx=0x7ffeb06e5aa0 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1 state=0x5604aa5acea0 s->prefetch_data=0 2019-11-28T21:59:38.487 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.501+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2019-11-28T21:59:38.500 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.514+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x6 2019-11-28T21:59:38.501 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.514+0000 7ff56cd56ec0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2019-11-28T21:59:38.501 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.514+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:38.501 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.514+0000 7ff56cd56ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T21:59:38.501 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.514+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x1, cached=0x6) 2019-11-28T21:59:38.501 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.514+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:38.530 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.544+0000 7ff56cd56ec0 20 rados_obj.operate() r=0 bl.length=232 2019-11-28T21:59:38.530 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.544+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x1 2019-11-28T21:59:38.531 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.544+0000 7ff56cd56ec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2019-11-28T21:59:38.531 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.544+0000 7ff56cd56ec0 20 get_system_obj_state: rctx=0x7ffeb06e5aa0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.8 state=0x5604aa5a3ac0 s->prefetch_data=0 2019-11-28T21:59:38.531 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.544+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.8 : miss 2019-11-28T21:59:38.541 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.555+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.8 info.flags=0x16 2019-11-28T21:59:38.541 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.555+0000 7ff56cd56ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.8 to cache LRU end 2019-11-28T21:59:38.541 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.555+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:38.541 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.555+0000 7ff56cd56ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-28T21:59:38.541 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.555+0000 7ff56cd56ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T21:59:38.541 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.555+0000 7ff56cd56ec0 20 Read xattr: user.rgw.acl 2019-11-28T21:59:38.542 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.555+0000 7ff56cd56ec0 20 Read xattr: user.rgw.idtag 2019-11-28T21:59:38.542 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.555+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.8 : type miss (requested=0x13, cached=0x16) 2019-11-28T21:59:38.542 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.555+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:38.560 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.574+0000 7ff56cd56ec0 20 rados_obj.operate() r=0 bl.length=324 2019-11-28T21:59:38.560 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.574+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.8 info.flags=0x13 2019-11-28T21:59:38.560 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.574+0000 7ff56cd56ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.8 to cache LRU end 2019-11-28T21:59:38.561 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.574+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:38.561 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.574+0000 7ff56cd56ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-28T21:59:38.561 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.574+0000 7ff56cd56ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.8 2019-11-28T21:59:38.571 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.585+0000 7ff56cd56ec0 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-multipart.1[bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.8]) start [] num_entries 1100 2019-11-28T21:59:38.593 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.607+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2019-11-28T21:59:38.594 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.607+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2019-11-28T21:59:38.594 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.607+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2019-11-28T21:59:38.594 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.607+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:38.602 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.616+0000 7ff56cd56ec0 10 manifest: total_size = 11534336 2019-11-28T21:59:38.602 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.616+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.196 2019-11-28T21:59:38.602 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.616+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:38.603 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.616+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5b5b48 2019-11-28T21:59:38.603 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.616+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.8 2019-11-28T21:59:38.705 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.719+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-28T21:59:38.705 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.719+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-28T21:59:38.706 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.719+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-28T21:59:38.706 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.719+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-28T21:59:38.706 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.719+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-28T21:59:38.706 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.719+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-28T21:59:38.706 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.719+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-28T21:59:38.706 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.719+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-28T21:59:38.706 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.719+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-28T21:59:38.707 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.719+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-28T21:59:38.707 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.719+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-28T21:59:38.707 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.719+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-11-28T21:59:38.707 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.719+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-11-28T21:59:38.707 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.719+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-11-28T21:59:38.707 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.719+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-11-28T21:59:38.707 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.719+0000 7ff56cd56ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.196 2019-11-28T21:59:38.784 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.798+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:38.802 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.817+0000 7ff56cd56ec0 10 manifest: total_size = 11534336 2019-11-28T21:59:38.803 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.817+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.203 2019-11-28T21:59:38.803 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.817+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:38.803 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.817+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5b5b48 2019-11-28T21:59:38.803 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.817+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.8 2019-11-28T21:59:38.948 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.962+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-28T21:59:38.948 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.962+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-28T21:59:38.949 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.962+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-28T21:59:38.949 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.962+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-28T21:59:38.949 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.962+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-28T21:59:38.949 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.962+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-28T21:59:38.949 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.962+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-28T21:59:38.949 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.962+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-28T21:59:38.949 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.962+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-28T21:59:38.950 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.962+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-28T21:59:38.950 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.962+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-28T21:59:38.950 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.962+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-11-28T21:59:38.950 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.962+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-11-28T21:59:38.950 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.962+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-11-28T21:59:38.950 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.962+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-11-28T21:59:38.950 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:38.962+0000 7ff56cd56ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.203 2019-11-28T21:59:39.037 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:39.051+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:39.046 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:39.060+0000 7ff56cd56ec0 10 manifest: total_size = 11534336 2019-11-28T21:59:39.047 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:39.060+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.210 2019-11-28T21:59:39.047 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:39.060+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x5604aa5b5b48 s->prefetch_data=0 2019-11-28T21:59:39.047 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:39.060+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5b5b48 2019-11-28T21:59:39.047 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:39.060+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.8 2019-11-28T21:59:39.135 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:39.149+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-28T21:59:39.135 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:39.149+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-28T21:59:39.136 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:39.149+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-28T21:59:39.136 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:39.149+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-28T21:59:39.136 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:39.149+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-28T21:59:39.136 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:39.149+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-28T21:59:39.136 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:39.149+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-28T21:59:39.136 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:39.149+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-28T21:59:39.136 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:39.149+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-28T21:59:39.137 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:39.149+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-28T21:59:39.138 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:39.149+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-28T21:59:39.138 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:39.149+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-11-28T21:59:39.138 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:39.149+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-11-28T21:59:39.138 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:39.149+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-11-28T21:59:39.138 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:39.149+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-11-28T21:59:39.138 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:39.149+0000 7ff56cd56ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.210 2019-11-28T21:59:39.190 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:39.204+0000 7ff56cd56ec0 10 cls_bucket_list_ordered :test-client.0-r-test-obj-storage-class-multipart.1[bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.8]) start _multipart_[] num_entries 1001 2019-11-28T21:59:39.191 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:39.204+0000 7ff56cd56ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-28T21:59:39.202 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:39.216+0000 7ff56cd56ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.8])"; objs.size()=0; is_truncated=0 2019-11-28T21:59:39.294 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:39.308+0000 7ff56cd56ec0 20 get_system_obj_state: rctx=0x7ffeb06e5458 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1 state=0x5604aa5acea0 s->prefetch_data=0 2019-11-28T21:59:39.295 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:39.308+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x16, cached=0x3) 2019-11-28T21:59:39.305 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:39.318+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x16 2019-11-28T21:59:39.305 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:39.318+0000 7ff56cd56ec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2019-11-28T21:59:39.305 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:39.318+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:39.305 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:39.318+0000 7ff56cd56ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T21:59:39.305 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:39.318+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : hit (requested=0x11, cached=0x17) 2019-11-28T21:59:39.305 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:39.318+0000 7ff56cd56ec0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2019-11-28T21:59:39.305 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:39.318+0000 7ff56cd56ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=194 2019-11-28T21:59:39.320 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:39.335+0000 7ff53affd700 10 RGWWatcher::handle_notify() notify_id 579820584965 cookie 94578037269648 notifier 4451 bl.length()=194 2019-11-28T21:59:40.010 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.024+0000 7ff56cd56ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.8 from cache 2019-11-28T21:59:40.010 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.024+0000 7ff56cd56ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=251 2019-11-28T21:59:40.022 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.035+0000 7ff53affd700 10 RGWWatcher::handle_notify() notify_id 579820584961 cookie 94578037276160 notifier 4451 bl.length()=251 2019-11-28T21:59:40.433 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.446+0000 7ff56cd56ec0 20 get_system_obj_state: rctx=0x7ffeb06e5aa0 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1 state=0x5604aa5acea0 s->prefetch_data=0 2019-11-28T21:59:40.433 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.446+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2019-11-28T21:59:40.441 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.455+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x6 2019-11-28T21:59:40.441 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.455+0000 7ff56cd56ec0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2019-11-28T21:59:40.441 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.455+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:40.441 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.455+0000 7ff56cd56ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T21:59:40.441 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.455+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x1, cached=0x6) 2019-11-28T21:59:40.442 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.455+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:40.457 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.471+0000 7ff56cd56ec0 20 rados_obj.operate() r=0 bl.length=222 2019-11-28T21:59:40.458 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.471+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x1 2019-11-28T21:59:40.458 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.471+0000 7ff56cd56ec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2019-11-28T21:59:40.458 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.471+0000 7ff56cd56ec0 20 get_system_obj_state: rctx=0x7ffeb06e5aa0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.6 state=0x5604aa59f170 s->prefetch_data=0 2019-11-28T21:59:40.458 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.471+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.6 : miss 2019-11-28T21:59:40.468 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.482+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.6 info.flags=0x16 2019-11-28T21:59:40.469 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.482+0000 7ff56cd56ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.6 to cache LRU end 2019-11-28T21:59:40.469 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.482+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:40.469 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.482+0000 7ff56cd56ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-28T21:59:40.469 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.482+0000 7ff56cd56ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T21:59:40.469 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.482+0000 7ff56cd56ec0 20 Read xattr: user.rgw.acl 2019-11-28T21:59:40.469 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.482+0000 7ff56cd56ec0 20 Read xattr: user.rgw.idtag 2019-11-28T21:59:40.470 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.482+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.6 : type miss (requested=0x13, cached=0x16) 2019-11-28T21:59:40.470 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.482+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:40.481 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.495+0000 7ff56cd56ec0 20 rados_obj.operate() r=0 bl.length=314 2019-11-28T21:59:40.481 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.495+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.6 info.flags=0x13 2019-11-28T21:59:40.482 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.495+0000 7ff56cd56ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.6 to cache LRU end 2019-11-28T21:59:40.482 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.495+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:40.482 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.495+0000 7ff56cd56ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-28T21:59:40.482 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.495+0000 7ff56cd56ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.6 2019-11-28T21:59:40.503 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.517+0000 7ff56cd56ec0 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class.1[bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.6]) start [] num_entries 1100 2019-11-28T21:59:40.523 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.537+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2019-11-28T21:59:40.523 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.537+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2019-11-28T21:59:40.524 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.537+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2019-11-28T21:59:40.524 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.537+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x5604aa5313c8 s->prefetch_data=0 2019-11-28T21:59:40.549 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.563+0000 7ff56cd56ec0 10 manifest: total_size = 10485760 2019-11-28T21:59:40.549 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.563+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.84 2019-11-28T21:59:40.549 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.563+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x5604aa5313c8 s->prefetch_data=0 2019-11-28T21:59:40.549 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.563+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5313c8 2019-11-28T21:59:40.549 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.563+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.6 2019-11-28T21:59:40.681 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.695+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-28T21:59:40.681 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.695+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-28T21:59:40.681 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.695+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-28T21:59:40.681 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.695+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-11-28T21:59:40.681 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.695+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-28T21:59:40.682 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.695+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2019-11-28T21:59:40.683 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.695+0000 7ff56cd56ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.84 2019-11-28T21:59:40.728 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.740+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x5604aa5313c8 s->prefetch_data=0 2019-11-28T21:59:40.734 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.748+0000 7ff56cd56ec0 10 manifest: total_size = 10485760 2019-11-28T21:59:40.734 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.748+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.85 2019-11-28T21:59:40.734 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.748+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x5604aa5313c8 s->prefetch_data=0 2019-11-28T21:59:40.734 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.748+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5313c8 2019-11-28T21:59:40.734 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.748+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.6 2019-11-28T21:59:40.828 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.842+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-28T21:59:40.828 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.842+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-28T21:59:40.829 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.842+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-28T21:59:40.829 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.842+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-11-28T21:59:40.829 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.842+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-28T21:59:40.829 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.842+0000 7ff56cd56ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2019-11-28T21:59:40.829 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.842+0000 7ff56cd56ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.85 2019-11-28T21:59:40.899 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.913+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x5604aa5313c8 s->prefetch_data=0 2019-11-28T21:59:40.918 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.932+0000 7ff56cd56ec0 10 manifest: total_size = 648332 2019-11-28T21:59:40.918 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.932+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.86 2019-11-28T21:59:40.918 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.932+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x5604aa5313c8 s->prefetch_data=0 2019-11-28T21:59:40.919 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.932+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5313c8 2019-11-28T21:59:40.919 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:40.932+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.6 2019-11-28T21:59:41.037 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:41.050+0000 7ff56cd56ec0 10 cls_bucket_list_ordered :test-client.0-r-test-obj-storage-class.1[bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.6]) start _multipart_[] num_entries 1001 2019-11-28T21:59:41.037 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:41.050+0000 7ff56cd56ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-28T21:59:41.103 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:41.117+0000 7ff56cd56ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.6])"; objs.size()=0; is_truncated=0 2019-11-28T21:59:41.162 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:41.176+0000 7ff56cd56ec0 20 get_system_obj_state: rctx=0x7ffeb06e5458 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1 state=0x5604aa59f170 s->prefetch_data=0 2019-11-28T21:59:41.162 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:41.176+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x16, cached=0x3) 2019-11-28T21:59:41.177 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:41.191+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x16 2019-11-28T21:59:41.178 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:41.191+0000 7ff56cd56ec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2019-11-28T21:59:41.178 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:41.191+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:41.178 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:41.191+0000 7ff56cd56ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T21:59:41.178 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:41.191+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : hit (requested=0x11, cached=0x17) 2019-11-28T21:59:41.178 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:41.191+0000 7ff56cd56ec0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2019-11-28T21:59:41.178 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:41.191+0000 7ff56cd56ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=184 2019-11-28T21:59:41.197 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:41.211+0000 7ff53affd700 10 RGWWatcher::handle_notify() notify_id 579820584972 cookie 94578037267328 notifier 4451 bl.length()=184 2019-11-28T21:59:41.684 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:41.698+0000 7ff56cd56ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.6 from cache 2019-11-28T21:59:41.684 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:41.698+0000 7ff56cd56ec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=241 2019-11-28T21:59:41.698 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:41.712+0000 7ff53affd700 10 RGWWatcher::handle_notify() notify_id 579820584963 cookie 94578037269008 notifier 4451 bl.length()=241 2019-11-28T21:59:42.186 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.200+0000 7ff56cd56ec0 20 get_system_obj_state: rctx=0x7ffeb06e5aa0 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.1 state=0x5604aa5acea0 s->prefetch_data=0 2019-11-28T21:59:42.186 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.200+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2019-11-28T21:59:42.196 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.210+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x6 2019-11-28T21:59:42.196 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.210+0000 7ff56cd56ec0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2019-11-28T21:59:42.196 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.210+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:42.196 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.210+0000 7ff56cd56ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T21:59:42.196 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.210+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : type miss (requested=0x1, cached=0x6) 2019-11-28T21:59:42.196 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.210+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:42.215 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.229+0000 7ff56cd56ec0 20 rados_obj.operate() r=0 bl.length=221 2019-11-28T21:59:42.215 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.229+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x1 2019-11-28T21:59:42.215 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.229+0000 7ff56cd56ec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2019-11-28T21:59:42.216 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.229+0000 7ff56cd56ec0 20 get_system_obj_state: rctx=0x7ffeb06e5aa0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.10 state=0x5604aa59f170 s->prefetch_data=0 2019-11-28T21:59:42.216 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.229+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.10 : miss 2019-11-28T21:59:42.227 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.241+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.10 info.flags=0x16 2019-11-28T21:59:42.227 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.241+0000 7ff56cd56ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.10 to cache LRU end 2019-11-28T21:59:42.228 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.241+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:42.228 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.241+0000 7ff56cd56ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-28T21:59:42.228 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.241+0000 7ff56cd56ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T21:59:42.228 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.241+0000 7ff56cd56ec0 20 Read xattr: user.rgw.acl 2019-11-28T21:59:42.228 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.241+0000 7ff56cd56ec0 20 Read xattr: user.rgw.idtag 2019-11-28T21:59:42.228 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.241+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.10 : type miss (requested=0x13, cached=0x16) 2019-11-28T21:59:42.228 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.241+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:42.246 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.260+0000 7ff56cd56ec0 20 rados_obj.operate() r=0 bl.length=313 2019-11-28T21:59:42.247 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.260+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.10 info.flags=0x13 2019-11-28T21:59:42.247 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.260+0000 7ff56cd56ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.10 to cache LRU end 2019-11-28T21:59:42.247 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.260+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:42.247 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.260+0000 7ff56cd56ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-28T21:59:42.247 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.260+0000 7ff56cd56ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.10 2019-11-28T21:59:42.270 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.285+0000 7ff56cd56ec0 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.1[bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.10]) start [] num_entries 1100 2019-11-28T21:59:42.315 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.329+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got __[] 2019-11-28T21:59:42.315 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.329+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2019-11-28T21:59:42.315 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.329+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got ___[] 2019-11-28T21:59:42.315 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.329+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got obj[] 2019-11-28T21:59:42.316 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.329+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x5604aa5313c8 s->prefetch_data=0 2019-11-28T21:59:42.326 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.339+0000 7ff56cd56ec0 10 manifest: total_size = 1048576 2019-11-28T21:59:42.326 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.339+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.305 2019-11-28T21:59:42.326 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.339+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x5604aa5313c8 s->prefetch_data=0 2019-11-28T21:59:42.326 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.339+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5313c8 2019-11-28T21:59:42.326 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.339+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.10 2019-11-28T21:59:42.445 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.459+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x5604aa5313c8 s->prefetch_data=0 2019-11-28T21:59:42.459 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.473+0000 7ff56cd56ec0 10 manifest: total_size = 4134 2019-11-28T21:59:42.459 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.473+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.307 2019-11-28T21:59:42.459 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.473+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x5604aa5313c8 s->prefetch_data=0 2019-11-28T21:59:42.459 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.473+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5313c8 2019-11-28T21:59:42.460 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.473+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.10 2019-11-28T21:59:42.649 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.663+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x5604aa5313c8 s->prefetch_data=0 2019-11-28T21:59:42.701 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.715+0000 7ff56cd56ec0 10 manifest: total_size = 49187 2019-11-28T21:59:42.701 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.715+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.306 2019-11-28T21:59:42.702 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.715+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x5604aa5313c8 s->prefetch_data=0 2019-11-28T21:59:42.702 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.715+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5313c8 2019-11-28T21:59:42.702 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.715+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.10 2019-11-28T21:59:42.895 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.909+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x5604aa5313c8 s->prefetch_data=0 2019-11-28T21:59:42.909 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.923+0000 7ff56cd56ec0 10 manifest: total_size = 1035 2019-11-28T21:59:42.909 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.923+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.304 2019-11-28T21:59:42.909 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.923+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x5604aa5313c8 s->prefetch_data=0 2019-11-28T21:59:42.910 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.923+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5313c8 2019-11-28T21:59:42.910 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:42.923+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.10 2019-11-28T21:59:43.123 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:43.137+0000 7ff56cd56ec0 10 cls_bucket_list_ordered :test-client.0-r-test-small-obj-data.1[bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.10]) start _multipart_[] num_entries 1001 2019-11-28T21:59:43.124 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:43.137+0000 7ff56cd56ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-28T21:59:43.221 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:43.235+0000 7ff56cd56ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.10])"; objs.size()=0; is_truncated=0 2019-11-28T21:59:43.312 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:43.325+0000 7ff56cd56ec0 20 get_system_obj_state: rctx=0x7ffeb06e5458 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.1 state=0x5604aa5acea0 s->prefetch_data=0 2019-11-28T21:59:43.312 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:43.325+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : type miss (requested=0x16, cached=0x3) 2019-11-28T21:59:43.331 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:43.345+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x16 2019-11-28T21:59:43.331 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:43.345+0000 7ff56cd56ec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2019-11-28T21:59:43.331 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:43.345+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:43.331 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:43.345+0000 7ff56cd56ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T21:59:43.331 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:43.345+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : hit (requested=0x11, cached=0x17) 2019-11-28T21:59:43.332 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:43.345+0000 7ff56cd56ec0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2019-11-28T21:59:43.332 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:43.345+0000 7ff56cd56ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2019-11-28T21:59:43.348 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:43.362+0000 7ff53affd700 10 RGWWatcher::handle_notify() notify_id 579820584966 cookie 94578037263808 notifier 4451 bl.length()=181 2019-11-28T21:59:43.419 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:43.433+0000 7ff52a7dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-28T21:59:43.701 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:43.715+0000 7ff56cd56ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.10 from cache 2019-11-28T21:59:43.702 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:43.715+0000 7ff56cd56ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=239 2019-11-28T21:59:43.718 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:43.732+0000 7ff53affd700 10 RGWWatcher::handle_notify() notify_id 579820584967 cookie 94578037269648 notifier 4451 bl.length()=239 2019-11-28T21:59:44.420 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.434+0000 7ff56cd56ec0 20 get_system_obj_state: rctx=0x7ffeb06e5aa0 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.2 state=0x5604aa5a3ac0 s->prefetch_data=0 2019-11-28T21:59:44.420 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.434+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2019-11-28T21:59:44.432 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.445+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x6 2019-11-28T21:59:44.432 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.445+0000 7ff56cd56ec0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2019-11-28T21:59:44.432 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.445+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:44.432 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.445+0000 7ff56cd56ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T21:59:44.433 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.445+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : type miss (requested=0x1, cached=0x6) 2019-11-28T21:59:44.433 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.445+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:44.444 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.457+0000 7ff56cd56ec0 20 rados_obj.operate() r=0 bl.length=221 2019-11-28T21:59:44.444 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.457+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x1 2019-11-28T21:59:44.445 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.457+0000 7ff56cd56ec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2019-11-28T21:59:44.445 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.457+0000 7ff56cd56ec0 20 get_system_obj_state: rctx=0x7ffeb06e5aa0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.11 state=0x5604aa5acea0 s->prefetch_data=0 2019-11-28T21:59:44.445 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.457+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.11 : miss 2019-11-28T21:59:44.466 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.480+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.11 info.flags=0x16 2019-11-28T21:59:44.467 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.480+0000 7ff56cd56ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.11 to cache LRU end 2019-11-28T21:59:44.467 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.480+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:44.467 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.480+0000 7ff56cd56ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-28T21:59:44.468 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.480+0000 7ff56cd56ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T21:59:44.468 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.480+0000 7ff56cd56ec0 20 Read xattr: user.rgw.acl 2019-11-28T21:59:44.468 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.480+0000 7ff56cd56ec0 20 Read xattr: user.rgw.idtag 2019-11-28T21:59:44.468 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.480+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.11 : type miss (requested=0x13, cached=0x16) 2019-11-28T21:59:44.468 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.480+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:44.487 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.501+0000 7ff56cd56ec0 20 rados_obj.operate() r=0 bl.length=313 2019-11-28T21:59:44.487 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.501+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.11 info.flags=0x13 2019-11-28T21:59:44.487 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.501+0000 7ff56cd56ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.11 to cache LRU end 2019-11-28T21:59:44.488 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.501+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:44.488 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.501+0000 7ff56cd56ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-28T21:59:44.488 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.501+0000 7ff56cd56ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.11 2019-11-28T21:59:44.509 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.523+0000 7ff56cd56ec0 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.2[bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.11]) start [] num_entries 1100 2019-11-28T21:59:44.530 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.539+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got __[] 2019-11-28T21:59:44.531 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.539+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2019-11-28T21:59:44.531 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.539+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got ___[] 2019-11-28T21:59:44.531 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.539+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got obj[] 2019-11-28T21:59:44.531 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.539+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x5604aa5313c8 s->prefetch_data=0 2019-11-28T21:59:44.540 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.549+0000 7ff56cd56ec0 10 manifest: total_size = 24595 2019-11-28T21:59:44.540 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.549+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.312 2019-11-28T21:59:44.540 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.549+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x5604aa5313c8 s->prefetch_data=0 2019-11-28T21:59:44.540 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.549+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5313c8 2019-11-28T21:59:44.541 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.549+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.11 2019-11-28T21:59:44.659 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.673+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x5604aa5313c8 s->prefetch_data=0 2019-11-28T21:59:44.673 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.687+0000 7ff56cd56ec0 10 manifest: total_size = 62 2019-11-28T21:59:44.673 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.687+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.314 2019-11-28T21:59:44.673 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.687+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x5604aa5313c8 s->prefetch_data=0 2019-11-28T21:59:44.673 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.687+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5313c8 2019-11-28T21:59:44.673 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.687+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.11 2019-11-28T21:59:44.893 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.907+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x5604aa5313c8 s->prefetch_data=0 2019-11-28T21:59:44.918 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.932+0000 7ff56cd56ec0 10 manifest: total_size = 527 2019-11-28T21:59:44.919 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.932+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.313 2019-11-28T21:59:44.919 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.932+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x5604aa5313c8 s->prefetch_data=0 2019-11-28T21:59:44.919 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.932+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5313c8 2019-11-28T21:59:44.919 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:44.932+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.11 2019-11-28T21:59:45.156 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:45.170+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x5604aa5313c8 s->prefetch_data=0 2019-11-28T21:59:45.174 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:45.188+0000 7ff56cd56ec0 10 manifest: total_size = 524288 2019-11-28T21:59:45.175 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:45.188+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.311 2019-11-28T21:59:45.175 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:45.188+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x5604aa5313c8 s->prefetch_data=0 2019-11-28T21:59:45.175 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:45.188+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5313c8 2019-11-28T21:59:45.175 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:45.188+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.11 2019-11-28T21:59:45.408 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:45.422+0000 7ff56cd56ec0 10 cls_bucket_list_ordered :test-client.0-r-test-small-obj-data.2[bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.11]) start _multipart_[] num_entries 1001 2019-11-28T21:59:45.408 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:45.422+0000 7ff56cd56ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-28T21:59:45.526 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:45.540+0000 7ff56cd56ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.11])"; objs.size()=0; is_truncated=0 2019-11-28T21:59:45.628 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:45.642+0000 7ff56cd56ec0 20 get_system_obj_state: rctx=0x7ffeb06e5458 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.2 state=0x5604aa5a2d80 s->prefetch_data=0 2019-11-28T21:59:45.628 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:45.642+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : type miss (requested=0x16, cached=0x3) 2019-11-28T21:59:45.643 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:45.657+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x16 2019-11-28T21:59:45.643 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:45.657+0000 7ff56cd56ec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2019-11-28T21:59:45.643 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:45.657+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:45.643 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:45.657+0000 7ff56cd56ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T21:59:45.643 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:45.657+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : hit (requested=0x11, cached=0x17) 2019-11-28T21:59:45.643 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:45.657+0000 7ff56cd56ec0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2019-11-28T21:59:45.643 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:45.657+0000 7ff56cd56ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2019-11-28T21:59:45.654 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:45.668+0000 7ff53affd700 10 RGWWatcher::handle_notify() notify_id 579820584968 cookie 94578037263808 notifier 4451 bl.length()=181 2019-11-28T21:59:45.968 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:45.982+0000 7ff56cd56ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.11 from cache 2019-11-28T21:59:45.968 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:45.982+0000 7ff56cd56ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=239 2019-11-28T21:59:45.980 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:45.994+0000 7ff53affd700 10 RGWWatcher::handle_notify() notify_id 579820584969 cookie 94578037269648 notifier 4451 bl.length()=239 2019-11-28T21:59:46.411 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.425+0000 7ff56cd56ec0 20 get_system_obj_state: rctx=0x7ffeb06e5aa0 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.3 state=0x5604aa59f170 s->prefetch_data=0 2019-11-28T21:59:46.412 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.425+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2019-11-28T21:59:46.424 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.438+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x6 2019-11-28T21:59:46.424 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.438+0000 7ff56cd56ec0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2019-11-28T21:59:46.424 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.438+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:46.424 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.438+0000 7ff56cd56ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T21:59:46.425 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.438+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : type miss (requested=0x1, cached=0x6) 2019-11-28T21:59:46.425 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.438+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:46.437 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.451+0000 7ff56cd56ec0 20 rados_obj.operate() r=0 bl.length=221 2019-11-28T21:59:46.437 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.451+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x1 2019-11-28T21:59:46.437 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.451+0000 7ff56cd56ec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2019-11-28T21:59:46.437 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.451+0000 7ff56cd56ec0 20 get_system_obj_state: rctx=0x7ffeb06e5aa0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.12 state=0x5604aa5a3ac0 s->prefetch_data=0 2019-11-28T21:59:46.437 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.451+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.12 : miss 2019-11-28T21:59:46.452 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.466+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.12 info.flags=0x16 2019-11-28T21:59:46.453 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.466+0000 7ff56cd56ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.12 to cache LRU end 2019-11-28T21:59:46.453 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.466+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:46.453 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.466+0000 7ff56cd56ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-28T21:59:46.453 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.466+0000 7ff56cd56ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T21:59:46.453 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.466+0000 7ff56cd56ec0 20 Read xattr: user.rgw.acl 2019-11-28T21:59:46.453 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.466+0000 7ff56cd56ec0 20 Read xattr: user.rgw.idtag 2019-11-28T21:59:46.453 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.466+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.12 : type miss (requested=0x13, cached=0x16) 2019-11-28T21:59:46.454 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.466+0000 7ff56cd56ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:46.468 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.482+0000 7ff56cd56ec0 20 rados_obj.operate() r=0 bl.length=313 2019-11-28T21:59:46.469 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.483+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.12 info.flags=0x13 2019-11-28T21:59:46.469 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.483+0000 7ff56cd56ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.12 to cache LRU end 2019-11-28T21:59:46.469 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.483+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:46.469 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.483+0000 7ff56cd56ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-28T21:59:46.471 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.483+0000 7ff56cd56ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.12 2019-11-28T21:59:46.487 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.501+0000 7ff56cd56ec0 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.3[bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.12]) start [] num_entries 1100 2019-11-28T21:59:46.525 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.539+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got __[] 2019-11-28T21:59:46.525 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.539+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2019-11-28T21:59:46.525 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.539+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got ___[] 2019-11-28T21:59:46.525 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.539+0000 7ff56cd56ec0 10 RGWRados::cls_bucket_list_unordered: got obj[] 2019-11-28T21:59:46.525 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.539+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x5604aa5313c8 s->prefetch_data=0 2019-11-28T21:59:46.534 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.548+0000 7ff56cd56ec0 10 manifest: total_size = 0 2019-11-28T21:59:46.534 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.548+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.319 2019-11-28T21:59:46.534 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.548+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x5604aa5313c8 s->prefetch_data=0 2019-11-28T21:59:46.534 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.548+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5313c8 2019-11-28T21:59:46.535 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.548+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.12 2019-11-28T21:59:46.691 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.705+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x5604aa5313c8 s->prefetch_data=0 2019-11-28T21:59:46.762 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.776+0000 7ff56cd56ec0 10 manifest: total_size = 0 2019-11-28T21:59:46.762 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.776+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.321 2019-11-28T21:59:46.763 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.776+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x5604aa5313c8 s->prefetch_data=0 2019-11-28T21:59:46.763 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.776+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5313c8 2019-11-28T21:59:46.763 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.776+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.12 2019-11-28T21:59:46.953 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.967+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x5604aa5313c8 s->prefetch_data=0 2019-11-28T21:59:46.964 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.978+0000 7ff56cd56ec0 10 manifest: total_size = 0 2019-11-28T21:59:46.964 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.978+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.320 2019-11-28T21:59:46.964 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.978+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x5604aa5313c8 s->prefetch_data=0 2019-11-28T21:59:46.964 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.978+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5313c8 2019-11-28T21:59:46.965 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:46.978+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.12 2019-11-28T21:59:47.177 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:47.191+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x5604aa5313c8 s->prefetch_data=0 2019-11-28T21:59:47.189 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:47.203+0000 7ff56cd56ec0 10 manifest: total_size = 0 2019-11-28T21:59:47.189 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:47.203+0000 7ff56cd56ec0 20 get_obj_state: setting s->obj_tag to bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.318 2019-11-28T21:59:47.189 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:47.203+0000 7ff56cd56ec0 20 get_obj_state: rctx=0x7ffeb06e5ac0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x5604aa5313c8 s->prefetch_data=0 2019-11-28T21:59:47.189 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:47.203+0000 7ff56cd56ec0 20 prepare_atomic_modification: state is not atomic. state=0x5604aa5313c8 2019-11-28T21:59:47.189 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:47.203+0000 7ff56cd56ec0 20 bucket index object: default.rgw.buckets.index:.dir.bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.12 2019-11-28T21:59:47.332 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:47.346+0000 7ff56cd56ec0 10 cls_bucket_list_ordered :test-client.0-r-test-small-obj-data.3[bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.12]) start _multipart_[] num_entries 1001 2019-11-28T21:59:47.332 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:47.346+0000 7ff56cd56ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-28T21:59:47.397 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:47.412+0000 7ff56cd56ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.12])"; objs.size()=0; is_truncated=0 2019-11-28T21:59:47.473 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:47.487+0000 7ff56cd56ec0 20 get_system_obj_state: rctx=0x7ffeb06e5458 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.3 state=0x5604aa59f170 s->prefetch_data=0 2019-11-28T21:59:47.473 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:47.487+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : type miss (requested=0x16, cached=0x3) 2019-11-28T21:59:47.486 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:47.500+0000 7ff56cd56ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x16 2019-11-28T21:59:47.486 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:47.500+0000 7ff56cd56ec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2019-11-28T21:59:47.486 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:47.500+0000 7ff56cd56ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T21:59:47.486 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:47.500+0000 7ff56cd56ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T21:59:47.486 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:47.500+0000 7ff56cd56ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : hit (requested=0x11, cached=0x17) 2019-11-28T21:59:47.486 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:47.500+0000 7ff56cd56ec0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2019-11-28T21:59:47.487 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:47.500+0000 7ff56cd56ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2019-11-28T21:59:47.502 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:47.516+0000 7ff53affd700 10 RGWWatcher::handle_notify() notify_id 579820584970 cookie 94578037263808 notifier 4451 bl.length()=181 2019-11-28T21:59:48.105 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:48.120+0000 7ff56cd56ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.12 from cache 2019-11-28T21:59:48.106 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:48.120+0000 7ff56cd56ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=239 2019-11-28T21:59:48.117 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:48.131+0000 7ff53affd700 10 RGWWatcher::handle_notify() notify_id 579820584971 cookie 94578037269648 notifier 4451 bl.length()=239 2019-11-28T21:59:48.501 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:48.515+0000 7ff56cd56ec0 10 removing key index: FRLRNKHPBTSOAEMQUXDP 2019-11-28T21:59:48.501 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:48.515+0000 7ff56cd56ec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=170 2019-11-28T21:59:48.516 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:48.530+0000 7ff53affd700 10 RGWWatcher::handle_notify() notify_id 579820584973 cookie 94578037270816 notifier 4451 bl.length()=170 2019-11-28T21:59:48.587 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:48.601+0000 7ff56cd56ec0 10 removing email index: ragweed.client.0+test@test.test 2019-11-28T21:59:48.587 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:48.601+0000 7ff56cd56ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=182 2019-11-28T21:59:48.595 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:48.609+0000 7ff53affd700 10 RGWWatcher::handle_notify() notify_id 579820584974 cookie 94578037267328 notifier 4451 bl.length()=182 2019-11-28T21:59:48.718 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:48.732+0000 7ff56cd56ec0 10 removing user buckets index 2019-11-28T21:59:48.718 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:48.732+0000 7ff56cd56ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=173 2019-11-28T21:59:48.726 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:48.741+0000 7ff53affd700 10 RGWWatcher::handle_notify() notify_id 579820584972 cookie 94578037269648 notifier 4451 bl.length()=173 2019-11-28T21:59:48.822 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:48.836+0000 7ff56cd56ec0 10 removing user index: ragweed.client.0 2019-11-28T21:59:48.822 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:48.836+0000 7ff56cd56ec0 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2019-11-28T21:59:48.822 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:48.836+0000 7ff56cd56ec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=165 2019-11-28T21:59:48.831 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:48.846+0000 7ff53affd700 10 RGWWatcher::handle_notify() notify_id 579820584975 cookie 94578037270816 notifier 4451 bl.length()=165 2019-11-28T21:59:49.028 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:49.042+0000 7ff56cd56ec0 20 remove_watcher() i=0 2019-11-28T21:59:49.028 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:49.042+0000 7ff56cd56ec0 2 removed watcher, disabling cache 2019-11-28T21:59:49.078 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:49.092+0000 7ff56cd56ec0 20 remove_watcher() i=1 2019-11-28T21:59:49.134 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:49.149+0000 7ff56cd56ec0 20 remove_watcher() i=2 2019-11-28T21:59:49.174 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:49.188+0000 7ff56cd56ec0 20 remove_watcher() i=3 2019-11-28T21:59:49.237 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:49.251+0000 7ff56cd56ec0 20 remove_watcher() i=4 2019-11-28T21:59:49.292 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:49.306+0000 7ff56cd56ec0 20 remove_watcher() i=5 2019-11-28T21:59:49.344 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:49.359+0000 7ff56cd56ec0 20 remove_watcher() i=6 2019-11-28T21:59:49.386 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:49.400+0000 7ff56cd56ec0 20 remove_watcher() i=7 2019-11-28T21:59:49.397 INFO:tasks.ragweed:Removing ragweed... 2019-11-28T21:59:49.398 INFO:teuthology.orchestra.run.smithi074:> rm -rf /home/ubuntu/cephtest/ragweed 2019-11-28T21:59:49.495 INFO:teuthology.run_tasks:Running task s3tests-java... 2019-11-28T21:59:49.512 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2019-11-28T21:59:49.512 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2019-11-28T21:59:49.513 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2019-11-28T21:59:49.513 INFO:teuthology.orchestra.run.smithi074:> git clone -b master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2019-11-28T21:59:49.566 INFO:teuthology.orchestra.run.smithi074.stdout:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2019-11-28T21:59:53.374 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2019-11-28T21:59:53.374 INFO:teuthology.orchestra.run.smithi074:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2019-11-28T21:59:55.903 INFO:teuthology.orchestra.run.smithi074.stdout: Gradle will be installed under /opt/gradle 2019-11-28T21:59:55.957 INFO:teuthology.orchestra.run.smithi074.stderr:--2019-11-28 21:59:55-- https://services.gradle.org/distributions/gradle-4.7-bin.zip 2019-11-28T21:59:55.973 INFO:teuthology.orchestra.run.smithi074.stderr:Resolving services.gradle.org (services.gradle.org)... 104.18.191.9, 104.18.190.9, 2606:4700::6812:bf09, ... 2019-11-28T21:59:55.981 INFO:teuthology.orchestra.run.smithi074.stderr:Connecting to services.gradle.org (services.gradle.org)|104.18.191.9|:443... connected. 2019-11-28T21:59:56.015 INFO:teuthology.orchestra.run.smithi074.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2019-11-28T21:59:56.015 INFO:teuthology.orchestra.run.smithi074.stderr:Location: https://downloads.gradle-dn.com/distributions/gradle-4.7-bin.zip [following] 2019-11-28T21:59:56.016 INFO:teuthology.orchestra.run.smithi074.stderr:--2019-11-28 21:59:56-- https://downloads.gradle-dn.com/distributions/gradle-4.7-bin.zip 2019-11-28T21:59:56.027 INFO:teuthology.orchestra.run.smithi074.stderr:Resolving downloads.gradle-dn.com (downloads.gradle-dn.com)... 104.17.160.20, 104.17.159.20, 2606:4700::6811:9f14, ... 2019-11-28T21:59:56.034 INFO:teuthology.orchestra.run.smithi074.stderr:Connecting to downloads.gradle-dn.com (downloads.gradle-dn.com)|104.17.160.20|:443... connected. 2019-11-28T21:59:56.076 INFO:teuthology.orchestra.run.smithi074.stderr:HTTP request sent, awaiting response... 200 OK 2019-11-28T21:59:56.076 INFO:teuthology.orchestra.run.smithi074.stderr:Length: 75323957 (72M) [application/zip] 2019-11-28T21:59:56.077 INFO:teuthology.orchestra.run.smithi074.stderr:Saving to: ‘gradle-4.7-bin.zip’ 2019-11-28T21:59:56.077 INFO:teuthology.orchestra.run.smithi074.stderr: 2019-11-28T21:59:56.083 INFO:teuthology.orchestra.run.smithi074.stderr: 0K .......... .......... .......... .......... .......... 0% 6.63M 11s 2019-11-28T21:59:56.084 INFO:teuthology.orchestra.run.smithi074.stderr: 50K .......... .......... .......... .......... .......... 0% 125M 6s 2019-11-28T21:59:56.101 INFO:teuthology.orchestra.run.smithi074.stderr: 100K .......... .......... .......... .......... .......... 0% 6.88M 7s 2019-11-28T21:59:56.101 INFO:teuthology.orchestra.run.smithi074.stderr: 150K .......... .......... .......... .......... .......... 0% 65.4M 6s 2019-11-28T21:59:56.102 INFO:teuthology.orchestra.run.smithi074.stderr: 200K .......... .......... .......... .......... .......... 0% 97.0M 5s 2019-11-28T21:59:56.102 INFO:teuthology.orchestra.run.smithi074.stderr: 250K .......... .......... .......... .......... .......... 0% 131M 4s 2019-11-28T21:59:56.102 INFO:teuthology.orchestra.run.smithi074.stderr: 300K .......... .......... .......... .......... .......... 0% 136M 4s 2019-11-28T21:59:56.102 INFO:teuthology.orchestra.run.smithi074.stderr: 350K .......... .......... .......... .......... .......... 0% 8.49M 4s 2019-11-28T21:59:56.102 INFO:teuthology.orchestra.run.smithi074.stderr: 400K .......... .......... .......... .......... .......... 0% 134M 4s 2019-11-28T21:59:56.102 INFO:teuthology.orchestra.run.smithi074.stderr: 450K .......... .......... .......... .......... .......... 0% 123M 3s 2019-11-28T21:59:56.102 INFO:teuthology.orchestra.run.smithi074.stderr: 500K .......... .......... .......... .......... .......... 0% 115M 3s 2019-11-28T21:59:56.103 INFO:teuthology.orchestra.run.smithi074.stderr: 550K .......... .......... .......... .......... .......... 0% 125M 3s 2019-11-28T21:59:56.103 INFO:teuthology.orchestra.run.smithi074.stderr: 600K .......... .......... .......... .......... .......... 0% 117M 3s 2019-11-28T21:59:56.103 INFO:teuthology.orchestra.run.smithi074.stderr: 650K .......... .......... .......... .......... .......... 0% 122M 3s 2019-11-28T21:59:57.243 INFO:teuthology.orchestra.run.smithi074.stderr: 700K .......... .......... .......... .......... .......... 1% 9.63M 3s 2019-11-28T21:59:57.244 INFO:teuthology.orchestra.run.smithi074.stderr: 750K .......... .......... .......... .......... .......... 1% 80.4M 3s 2019-11-28T21:59:57.244 INFO:teuthology.orchestra.run.smithi074.stderr: 800K .......... .......... .......... .......... .......... 1% 200M 3s 2019-11-28T21:59:57.244 INFO:teuthology.orchestra.run.smithi074.stderr: 850K .......... .......... .......... .......... .......... 1% 137M 3s 2019-11-28T21:59:57.244 INFO:teuthology.orchestra.run.smithi074.stderr: 900K .......... .......... .......... .......... .......... 1% 133M 2s 2019-11-28T21:59:57.244 INFO:teuthology.orchestra.run.smithi074.stderr: 950K .......... .......... .......... .......... .......... 1% 120M 2s 2019-11-28T21:59:57.244 INFO:teuthology.orchestra.run.smithi074.stderr: 1000K .......... .......... .......... .......... .......... 1% 122M 2s 2019-11-28T21:59:57.244 INFO:teuthology.orchestra.run.smithi074.stderr: 1050K .......... .......... .......... .......... .......... 1% 156M 2s 2019-11-28T21:59:57.245 INFO:teuthology.orchestra.run.smithi074.stderr: 1100K .......... .......... .......... .......... .......... 1% 136M 2s 2019-11-28T21:59:57.245 INFO:teuthology.orchestra.run.smithi074.stderr: 1150K .......... .......... .......... .......... .......... 1% 101M 2s 2019-11-28T21:59:57.245 INFO:teuthology.orchestra.run.smithi074.stderr: 1200K .......... .......... .......... .......... .......... 1% 106M 2s 2019-11-28T21:59:57.245 INFO:teuthology.orchestra.run.smithi074.stderr: 1250K .......... .......... .......... .......... .......... 1% 147M 2s 2019-11-28T21:59:57.245 INFO:teuthology.orchestra.run.smithi074.stderr: 1300K .......... .......... .......... .......... .......... 1% 159M 2s 2019-11-28T21:59:57.245 INFO:teuthology.orchestra.run.smithi074.stderr: 1350K .......... .......... .......... .......... .......... 1% 108M 2s 2019-11-28T21:59:57.245 INFO:teuthology.orchestra.run.smithi074.stderr: 1400K .......... .......... .......... .......... .......... 1% 21.3M 2s 2019-11-28T21:59:57.246 INFO:teuthology.orchestra.run.smithi074.stderr: 1450K .......... .......... .......... .......... .......... 2% 201M 2s 2019-11-28T21:59:57.246 INFO:teuthology.orchestra.run.smithi074.stderr: 1500K .......... .......... .......... .......... .......... 2% 140M 2s 2019-11-28T21:59:57.246 INFO:teuthology.orchestra.run.smithi074.stderr: 1550K .......... .......... .......... .......... .......... 2% 115M 2s 2019-11-28T21:59:57.246 INFO:teuthology.orchestra.run.smithi074.stderr: 1600K .......... .......... .......... .......... .......... 2% 150M 2s 2019-11-28T21:59:57.246 INFO:teuthology.orchestra.run.smithi074.stderr: 1650K .......... .......... .......... .......... .......... 2% 148M 2s 2019-11-28T21:59:57.246 INFO:teuthology.orchestra.run.smithi074.stderr: 1700K .......... .......... .......... .......... .......... 2% 150M 2s 2019-11-28T21:59:57.246 INFO:teuthology.orchestra.run.smithi074.stderr: 1750K .......... .......... .......... .......... .......... 2% 135M 2s 2019-11-28T21:59:57.247 INFO:teuthology.orchestra.run.smithi074.stderr: 1800K .......... .......... .......... .......... .......... 2% 143M 2s 2019-11-28T21:59:57.247 INFO:teuthology.orchestra.run.smithi074.stderr: 1850K .......... .......... .......... .......... .......... 2% 125M 2s 2019-11-28T21:59:57.247 INFO:teuthology.orchestra.run.smithi074.stderr: 1900K .......... .......... .......... .......... .......... 2% 145M 2s 2019-11-28T21:59:57.247 INFO:teuthology.orchestra.run.smithi074.stderr: 1950K .......... .......... .......... .......... .......... 2% 137M 1s 2019-11-28T21:59:57.247 INFO:teuthology.orchestra.run.smithi074.stderr: 2000K .......... .......... .......... .......... .......... 2% 162M 1s 2019-11-28T21:59:57.247 INFO:teuthology.orchestra.run.smithi074.stderr: 2050K .......... .......... .......... .......... .......... 2% 155M 1s 2019-11-28T21:59:57.247 INFO:teuthology.orchestra.run.smithi074.stderr: 2100K .......... .......... .......... .......... .......... 2% 160M 1s 2019-11-28T21:59:57.248 INFO:teuthology.orchestra.run.smithi074.stderr: 2150K .......... .......... .......... .......... .......... 2% 144M 1s 2019-11-28T21:59:57.248 INFO:teuthology.orchestra.run.smithi074.stderr: 2200K .......... .......... .......... .......... .......... 3% 156M 1s 2019-11-28T21:59:57.248 INFO:teuthology.orchestra.run.smithi074.stderr: 2250K .......... .......... .......... .......... .......... 3% 157M 1s 2019-11-28T21:59:57.248 INFO:teuthology.orchestra.run.smithi074.stderr: 2300K .......... .......... .......... .......... .......... 3% 151M 1s 2019-11-28T21:59:57.248 INFO:teuthology.orchestra.run.smithi074.stderr: 2350K .......... .......... .......... .......... .......... 3% 105M 1s 2019-11-28T21:59:57.248 INFO:teuthology.orchestra.run.smithi074.stderr: 2400K .......... .......... .......... .......... .......... 3% 126M 1s 2019-11-28T21:59:57.248 INFO:teuthology.orchestra.run.smithi074.stderr: 2450K .......... .......... .......... .......... .......... 3% 166M 1s 2019-11-28T21:59:57.249 INFO:teuthology.orchestra.run.smithi074.stderr: 2500K .......... .......... .......... .......... .......... 3% 126M 1s 2019-11-28T21:59:57.249 INFO:teuthology.orchestra.run.smithi074.stderr: 2550K .......... .......... .......... .......... .......... 3% 122M 1s 2019-11-28T21:59:57.249 INFO:teuthology.orchestra.run.smithi074.stderr: 2600K .......... .......... .......... .......... .......... 3% 162M 1s 2019-11-28T21:59:57.249 INFO:teuthology.orchestra.run.smithi074.stderr: 2650K .......... .......... .......... .......... .......... 3% 160M 1s 2019-11-28T21:59:57.249 INFO:teuthology.orchestra.run.smithi074.stderr: 2700K .......... .......... .......... .......... .......... 3% 162M 1s 2019-11-28T21:59:57.249 INFO:teuthology.orchestra.run.smithi074.stderr: 2750K .......... .......... .......... .......... .......... 3% 140M 1s 2019-11-28T21:59:57.249 INFO:teuthology.orchestra.run.smithi074.stderr: 2800K .......... .......... .......... .......... .......... 3% 163M 1s 2019-11-28T21:59:57.250 INFO:teuthology.orchestra.run.smithi074.stderr: 2850K .......... .......... .......... .......... .......... 3% 161M 1s 2019-11-28T21:59:57.250 INFO:teuthology.orchestra.run.smithi074.stderr: 2900K .......... .......... .......... .......... .......... 4% 164M 1s 2019-11-28T21:59:57.250 INFO:teuthology.orchestra.run.smithi074.stderr: 2950K .......... .......... .......... .......... .......... 4% 132M 1s 2019-11-28T21:59:57.250 INFO:teuthology.orchestra.run.smithi074.stderr: 3000K .......... .......... .......... .......... .......... 4% 161M 1s 2019-11-28T21:59:57.250 INFO:teuthology.orchestra.run.smithi074.stderr: 3050K .......... .......... .......... .......... .......... 4% 159M 1s 2019-11-28T21:59:57.250 INFO:teuthology.orchestra.run.smithi074.stderr: 3100K .......... .......... .......... .......... .......... 4% 156M 1s 2019-11-28T21:59:57.250 INFO:teuthology.orchestra.run.smithi074.stderr: 3150K .......... .......... .......... .......... .......... 4% 126M 1s 2019-11-28T21:59:57.250 INFO:teuthology.orchestra.run.smithi074.stderr: 3200K .......... .......... .......... .......... .......... 4% 151M 1s 2019-11-28T21:59:57.251 INFO:teuthology.orchestra.run.smithi074.stderr: 3250K .......... .......... .......... .......... .......... 4% 143M 1s 2019-11-28T21:59:57.251 INFO:teuthology.orchestra.run.smithi074.stderr: 3300K .......... .......... .......... .......... .......... 4% 144M 1s 2019-11-28T21:59:57.251 INFO:teuthology.orchestra.run.smithi074.stderr: 3350K .......... .......... .......... .......... .......... 4% 140M 1s 2019-11-28T21:59:57.251 INFO:teuthology.orchestra.run.smithi074.stderr: 3400K .......... .......... .......... .......... .......... 4% 148M 1s 2019-11-28T21:59:57.251 INFO:teuthology.orchestra.run.smithi074.stderr: 3450K .......... .......... .......... .......... .......... 4% 163M 1s 2019-11-28T21:59:57.251 INFO:teuthology.orchestra.run.smithi074.stderr: 3500K .......... .......... .......... .......... .......... 4% 156M 1s 2019-11-28T21:59:57.251 INFO:teuthology.orchestra.run.smithi074.stderr: 3550K .......... .......... .......... .......... .......... 4% 134M 1s 2019-11-28T21:59:57.251 INFO:teuthology.orchestra.run.smithi074.stderr: 3600K .......... .......... .......... .......... .......... 4% 168M 1s 2019-11-28T21:59:57.252 INFO:teuthology.orchestra.run.smithi074.stderr: 3650K .......... .......... .......... .......... .......... 5% 166M 1s 2019-11-28T21:59:57.252 INFO:teuthology.orchestra.run.smithi074.stderr: 3700K .......... .......... .......... .......... .......... 5% 163M 1s 2019-11-28T21:59:57.252 INFO:teuthology.orchestra.run.smithi074.stderr: 3750K .......... .......... .......... .......... .......... 5% 144M 1s 2019-11-28T21:59:57.252 INFO:teuthology.orchestra.run.smithi074.stderr: 3800K .......... .......... .......... .......... .......... 5% 163M 1s 2019-11-28T21:59:57.252 INFO:teuthology.orchestra.run.smithi074.stderr: 3850K .......... .......... .......... .......... .......... 5% 166M 1s 2019-11-28T21:59:57.252 INFO:teuthology.orchestra.run.smithi074.stderr: 3900K .......... .......... .......... .......... .......... 5% 156M 1s 2019-11-28T21:59:57.252 INFO:teuthology.orchestra.run.smithi074.stderr: 3950K .......... .......... .......... .......... .......... 5% 134M 1s 2019-11-28T21:59:57.253 INFO:teuthology.orchestra.run.smithi074.stderr: 4000K .......... .......... .......... .......... .......... 5% 161M 1s 2019-11-28T21:59:57.253 INFO:teuthology.orchestra.run.smithi074.stderr: 4050K .......... .......... .......... .......... .......... 5% 167M 1s 2019-11-28T21:59:57.253 INFO:teuthology.orchestra.run.smithi074.stderr: 4100K .......... .......... .......... .......... .......... 5% 155M 1s 2019-11-28T21:59:57.253 INFO:teuthology.orchestra.run.smithi074.stderr: 4150K .......... .......... .......... .......... .......... 5% 144M 1s 2019-11-28T21:59:57.253 INFO:teuthology.orchestra.run.smithi074.stderr: 4200K .......... .......... .......... .......... .......... 5% 158M 1s 2019-11-28T21:59:57.253 INFO:teuthology.orchestra.run.smithi074.stderr: 4250K .......... .......... .......... .......... .......... 5% 155M 1s 2019-11-28T21:59:57.253 INFO:teuthology.orchestra.run.smithi074.stderr: 4300K .......... .......... .......... .......... .......... 5% 119M 1s 2019-11-28T21:59:57.254 INFO:teuthology.orchestra.run.smithi074.stderr: 4350K .......... .......... .......... .......... .......... 5% 125M 1s 2019-11-28T21:59:57.254 INFO:teuthology.orchestra.run.smithi074.stderr: 4400K .......... .......... .......... .......... .......... 6% 170M 1s 2019-11-28T21:59:57.254 INFO:teuthology.orchestra.run.smithi074.stderr: 4450K .......... .......... .......... .......... .......... 6% 153M 1s 2019-11-28T21:59:57.254 INFO:teuthology.orchestra.run.smithi074.stderr: 4500K .......... .......... .......... .......... .......... 6% 160M 1s 2019-11-28T21:59:57.254 INFO:teuthology.orchestra.run.smithi074.stderr: 4550K .......... .......... .......... .......... .......... 6% 132M 1s 2019-11-28T21:59:57.254 INFO:teuthology.orchestra.run.smithi074.stderr: 4600K .......... .......... .......... .......... .......... 6% 164M 1s 2019-11-28T21:59:57.254 INFO:teuthology.orchestra.run.smithi074.stderr: 4650K .......... .......... .......... .......... .......... 6% 168M 1s 2019-11-28T21:59:57.254 INFO:teuthology.orchestra.run.smithi074.stderr: 4700K .......... .......... .......... .......... .......... 6% 172M 1s 2019-11-28T21:59:57.255 INFO:teuthology.orchestra.run.smithi074.stderr: 4750K .......... .......... .......... .......... .......... 6% 151M 1s 2019-11-28T21:59:57.255 INFO:teuthology.orchestra.run.smithi074.stderr: 4800K .......... .......... .......... .......... .......... 6% 161M 1s 2019-11-28T21:59:57.255 INFO:teuthology.orchestra.run.smithi074.stderr: 4850K .......... .......... .......... .......... .......... 6% 168M 1s 2019-11-28T21:59:57.255 INFO:teuthology.orchestra.run.smithi074.stderr: 4900K .......... .......... .......... .......... .......... 6% 170M 1s 2019-11-28T21:59:57.255 INFO:teuthology.orchestra.run.smithi074.stderr: 4950K .......... .......... .......... .......... .......... 6% 129M 1s 2019-11-28T21:59:57.255 INFO:teuthology.orchestra.run.smithi074.stderr: 5000K .......... .......... .......... .......... .......... 6% 178M 1s 2019-11-28T21:59:57.255 INFO:teuthology.orchestra.run.smithi074.stderr: 5050K .......... .......... .......... .......... .......... 6% 179M 1s 2019-11-28T21:59:57.256 INFO:teuthology.orchestra.run.smithi074.stderr: 5100K .......... .......... .......... .......... .......... 7% 172M 1s 2019-11-28T21:59:57.256 INFO:teuthology.orchestra.run.smithi074.stderr: 5150K .......... .......... .......... .......... .......... 7% 154M 1s 2019-11-28T21:59:57.256 INFO:teuthology.orchestra.run.smithi074.stderr: 5200K .......... .......... .......... .......... .......... 7% 173M 1s 2019-11-28T21:59:57.256 INFO:teuthology.orchestra.run.smithi074.stderr: 5250K .......... .......... .......... .......... .......... 7% 175M 1s 2019-11-28T21:59:57.256 INFO:teuthology.orchestra.run.smithi074.stderr: 5300K .......... .......... .......... .......... .......... 7% 174M 1s 2019-11-28T21:59:57.256 INFO:teuthology.orchestra.run.smithi074.stderr: 5350K .......... .......... .......... .......... .......... 7% 134M 1s 2019-11-28T21:59:57.256 INFO:teuthology.orchestra.run.smithi074.stderr: 5400K .......... .......... .......... .......... .......... 7% 176M 1s 2019-11-28T21:59:57.257 INFO:teuthology.orchestra.run.smithi074.stderr: 5450K .......... .......... .......... .......... .......... 7% 176M 1s 2019-11-28T21:59:57.257 INFO:teuthology.orchestra.run.smithi074.stderr: 5500K .......... .......... .......... .......... .......... 7% 138M 1s 2019-11-28T21:59:57.257 INFO:teuthology.orchestra.run.smithi074.stderr: 5550K .......... .......... .......... .......... .......... 7% 149M 1s 2019-11-28T21:59:57.257 INFO:teuthology.orchestra.run.smithi074.stderr: 5600K .......... .......... .......... .......... .......... 7% 174M 1s 2019-11-28T21:59:57.257 INFO:teuthology.orchestra.run.smithi074.stderr: 5650K .......... .......... .......... .......... .......... 7% 164M 1s 2019-11-28T21:59:57.257 INFO:teuthology.orchestra.run.smithi074.stderr: 5700K .......... .......... .......... .......... .......... 7% 164M 1s 2019-11-28T21:59:57.257 INFO:teuthology.orchestra.run.smithi074.stderr: 5750K .......... .......... .......... .......... .......... 7% 135M 1s 2019-11-28T21:59:57.257 INFO:teuthology.orchestra.run.smithi074.stderr: 5800K .......... .......... .......... .......... .......... 7% 166M 1s 2019-11-28T21:59:57.258 INFO:teuthology.orchestra.run.smithi074.stderr: 5850K .......... .......... .......... .......... .......... 8% 165M 1s 2019-11-28T21:59:57.258 INFO:teuthology.orchestra.run.smithi074.stderr: 5900K .......... .......... .......... .......... .......... 8% 181M 1s 2019-11-28T21:59:57.258 INFO:teuthology.orchestra.run.smithi074.stderr: 5950K .......... .......... .......... .......... .......... 8% 146M 1s 2019-11-28T21:59:57.258 INFO:teuthology.orchestra.run.smithi074.stderr: 6000K .......... .......... .......... .......... .......... 8% 175M 1s 2019-11-28T21:59:57.258 INFO:teuthology.orchestra.run.smithi074.stderr: 6050K .......... .......... .......... .......... .......... 8% 180M 1s 2019-11-28T21:59:57.258 INFO:teuthology.orchestra.run.smithi074.stderr: 6100K .......... .......... .......... .......... .......... 8% 177M 1s 2019-11-28T21:59:57.258 INFO:teuthology.orchestra.run.smithi074.stderr: 6150K .......... .......... .......... .......... .......... 8% 142M 1s 2019-11-28T21:59:57.259 INFO:teuthology.orchestra.run.smithi074.stderr: 6200K .......... .......... .......... .......... .......... 8% 176M 1s 2019-11-28T21:59:57.259 INFO:teuthology.orchestra.run.smithi074.stderr: 6250K .......... .......... .......... .......... .......... 8% 181M 1s 2019-11-28T21:59:57.259 INFO:teuthology.orchestra.run.smithi074.stderr: 6300K .......... .......... .......... .......... .......... 8% 177M 1s 2019-11-28T21:59:57.259 INFO:teuthology.orchestra.run.smithi074.stderr: 6350K .......... .......... .......... .......... .......... 8% 159M 1s 2019-11-28T21:59:57.259 INFO:teuthology.orchestra.run.smithi074.stderr: 6400K .......... .......... .......... .......... .......... 8% 178M 1s 2019-11-28T21:59:57.259 INFO:teuthology.orchestra.run.smithi074.stderr: 6450K .......... .......... .......... .......... .......... 8% 162M 1s 2019-11-28T21:59:57.259 INFO:teuthology.orchestra.run.smithi074.stderr: 6500K .......... .......... .......... .......... .......... 8% 135M 1s 2019-11-28T21:59:57.260 INFO:teuthology.orchestra.run.smithi074.stderr: 6550K .......... .......... .......... .......... .......... 8% 152M 1s 2019-11-28T21:59:57.260 INFO:teuthology.orchestra.run.smithi074.stderr: 6600K .......... .......... .......... .......... .......... 9% 143M 1s 2019-11-28T21:59:57.260 INFO:teuthology.orchestra.run.smithi074.stderr: 6650K .......... .......... .......... .......... .......... 9% 156M 1s 2019-11-28T21:59:57.260 INFO:teuthology.orchestra.run.smithi074.stderr: 6700K .......... .......... .......... .......... .......... 9% 168M 1s 2019-11-28T21:59:57.260 INFO:teuthology.orchestra.run.smithi074.stderr: 6750K .......... .......... .......... .......... .......... 9% 140M 1s 2019-11-28T21:59:57.260 INFO:teuthology.orchestra.run.smithi074.stderr: 6800K .......... .......... .......... .......... .......... 9% 179M 1s 2019-11-28T21:59:57.260 INFO:teuthology.orchestra.run.smithi074.stderr: 6850K .......... .......... .......... .......... .......... 9% 180M 1s 2019-11-28T21:59:57.261 INFO:teuthology.orchestra.run.smithi074.stderr: 6900K .......... .......... .......... .......... .......... 9% 167M 1s 2019-11-28T21:59:57.261 INFO:teuthology.orchestra.run.smithi074.stderr: 6950K .......... .......... .......... .......... .......... 9% 132M 1s 2019-11-28T21:59:57.261 INFO:teuthology.orchestra.run.smithi074.stderr: 7000K .......... .......... .......... .......... .......... 9% 162M 1s 2019-11-28T21:59:57.261 INFO:teuthology.orchestra.run.smithi074.stderr: 7050K .......... .......... .......... .......... .......... 9% 170M 1s 2019-11-28T21:59:57.261 INFO:teuthology.orchestra.run.smithi074.stderr: 7100K .......... .......... .......... .......... .......... 9% 165M 1s 2019-11-28T21:59:57.261 INFO:teuthology.orchestra.run.smithi074.stderr: 7150K .......... .......... .......... .......... .......... 9% 155M 1s 2019-11-28T21:59:57.261 INFO:teuthology.orchestra.run.smithi074.stderr: 7200K .......... .......... .......... .......... .......... 9% 178M 1s 2019-11-28T21:59:57.262 INFO:teuthology.orchestra.run.smithi074.stderr: 7250K .......... .......... .......... .......... .......... 9% 174M 1s 2019-11-28T21:59:57.262 INFO:teuthology.orchestra.run.smithi074.stderr: 7300K .......... .......... .......... .......... .......... 9% 171M 1s 2019-11-28T21:59:57.262 INFO:teuthology.orchestra.run.smithi074.stderr: 7350K .......... .......... .......... .......... .......... 10% 148M 1s 2019-11-28T21:59:57.262 INFO:teuthology.orchestra.run.smithi074.stderr: 7400K .......... .......... .......... .......... .......... 10% 177M 1s 2019-11-28T21:59:57.262 INFO:teuthology.orchestra.run.smithi074.stderr: 7450K .......... .......... .......... .......... .......... 10% 162M 1s 2019-11-28T21:59:57.262 INFO:teuthology.orchestra.run.smithi074.stderr: 7500K .......... .......... .......... .......... .......... 10% 185M 1s 2019-11-28T21:59:57.262 INFO:teuthology.orchestra.run.smithi074.stderr: 7550K .......... .......... .......... .......... .......... 10% 160M 1s 2019-11-28T21:59:57.262 INFO:teuthology.orchestra.run.smithi074.stderr: 7600K .......... .......... .......... .......... .......... 10% 181M 1s 2019-11-28T21:59:57.263 INFO:teuthology.orchestra.run.smithi074.stderr: 7650K .......... .......... .......... .......... .......... 10% 186M 1s 2019-11-28T21:59:57.263 INFO:teuthology.orchestra.run.smithi074.stderr: 7700K .......... .......... .......... .......... .......... 10% 137M 1s 2019-11-28T21:59:57.263 INFO:teuthology.orchestra.run.smithi074.stderr: 7750K .......... .......... .......... .......... .......... 10% 140M 1s 2019-11-28T21:59:57.263 INFO:teuthology.orchestra.run.smithi074.stderr: 7800K .......... .......... .......... .......... .......... 10% 144M 1s 2019-11-28T21:59:57.263 INFO:teuthology.orchestra.run.smithi074.stderr: 7850K .......... .......... .......... .......... .......... 10% 172M 1s 2019-11-28T21:59:57.263 INFO:teuthology.orchestra.run.smithi074.stderr: 7900K .......... .......... .......... .......... .......... 10% 156M 1s 2019-11-28T21:59:57.263 INFO:teuthology.orchestra.run.smithi074.stderr: 7950K .......... .......... .......... .......... .......... 10% 143M 1s 2019-11-28T21:59:57.264 INFO:teuthology.orchestra.run.smithi074.stderr: 8000K .......... .......... .......... .......... .......... 10% 168M 1s 2019-11-28T21:59:57.264 INFO:teuthology.orchestra.run.smithi074.stderr: 8050K .......... .......... .......... .......... .......... 11% 186M 1s 2019-11-28T21:59:57.264 INFO:teuthology.orchestra.run.smithi074.stderr: 8100K .......... .......... .......... .......... .......... 11% 182M 1s 2019-11-28T21:59:57.264 INFO:teuthology.orchestra.run.smithi074.stderr: 8150K .......... .......... .......... .......... .......... 11% 148M 1s 2019-11-28T21:59:57.264 INFO:teuthology.orchestra.run.smithi074.stderr: 8200K .......... .......... .......... .......... .......... 11% 184M 1s 2019-11-28T21:59:57.264 INFO:teuthology.orchestra.run.smithi074.stderr: 8250K .......... .......... .......... .......... .......... 11% 180M 1s 2019-11-28T21:59:57.264 INFO:teuthology.orchestra.run.smithi074.stderr: 8300K .......... .......... .......... .......... .......... 11% 171M 1s 2019-11-28T21:59:57.265 INFO:teuthology.orchestra.run.smithi074.stderr: 8350K .......... .......... .......... .......... .......... 11% 153M 1s 2019-11-28T21:59:57.265 INFO:teuthology.orchestra.run.smithi074.stderr: 8400K .......... .......... .......... .......... .......... 11% 189M 1s 2019-11-28T21:59:57.265 INFO:teuthology.orchestra.run.smithi074.stderr: 8450K .......... .......... .......... .......... .......... 11% 177M 1s 2019-11-28T21:59:57.265 INFO:teuthology.orchestra.run.smithi074.stderr: 8500K .......... .......... .......... .......... .......... 11% 183M 1s 2019-11-28T21:59:57.265 INFO:teuthology.orchestra.run.smithi074.stderr: 8550K .......... .......... .......... .......... .......... 11% 151M 1s 2019-11-28T21:59:57.265 INFO:teuthology.orchestra.run.smithi074.stderr: 8600K .......... .......... .......... .......... .......... 11% 185M 1s 2019-11-28T21:59:57.265 INFO:teuthology.orchestra.run.smithi074.stderr: 8650K .......... .......... .......... .......... .......... 11% 182M 1s 2019-11-28T21:59:57.266 INFO:teuthology.orchestra.run.smithi074.stderr: 8700K .......... .......... .......... .......... .......... 11% 188M 1s 2019-11-28T21:59:57.266 INFO:teuthology.orchestra.run.smithi074.stderr: 8750K .......... .......... .......... .......... .......... 11% 170M 1s 2019-11-28T21:59:57.266 INFO:teuthology.orchestra.run.smithi074.stderr: 8800K .......... .......... .......... .......... .......... 12% 171M 1s 2019-11-28T21:59:57.266 INFO:teuthology.orchestra.run.smithi074.stderr: 8850K .......... .......... .......... .......... .......... 12% 186M 1s 2019-11-28T21:59:57.266 INFO:teuthology.orchestra.run.smithi074.stderr: 8900K .......... .......... .......... .......... .......... 12% 192M 1s 2019-11-28T21:59:57.266 INFO:teuthology.orchestra.run.smithi074.stderr: 8950K .......... .......... .......... .......... .......... 12% 160M 1s 2019-11-28T21:59:57.266 INFO:teuthology.orchestra.run.smithi074.stderr: 9000K .......... .......... .......... .......... .......... 12% 190M 1s 2019-11-28T21:59:57.267 INFO:teuthology.orchestra.run.smithi074.stderr: 9050K .......... .......... .......... .......... .......... 12% 185M 1s 2019-11-28T21:59:57.267 INFO:teuthology.orchestra.run.smithi074.stderr: 9100K .......... .......... .......... .......... .......... 12% 191M 1s 2019-11-28T21:59:57.267 INFO:teuthology.orchestra.run.smithi074.stderr: 9150K .......... .......... .......... .......... .......... 12% 165M 1s 2019-11-28T21:59:57.267 INFO:teuthology.orchestra.run.smithi074.stderr: 9200K .......... .......... .......... .......... .......... 12% 156M 1s 2019-11-28T21:59:57.267 INFO:teuthology.orchestra.run.smithi074.stderr: 9250K .......... .......... .......... .......... .......... 12% 168M 1s 2019-11-28T21:59:57.267 INFO:teuthology.orchestra.run.smithi074.stderr: 9300K .......... .......... .......... .......... .......... 12% 154M 1s 2019-11-28T21:59:57.267 INFO:teuthology.orchestra.run.smithi074.stderr: 9350K .......... .......... .......... .......... .......... 12% 157M 1s 2019-11-28T21:59:57.267 INFO:teuthology.orchestra.run.smithi074.stderr: 9400K .......... .......... .......... .......... .......... 12% 155M 1s 2019-11-28T21:59:57.268 INFO:teuthology.orchestra.run.smithi074.stderr: 9450K .......... .......... .......... .......... .......... 12% 148M 1s 2019-11-28T21:59:57.268 INFO:teuthology.orchestra.run.smithi074.stderr: 9500K .......... .......... .......... .......... .......... 12% 191M 1s 2019-11-28T21:59:57.268 INFO:teuthology.orchestra.run.smithi074.stderr: 9550K .......... .......... .......... .......... .......... 13% 162M 1s 2019-11-28T21:59:57.268 INFO:teuthology.orchestra.run.smithi074.stderr: 9600K .......... .......... .......... .......... .......... 13% 186M 1s 2019-11-28T21:59:57.268 INFO:teuthology.orchestra.run.smithi074.stderr: 9650K .......... .......... .......... .......... .......... 13% 187M 1s 2019-11-28T21:59:57.268 INFO:teuthology.orchestra.run.smithi074.stderr: 9700K .......... .......... .......... .......... .......... 13% 191M 1s 2019-11-28T21:59:57.268 INFO:teuthology.orchestra.run.smithi074.stderr: 9750K .......... .......... .......... .......... .......... 13% 155M 1s 2019-11-28T21:59:57.269 INFO:teuthology.orchestra.run.smithi074.stderr: 9800K .......... .......... .......... .......... .......... 13% 186M 1s 2019-11-28T21:59:57.269 INFO:teuthology.orchestra.run.smithi074.stderr: 9850K .......... .......... .......... .......... .......... 13% 198M 1s 2019-11-28T21:59:57.269 INFO:teuthology.orchestra.run.smithi074.stderr: 9900K .......... .......... .......... .......... .......... 13% 175M 1s 2019-11-28T21:59:57.269 INFO:teuthology.orchestra.run.smithi074.stderr: 9950K .......... .......... .......... .......... .......... 13% 176M 1s 2019-11-28T21:59:57.269 INFO:teuthology.orchestra.run.smithi074.stderr: 10000K .......... .......... .......... .......... .......... 13% 180M 1s 2019-11-28T21:59:57.269 INFO:teuthology.orchestra.run.smithi074.stderr: 10050K .......... .......... .......... .......... .......... 13% 190M 1s 2019-11-28T21:59:57.269 INFO:teuthology.orchestra.run.smithi074.stderr: 10100K .......... .......... .......... .......... .......... 13% 177M 1s 2019-11-28T21:59:57.270 INFO:teuthology.orchestra.run.smithi074.stderr: 10150K .......... .......... .......... .......... .......... 13% 163M 1s 2019-11-28T21:59:57.270 INFO:teuthology.orchestra.run.smithi074.stderr: 10200K .......... .......... .......... .......... .......... 13% 160M 1s 2019-11-28T21:59:57.270 INFO:teuthology.orchestra.run.smithi074.stderr: 10250K .......... .......... .......... .......... .......... 14% 167M 1s 2019-11-28T21:59:57.270 INFO:teuthology.orchestra.run.smithi074.stderr: 10300K .......... .......... .......... .......... .......... 14% 169M 1s 2019-11-28T21:59:57.270 INFO:teuthology.orchestra.run.smithi074.stderr: 10350K .......... .......... .......... .......... .......... 14% 174M 1s 2019-11-28T21:59:57.270 INFO:teuthology.orchestra.run.smithi074.stderr: 10400K .......... .......... .......... .......... .......... 14% 159M 1s 2019-11-28T21:59:57.270 INFO:teuthology.orchestra.run.smithi074.stderr: 10450K .......... .......... .......... .......... .......... 14% 156M 1s 2019-11-28T21:59:57.270 INFO:teuthology.orchestra.run.smithi074.stderr: 10500K .......... .......... .......... .......... .......... 14% 161M 1s 2019-11-28T21:59:57.271 INFO:teuthology.orchestra.run.smithi074.stderr: 10550K .......... .......... .......... .......... .......... 14% 145M 1s 2019-11-28T21:59:57.271 INFO:teuthology.orchestra.run.smithi074.stderr: 10600K .......... .......... .......... .......... .......... 14% 184M 1s 2019-11-28T21:59:57.271 INFO:teuthology.orchestra.run.smithi074.stderr: 10650K .......... .......... .......... .......... .......... 14% 177M 1s 2019-11-28T21:59:57.271 INFO:teuthology.orchestra.run.smithi074.stderr: 10700K .......... .......... .......... .......... .......... 14% 188M 1s 2019-11-28T21:59:57.271 INFO:teuthology.orchestra.run.smithi074.stderr: 10750K .......... .......... .......... .......... .......... 14% 171M 1s 2019-11-28T21:59:57.271 INFO:teuthology.orchestra.run.smithi074.stderr: 10800K .......... .......... .......... .......... .......... 14% 188M 1s 2019-11-28T21:59:57.271 INFO:teuthology.orchestra.run.smithi074.stderr: 10850K .......... .......... .......... .......... .......... 14% 192M 1s 2019-11-28T21:59:57.272 INFO:teuthology.orchestra.run.smithi074.stderr: 10900K .......... .......... .......... .......... .......... 14% 195M 1s 2019-11-28T21:59:57.272 INFO:teuthology.orchestra.run.smithi074.stderr: 10950K .......... .......... .......... .......... .......... 14% 153M 1s 2019-11-28T21:59:57.272 INFO:teuthology.orchestra.run.smithi074.stderr: 11000K .......... .......... .......... .......... .......... 15% 189M 1s 2019-11-28T21:59:57.272 INFO:teuthology.orchestra.run.smithi074.stderr: 11050K .......... .......... .......... .......... .......... 15% 195M 1s 2019-11-28T21:59:57.272 INFO:teuthology.orchestra.run.smithi074.stderr: 11100K .......... .......... .......... .......... .......... 15% 196M 1s 2019-11-28T21:59:57.272 INFO:teuthology.orchestra.run.smithi074.stderr: 11150K .......... .......... .......... .......... .......... 15% 171M 1s 2019-11-28T21:59:57.272 INFO:teuthology.orchestra.run.smithi074.stderr: 11200K .......... .......... .......... .......... .......... 15% 202M 1s 2019-11-28T21:59:57.272 INFO:teuthology.orchestra.run.smithi074.stderr: 11250K .......... .......... .......... .......... .......... 15% 198M 1s 2019-11-28T21:59:57.273 INFO:teuthology.orchestra.run.smithi074.stderr: 11300K .......... .......... .......... .......... .......... 15% 198M 1s 2019-11-28T21:59:57.273 INFO:teuthology.orchestra.run.smithi074.stderr: 11350K .......... .......... .......... .......... .......... 15% 159M 1s 2019-11-28T21:59:57.273 INFO:teuthology.orchestra.run.smithi074.stderr: 11400K .......... .......... .......... .......... .......... 15% 205M 1s 2019-11-28T21:59:57.273 INFO:teuthology.orchestra.run.smithi074.stderr: 11450K .......... .......... .......... .......... .......... 15% 197M 1s 2019-11-28T21:59:57.273 INFO:teuthology.orchestra.run.smithi074.stderr: 11500K .......... .......... .......... .......... .......... 15% 105M 1s 2019-11-28T21:59:57.273 INFO:teuthology.orchestra.run.smithi074.stderr: 11550K .......... .......... .......... .......... .......... 15% 171M 1s 2019-11-28T21:59:57.274 INFO:teuthology.orchestra.run.smithi074.stderr: 11600K .......... .......... .......... .......... .......... 15% 198M 1s 2019-11-28T21:59:57.274 INFO:teuthology.orchestra.run.smithi074.stderr: 11650K .......... .......... .......... .......... .......... 15% 256M 1s 2019-11-28T21:59:57.274 INFO:teuthology.orchestra.run.smithi074.stderr: 11700K .......... .......... .......... .......... .......... 15% 258M 1s 2019-11-28T21:59:57.274 INFO:teuthology.orchestra.run.smithi074.stderr: 11750K .......... .......... .......... .......... .......... 16% 244M 1s 2019-11-28T21:59:57.274 INFO:teuthology.orchestra.run.smithi074.stderr: 11800K .......... .......... .......... .......... .......... 16% 195M 1s 2019-11-28T21:59:57.274 INFO:teuthology.orchestra.run.smithi074.stderr: 11850K .......... .......... .......... .......... .......... 16% 147M 1s 2019-11-28T21:59:57.274 INFO:teuthology.orchestra.run.smithi074.stderr: 11900K .......... .......... .......... .......... .......... 16% 139M 1s 2019-11-28T21:59:57.274 INFO:teuthology.orchestra.run.smithi074.stderr: 11950K .......... .......... .......... .......... .......... 16% 161M 1s 2019-11-28T21:59:57.275 INFO:teuthology.orchestra.run.smithi074.stderr: 12000K .......... .......... .......... .......... .......... 16% 147M 1s 2019-11-28T21:59:57.275 INFO:teuthology.orchestra.run.smithi074.stderr: 12050K .......... .......... .......... .......... .......... 16% 166M 1s 2019-11-28T21:59:57.275 INFO:teuthology.orchestra.run.smithi074.stderr: 12100K .......... .......... .......... .......... .......... 16% 261M 1s 2019-11-28T21:59:57.275 INFO:teuthology.orchestra.run.smithi074.stderr: 12150K .......... .......... .......... .......... .......... 16% 249M 1s 2019-11-28T21:59:57.275 INFO:teuthology.orchestra.run.smithi074.stderr: 12200K .......... .......... .......... .......... .......... 16% 263M 1s 2019-11-28T21:59:57.275 INFO:teuthology.orchestra.run.smithi074.stderr: 12250K .......... .......... .......... .......... .......... 16% 271M 1s 2019-11-28T21:59:57.275 INFO:teuthology.orchestra.run.smithi074.stderr: 12300K .......... .......... .......... .......... .......... 16% 239M 1s 2019-11-28T21:59:57.276 INFO:teuthology.orchestra.run.smithi074.stderr: 12350K .......... .......... .......... .......... .......... 16% 163M 1s 2019-11-28T21:59:57.276 INFO:teuthology.orchestra.run.smithi074.stderr: 12400K .......... .......... .......... .......... .......... 16% 187M 1s 2019-11-28T21:59:57.276 INFO:teuthology.orchestra.run.smithi074.stderr: 12450K .......... .......... .......... .......... .......... 16% 202M 1s 2019-11-28T21:59:57.276 INFO:teuthology.orchestra.run.smithi074.stderr: 12500K .......... .......... .......... .......... .......... 17% 202M 1s 2019-11-28T21:59:57.276 INFO:teuthology.orchestra.run.smithi074.stderr: 12550K .......... .......... .......... .......... .......... 17% 163M 1s 2019-11-28T21:59:57.276 INFO:teuthology.orchestra.run.smithi074.stderr: 12600K .......... .......... .......... .......... .......... 17% 202M 1s 2019-11-28T21:59:57.276 INFO:teuthology.orchestra.run.smithi074.stderr: 12650K .......... .......... .......... .......... .......... 17% 213M 1s 2019-11-28T21:59:57.277 INFO:teuthology.orchestra.run.smithi074.stderr: 12700K .......... .......... .......... .......... .......... 17% 197M 1s 2019-11-28T21:59:57.277 INFO:teuthology.orchestra.run.smithi074.stderr: 12750K .......... .......... .......... .......... .......... 17% 185M 0s 2019-11-28T21:59:57.277 INFO:teuthology.orchestra.run.smithi074.stderr: 12800K .......... .......... .......... .......... .......... 17% 207M 0s 2019-11-28T21:59:57.277 INFO:teuthology.orchestra.run.smithi074.stderr: 12850K .......... .......... .......... .......... .......... 17% 195M 0s 2019-11-28T21:59:57.277 INFO:teuthology.orchestra.run.smithi074.stderr: 12900K .......... .......... .......... .......... .......... 17% 178M 0s 2019-11-28T21:59:57.277 INFO:teuthology.orchestra.run.smithi074.stderr: 12950K .......... .......... .......... .......... .......... 17% 163M 0s 2019-11-28T21:59:57.277 INFO:teuthology.orchestra.run.smithi074.stderr: 13000K .......... .......... .......... .......... .......... 17% 165M 0s 2019-11-28T21:59:57.278 INFO:teuthology.orchestra.run.smithi074.stderr: 13050K .......... .......... .......... .......... .......... 17% 167M 0s 2019-11-28T21:59:57.278 INFO:teuthology.orchestra.run.smithi074.stderr: 13100K .......... .......... .......... .......... .......... 17% 170M 0s 2019-11-28T21:59:57.278 INFO:teuthology.orchestra.run.smithi074.stderr: 13150K .......... .......... .......... .......... .......... 17% 184M 0s 2019-11-28T21:59:57.278 INFO:teuthology.orchestra.run.smithi074.stderr: 13200K .......... .......... .......... .......... .......... 18% 184M 0s 2019-11-28T21:59:57.278 INFO:teuthology.orchestra.run.smithi074.stderr: 13250K .......... .......... .......... .......... .......... 18% 144M 0s 2019-11-28T21:59:57.278 INFO:teuthology.orchestra.run.smithi074.stderr: 13300K .......... .......... .......... .......... .......... 18% 206M 0s 2019-11-28T21:59:57.279 INFO:teuthology.orchestra.run.smithi074.stderr: 13350K .......... .......... .......... .......... .......... 18% 147M 0s 2019-11-28T21:59:57.279 INFO:teuthology.orchestra.run.smithi074.stderr: 13400K .......... .......... .......... .......... .......... 18% 210M 0s 2019-11-28T21:59:57.279 INFO:teuthology.orchestra.run.smithi074.stderr: 13450K .......... .......... .......... .......... .......... 18% 209M 0s 2019-11-28T21:59:57.279 INFO:teuthology.orchestra.run.smithi074.stderr: 13500K .......... .......... .......... .......... .......... 18% 210M 0s 2019-11-28T21:59:57.279 INFO:teuthology.orchestra.run.smithi074.stderr: 13550K .......... .......... .......... .......... .......... 18% 187M 0s 2019-11-28T21:59:57.279 INFO:teuthology.orchestra.run.smithi074.stderr: 13600K .......... .......... .......... .......... .......... 18% 192M 0s 2019-11-28T21:59:57.279 INFO:teuthology.orchestra.run.smithi074.stderr: 13650K .......... .......... .......... .......... .......... 18% 200M 0s 2019-11-28T21:59:57.279 INFO:teuthology.orchestra.run.smithi074.stderr: 13700K .......... .......... .......... .......... .......... 18% 208M 0s 2019-11-28T21:59:57.280 INFO:teuthology.orchestra.run.smithi074.stderr: 13750K .......... .......... .......... .......... .......... 18% 171M 0s 2019-11-28T21:59:57.280 INFO:teuthology.orchestra.run.smithi074.stderr: 13800K .......... .......... .......... .......... .......... 18% 211M 0s 2019-11-28T21:59:57.280 INFO:teuthology.orchestra.run.smithi074.stderr: 13850K .......... .......... .......... .......... .......... 18% 199M 0s 2019-11-28T21:59:57.280 INFO:teuthology.orchestra.run.smithi074.stderr: 13900K .......... .......... .......... .......... .......... 18% 176M 0s 2019-11-28T21:59:57.280 INFO:teuthology.orchestra.run.smithi074.stderr: 13950K .......... .......... .......... .......... .......... 19% 171M 0s 2019-11-28T21:59:57.280 INFO:teuthology.orchestra.run.smithi074.stderr: 14000K .......... .......... .......... .......... .......... 19% 202M 0s 2019-11-28T21:59:57.281 INFO:teuthology.orchestra.run.smithi074.stderr: 14050K .......... .......... .......... .......... .......... 19% 219M 0s 2019-11-28T21:59:57.281 INFO:teuthology.orchestra.run.smithi074.stderr: 14100K .......... .......... .......... .......... .......... 19% 215M 0s 2019-11-28T21:59:57.281 INFO:teuthology.orchestra.run.smithi074.stderr: 14150K .......... .......... .......... .......... .......... 19% 160M 0s 2019-11-28T21:59:57.281 INFO:teuthology.orchestra.run.smithi074.stderr: 14200K .......... .......... .......... .......... .......... 19% 156M 0s 2019-11-28T21:59:57.281 INFO:teuthology.orchestra.run.smithi074.stderr: 14250K .......... .......... .......... .......... .......... 19% 164M 0s 2019-11-28T21:59:57.281 INFO:teuthology.orchestra.run.smithi074.stderr: 14300K .......... .......... .......... .......... .......... 19% 173M 0s 2019-11-28T21:59:57.281 INFO:teuthology.orchestra.run.smithi074.stderr: 14350K .......... .......... .......... .......... .......... 19% 180M 0s 2019-11-28T21:59:57.281 INFO:teuthology.orchestra.run.smithi074.stderr: 14400K .......... .......... .......... .......... .......... 19% 196M 0s 2019-11-28T21:59:57.282 INFO:teuthology.orchestra.run.smithi074.stderr: 14450K .......... .......... .......... .......... .......... 19% 209M 0s 2019-11-28T21:59:57.282 INFO:teuthology.orchestra.run.smithi074.stderr: 14500K .......... .......... .......... .......... .......... 19% 197M 0s 2019-11-28T21:59:57.282 INFO:teuthology.orchestra.run.smithi074.stderr: 14550K .......... .......... .......... .......... .......... 19% 169M 0s 2019-11-28T21:59:57.282 INFO:teuthology.orchestra.run.smithi074.stderr: 14600K .......... .......... .......... .......... .......... 19% 200M 0s 2019-11-28T21:59:57.282 INFO:teuthology.orchestra.run.smithi074.stderr: 14650K .......... .......... .......... .......... .......... 19% 210M 0s 2019-11-28T21:59:57.282 INFO:teuthology.orchestra.run.smithi074.stderr: 14700K .......... .......... .......... .......... .......... 20% 197M 0s 2019-11-28T21:59:57.282 INFO:teuthology.orchestra.run.smithi074.stderr: 14750K .......... .......... .......... .......... .......... 20% 189M 0s 2019-11-28T21:59:57.283 INFO:teuthology.orchestra.run.smithi074.stderr: 14800K .......... .......... .......... .......... .......... 20% 211M 0s 2019-11-28T21:59:57.283 INFO:teuthology.orchestra.run.smithi074.stderr: 14850K .......... .......... .......... .......... .......... 20% 216M 0s 2019-11-28T21:59:57.283 INFO:teuthology.orchestra.run.smithi074.stderr: 14900K .......... .......... .......... .......... .......... 20% 222M 0s 2019-11-28T21:59:57.283 INFO:teuthology.orchestra.run.smithi074.stderr: 14950K .......... .......... .......... .......... .......... 20% 186M 0s 2019-11-28T21:59:57.283 INFO:teuthology.orchestra.run.smithi074.stderr: 15000K .......... .......... .......... .......... .......... 20% 213M 0s 2019-11-28T21:59:57.283 INFO:teuthology.orchestra.run.smithi074.stderr: 15050K .......... .......... .......... .......... .......... 20% 220M 0s 2019-11-28T21:59:57.283 INFO:teuthology.orchestra.run.smithi074.stderr: 15100K .......... .......... .......... .......... .......... 20% 211M 0s 2019-11-28T21:59:57.284 INFO:teuthology.orchestra.run.smithi074.stderr: 15150K .......... .......... .......... .......... .......... 20% 192M 0s 2019-11-28T21:59:57.284 INFO:teuthology.orchestra.run.smithi074.stderr: 15200K .......... .......... .......... .......... .......... 20% 218M 0s 2019-11-28T21:59:57.284 INFO:teuthology.orchestra.run.smithi074.stderr: 15250K .......... .......... .......... .......... .......... 20% 214M 0s 2019-11-28T21:59:57.284 INFO:teuthology.orchestra.run.smithi074.stderr: 15300K .......... .......... .......... .......... .......... 20% 224M 0s 2019-11-28T21:59:57.284 INFO:teuthology.orchestra.run.smithi074.stderr: 15350K .......... .......... .......... .......... .......... 20% 183M 0s 2019-11-28T21:59:57.284 INFO:teuthology.orchestra.run.smithi074.stderr: 15400K .......... .......... .......... .......... .......... 21% 214M 0s 2019-11-28T21:59:57.284 INFO:teuthology.orchestra.run.smithi074.stderr: 15450K .......... .......... .......... .......... .......... 21% 212M 0s 2019-11-28T21:59:57.285 INFO:teuthology.orchestra.run.smithi074.stderr: 15500K .......... .......... .......... .......... .......... 21% 216M 0s 2019-11-28T21:59:57.285 INFO:teuthology.orchestra.run.smithi074.stderr: 15550K .......... .......... .......... .......... .......... 21% 187M 0s 2019-11-28T21:59:57.285 INFO:teuthology.orchestra.run.smithi074.stderr: 15600K .......... .......... .......... .......... .......... 21% 218M 0s 2019-11-28T21:59:57.285 INFO:teuthology.orchestra.run.smithi074.stderr: 15650K .......... .......... .......... .......... .......... 21% 203M 0s 2019-11-28T21:59:57.285 INFO:teuthology.orchestra.run.smithi074.stderr: 15700K .......... .......... .......... .......... .......... 21% 219M 0s 2019-11-28T21:59:57.285 INFO:teuthology.orchestra.run.smithi074.stderr: 15750K .......... .......... .......... .......... .......... 21% 182M 0s 2019-11-28T21:59:57.285 INFO:teuthology.orchestra.run.smithi074.stderr: 15800K .......... .......... .......... .......... .......... 21% 218M 0s 2019-11-28T21:59:57.286 INFO:teuthology.orchestra.run.smithi074.stderr: 15850K .......... .......... .......... .......... .......... 21% 191M 0s 2019-11-28T21:59:57.286 INFO:teuthology.orchestra.run.smithi074.stderr: 15900K .......... .......... .......... .......... .......... 21% 172M 0s 2019-11-28T21:59:57.286 INFO:teuthology.orchestra.run.smithi074.stderr: 15950K .......... .......... .......... .......... .......... 21% 192M 0s 2019-11-28T21:59:57.286 INFO:teuthology.orchestra.run.smithi074.stderr: 16000K .......... .......... .......... .......... .......... 21% 210M 0s 2019-11-28T21:59:57.286 INFO:teuthology.orchestra.run.smithi074.stderr: 16050K .......... .......... .......... .......... .......... 21% 218M 0s 2019-11-28T21:59:57.286 INFO:teuthology.orchestra.run.smithi074.stderr: 16100K .......... .......... .......... .......... .......... 21% 219M 0s 2019-11-28T21:59:57.286 INFO:teuthology.orchestra.run.smithi074.stderr: 16150K .......... .......... .......... .......... .......... 22% 171M 0s 2019-11-28T21:59:57.286 INFO:teuthology.orchestra.run.smithi074.stderr: 16200K .......... .......... .......... .......... .......... 22% 229M 0s 2019-11-28T21:59:57.287 INFO:teuthology.orchestra.run.smithi074.stderr: 16250K .......... .......... .......... .......... .......... 22% 211M 0s 2019-11-28T21:59:57.287 INFO:teuthology.orchestra.run.smithi074.stderr: 16300K .......... .......... .......... .......... .......... 22% 221M 0s 2019-11-28T21:59:57.287 INFO:teuthology.orchestra.run.smithi074.stderr: 16350K .......... .......... .......... .......... .......... 22% 192M 0s 2019-11-28T21:59:57.287 INFO:teuthology.orchestra.run.smithi074.stderr: 16400K .......... .......... .......... .......... .......... 22% 219M 0s 2019-11-28T21:59:57.287 INFO:teuthology.orchestra.run.smithi074.stderr: 16450K .......... .......... .......... .......... .......... 22% 210M 0s 2019-11-28T21:59:57.287 INFO:teuthology.orchestra.run.smithi074.stderr: 16500K .......... .......... .......... .......... .......... 22% 218M 0s 2019-11-28T21:59:57.287 INFO:teuthology.orchestra.run.smithi074.stderr: 16550K .......... .......... .......... .......... .......... 22% 179M 0s 2019-11-28T21:59:57.287 INFO:teuthology.orchestra.run.smithi074.stderr: 16600K .......... .......... .......... .......... .......... 22% 208M 0s 2019-11-28T21:59:57.288 INFO:teuthology.orchestra.run.smithi074.stderr: 16650K .......... .......... .......... .......... .......... 22% 222M 0s 2019-11-28T21:59:57.288 INFO:teuthology.orchestra.run.smithi074.stderr: 16700K .......... .......... .......... .......... .......... 22% 203M 0s 2019-11-28T21:59:57.288 INFO:teuthology.orchestra.run.smithi074.stderr: 16750K .......... .......... .......... .......... .......... 22% 175M 0s 2019-11-28T21:59:57.288 INFO:teuthology.orchestra.run.smithi074.stderr: 16800K .......... .......... .......... .......... .......... 22% 222M 0s 2019-11-28T21:59:57.288 INFO:teuthology.orchestra.run.smithi074.stderr: 16850K .......... .......... .......... .......... .......... 22% 214M 0s 2019-11-28T21:59:57.288 INFO:teuthology.orchestra.run.smithi074.stderr: 16900K .......... .......... .......... .......... .......... 23% 217M 0s 2019-11-28T21:59:57.288 INFO:teuthology.orchestra.run.smithi074.stderr: 16950K .......... .......... .......... .......... .......... 23% 204M 0s 2019-11-28T21:59:57.289 INFO:teuthology.orchestra.run.smithi074.stderr: 17000K .......... .......... .......... .......... .......... 23% 223M 0s 2019-11-28T21:59:57.289 INFO:teuthology.orchestra.run.smithi074.stderr: 17050K .......... .......... .......... .......... .......... 23% 174M 0s 2019-11-28T21:59:57.289 INFO:teuthology.orchestra.run.smithi074.stderr: 17100K .......... .......... .......... .......... .......... 23% 174M 0s 2019-11-28T21:59:57.289 INFO:teuthology.orchestra.run.smithi074.stderr: 17150K .......... .......... .......... .......... .......... 23% 186M 0s 2019-11-28T21:59:57.289 INFO:teuthology.orchestra.run.smithi074.stderr: 17200K .......... .......... .......... .......... .......... 23% 220M 0s 2019-11-28T21:59:57.289 INFO:teuthology.orchestra.run.smithi074.stderr: 17250K .......... .......... .......... .......... .......... 23% 225M 0s 2019-11-28T21:59:57.290 INFO:teuthology.orchestra.run.smithi074.stderr: 17300K .......... .......... .......... .......... .......... 23% 223M 0s 2019-11-28T21:59:57.290 INFO:teuthology.orchestra.run.smithi074.stderr: 17350K .......... .......... .......... .......... .......... 23% 174M 0s 2019-11-28T21:59:57.290 INFO:teuthology.orchestra.run.smithi074.stderr: 17400K .......... .......... .......... .......... .......... 23% 228M 0s 2019-11-28T21:59:57.290 INFO:teuthology.orchestra.run.smithi074.stderr: 17450K .......... .......... .......... .......... .......... 23% 206M 0s 2019-11-28T21:59:57.290 INFO:teuthology.orchestra.run.smithi074.stderr: 17500K .......... .......... .......... .......... .......... 23% 217M 0s 2019-11-28T21:59:57.290 INFO:teuthology.orchestra.run.smithi074.stderr: 17550K .......... .......... .......... .......... .......... 23% 200M 0s 2019-11-28T21:59:57.290 INFO:teuthology.orchestra.run.smithi074.stderr: 17600K .......... .......... .......... .......... .......... 23% 227M 0s 2019-11-28T21:59:57.290 INFO:teuthology.orchestra.run.smithi074.stderr: 17650K .......... .......... .......... .......... .......... 24% 192M 0s 2019-11-28T21:59:57.291 INFO:teuthology.orchestra.run.smithi074.stderr: 17700K .......... .......... .......... .......... .......... 24% 203M 0s 2019-11-28T21:59:57.291 INFO:teuthology.orchestra.run.smithi074.stderr: 17750K .......... .......... .......... .......... .......... 24% 176M 0s 2019-11-28T21:59:57.291 INFO:teuthology.orchestra.run.smithi074.stderr: 17800K .......... .......... .......... .......... .......... 24% 221M 0s 2019-11-28T21:59:57.291 INFO:teuthology.orchestra.run.smithi074.stderr: 17850K .......... .......... .......... .......... .......... 24% 218M 0s 2019-11-28T21:59:57.291 INFO:teuthology.orchestra.run.smithi074.stderr: 17900K .......... .......... .......... .......... .......... 24% 222M 0s 2019-11-28T21:59:57.291 INFO:teuthology.orchestra.run.smithi074.stderr: 17950K .......... .......... .......... .......... .......... 24% 175M 0s 2019-11-28T21:59:57.291 INFO:teuthology.orchestra.run.smithi074.stderr: 18000K .......... .......... .......... .......... .......... 24% 208M 0s 2019-11-28T21:59:57.292 INFO:teuthology.orchestra.run.smithi074.stderr: 18050K .......... .......... .......... .......... .......... 24% 213M 0s 2019-11-28T21:59:57.292 INFO:teuthology.orchestra.run.smithi074.stderr: 18100K .......... .......... .......... .......... .......... 24% 208M 0s 2019-11-28T21:59:57.292 INFO:teuthology.orchestra.run.smithi074.stderr: 18150K .......... .......... .......... .......... .......... 24% 190M 0s 2019-11-28T21:59:57.292 INFO:teuthology.orchestra.run.smithi074.stderr: 18200K .......... .......... .......... .......... .......... 24% 224M 0s 2019-11-28T21:59:57.292 INFO:teuthology.orchestra.run.smithi074.stderr: 18250K .......... .......... .......... .......... .......... 24% 183M 0s 2019-11-28T21:59:57.292 INFO:teuthology.orchestra.run.smithi074.stderr: 18300K .......... .......... .......... .......... .......... 24% 204M 0s 2019-11-28T21:59:57.292 INFO:teuthology.orchestra.run.smithi074.stderr: 18350K .......... .......... .......... .......... .......... 25% 141M 0s 2019-11-28T21:59:57.293 INFO:teuthology.orchestra.run.smithi074.stderr: 18400K .......... .......... .......... .......... .......... 25% 171M 0s 2019-11-28T21:59:57.293 INFO:teuthology.orchestra.run.smithi074.stderr: 18450K .......... .......... .......... .......... .......... 25% 234M 0s 2019-11-28T21:59:57.293 INFO:teuthology.orchestra.run.smithi074.stderr: 18500K .......... .......... .......... .......... .......... 25% 235M 0s 2019-11-28T21:59:57.293 INFO:teuthology.orchestra.run.smithi074.stderr: 18550K .......... .......... .......... .......... .......... 25% 142M 0s 2019-11-28T21:59:57.293 INFO:teuthology.orchestra.run.smithi074.stderr: 18600K .......... .......... .......... .......... .......... 25% 192M 0s 2019-11-28T21:59:57.293 INFO:teuthology.orchestra.run.smithi074.stderr: 18650K .......... .......... .......... .......... .......... 25% 187M 0s 2019-11-28T21:59:57.293 INFO:teuthology.orchestra.run.smithi074.stderr: 18700K .......... .......... .......... .......... .......... 25% 177M 0s 2019-11-28T21:59:57.294 INFO:teuthology.orchestra.run.smithi074.stderr: 18750K .......... .......... .......... .......... .......... 25% 173M 0s 2019-11-28T21:59:57.294 INFO:teuthology.orchestra.run.smithi074.stderr: 18800K .......... .......... .......... .......... .......... 25% 237M 0s 2019-11-28T21:59:57.294 INFO:teuthology.orchestra.run.smithi074.stderr: 18850K .......... .......... .......... .......... .......... 25% 241M 0s 2019-11-28T21:59:57.294 INFO:teuthology.orchestra.run.smithi074.stderr: 18900K .......... .......... .......... .......... .......... 25% 227M 0s 2019-11-28T21:59:57.294 INFO:teuthology.orchestra.run.smithi074.stderr: 18950K .......... .......... .......... .......... .......... 25% 204M 0s 2019-11-28T21:59:57.294 INFO:teuthology.orchestra.run.smithi074.stderr: 19000K .......... .......... .......... .......... .......... 25% 228M 0s 2019-11-28T21:59:57.294 INFO:teuthology.orchestra.run.smithi074.stderr: 19050K .......... .......... .......... .......... .......... 25% 225M 0s 2019-11-28T21:59:57.294 INFO:teuthology.orchestra.run.smithi074.stderr: 19100K .......... .......... .......... .......... .......... 26% 237M 0s 2019-11-28T21:59:57.295 INFO:teuthology.orchestra.run.smithi074.stderr: 19150K .......... .......... .......... .......... .......... 26% 189M 0s 2019-11-28T21:59:57.295 INFO:teuthology.orchestra.run.smithi074.stderr: 19200K .......... .......... .......... .......... .......... 26% 229M 0s 2019-11-28T21:59:57.295 INFO:teuthology.orchestra.run.smithi074.stderr: 19250K .......... .......... .......... .......... .......... 26% 226M 0s 2019-11-28T21:59:57.295 INFO:teuthology.orchestra.run.smithi074.stderr: 19300K .......... .......... .......... .......... .......... 26% 232M 0s 2019-11-28T21:59:57.295 INFO:teuthology.orchestra.run.smithi074.stderr: 19350K .......... .......... .......... .......... .......... 26% 204M 0s 2019-11-28T21:59:57.295 INFO:teuthology.orchestra.run.smithi074.stderr: 19400K .......... .......... .......... .......... .......... 26% 217M 0s 2019-11-28T21:59:57.295 INFO:teuthology.orchestra.run.smithi074.stderr: 19450K .......... .......... .......... .......... .......... 26% 227M 0s 2019-11-28T21:59:57.296 INFO:teuthology.orchestra.run.smithi074.stderr: 19500K .......... .......... .......... .......... .......... 26% 228M 0s 2019-11-28T21:59:57.296 INFO:teuthology.orchestra.run.smithi074.stderr: 19550K .......... .......... .......... .......... .......... 26% 207M 0s 2019-11-28T21:59:57.296 INFO:teuthology.orchestra.run.smithi074.stderr: 19600K .......... .......... .......... .......... .......... 26% 213M 0s 2019-11-28T21:59:57.296 INFO:teuthology.orchestra.run.smithi074.stderr: 19650K .......... .......... .......... .......... .......... 26% 223M 0s 2019-11-28T21:59:57.296 INFO:teuthology.orchestra.run.smithi074.stderr: 19700K .......... .......... .......... .......... .......... 26% 225M 0s 2019-11-28T21:59:57.296 INFO:teuthology.orchestra.run.smithi074.stderr: 19750K .......... .......... .......... .......... .......... 26% 182M 0s 2019-11-28T21:59:57.296 INFO:teuthology.orchestra.run.smithi074.stderr: 19800K .......... .......... .......... .......... .......... 26% 222M 0s 2019-11-28T21:59:57.296 INFO:teuthology.orchestra.run.smithi074.stderr: 19850K .......... .......... .......... .......... .......... 27% 212M 0s 2019-11-28T21:59:57.297 INFO:teuthology.orchestra.run.smithi074.stderr: 19900K .......... .......... .......... .......... .......... 27% 229M 0s 2019-11-28T21:59:57.297 INFO:teuthology.orchestra.run.smithi074.stderr: 19950K .......... .......... .......... .......... .......... 27% 206M 0s 2019-11-28T21:59:57.297 INFO:teuthology.orchestra.run.smithi074.stderr: 20000K .......... .......... .......... .......... .......... 27% 217M 0s 2019-11-28T21:59:57.297 INFO:teuthology.orchestra.run.smithi074.stderr: 20050K .......... .......... .......... .......... .......... 27% 180M 0s 2019-11-28T21:59:57.297 INFO:teuthology.orchestra.run.smithi074.stderr: 20100K .......... .......... .......... .......... .......... 27% 183M 0s 2019-11-28T21:59:57.297 INFO:teuthology.orchestra.run.smithi074.stderr: 20150K .......... .......... .......... .......... .......... 27% 143M 0s 2019-11-28T21:59:57.297 INFO:teuthology.orchestra.run.smithi074.stderr: 20200K .......... .......... .......... .......... .......... 27% 223M 0s 2019-11-28T21:59:57.298 INFO:teuthology.orchestra.run.smithi074.stderr: 20250K .......... .......... .......... .......... .......... 27% 238M 0s 2019-11-28T21:59:57.298 INFO:teuthology.orchestra.run.smithi074.stderr: 20300K .......... .......... .......... .......... .......... 27% 237M 0s 2019-11-28T21:59:57.298 INFO:teuthology.orchestra.run.smithi074.stderr: 20350K .......... .......... .......... .......... .......... 27% 196M 0s 2019-11-28T21:59:57.298 INFO:teuthology.orchestra.run.smithi074.stderr: 20400K .......... .......... .......... .......... .......... 27% 238M 0s 2019-11-28T21:59:57.298 INFO:teuthology.orchestra.run.smithi074.stderr: 20450K .......... .......... .......... .......... .......... 27% 238M 0s 2019-11-28T21:59:57.298 INFO:teuthology.orchestra.run.smithi074.stderr: 20500K .......... .......... .......... .......... .......... 27% 235M 0s 2019-11-28T21:59:57.298 INFO:teuthology.orchestra.run.smithi074.stderr: 20550K .......... .......... .......... .......... .......... 28% 204M 0s 2019-11-28T21:59:57.299 INFO:teuthology.orchestra.run.smithi074.stderr: 20600K .......... .......... .......... .......... .......... 28% 208M 0s 2019-11-28T21:59:57.299 INFO:teuthology.orchestra.run.smithi074.stderr: 20650K .......... .......... .......... .......... .......... 28% 288M 0s 2019-11-28T21:59:57.299 INFO:teuthology.orchestra.run.smithi074.stderr: 20700K .......... .......... .......... .......... .......... 28% 299M 0s 2019-11-28T21:59:57.299 INFO:teuthology.orchestra.run.smithi074.stderr: 20750K .......... .......... .......... .......... .......... 28% 281M 0s 2019-11-28T21:59:57.299 INFO:teuthology.orchestra.run.smithi074.stderr: 20800K .......... .......... .......... .......... .......... 28% 325M 0s 2019-11-28T21:59:57.299 INFO:teuthology.orchestra.run.smithi074.stderr: 20850K .......... .......... .......... .......... .......... 28% 336M 0s 2019-11-28T21:59:57.299 INFO:teuthology.orchestra.run.smithi074.stderr: 20900K .......... .......... .......... .......... .......... 28% 338M 0s 2019-11-28T21:59:57.299 INFO:teuthology.orchestra.run.smithi074.stderr: 20950K .......... .......... .......... .......... .......... 28% 287M 0s 2019-11-28T21:59:57.300 INFO:teuthology.orchestra.run.smithi074.stderr: 21000K .......... .......... .......... .......... .......... 28% 338M 0s 2019-11-28T21:59:57.300 INFO:teuthology.orchestra.run.smithi074.stderr: 21050K .......... .......... .......... .......... .......... 28% 332M 0s 2019-11-28T21:59:57.300 INFO:teuthology.orchestra.run.smithi074.stderr: 21100K .......... .......... .......... .......... .......... 28% 343M 0s 2019-11-28T21:59:57.300 INFO:teuthology.orchestra.run.smithi074.stderr: 21150K .......... .......... .......... .......... .......... 28% 322M 0s 2019-11-28T21:59:57.300 INFO:teuthology.orchestra.run.smithi074.stderr: 21200K .......... .......... .......... .......... .......... 28% 333M 0s 2019-11-28T21:59:57.300 INFO:teuthology.orchestra.run.smithi074.stderr: 21250K .......... .......... .......... .......... .......... 28% 333M 0s 2019-11-28T21:59:57.300 INFO:teuthology.orchestra.run.smithi074.stderr: 21300K .......... .......... .......... .......... .......... 29% 254M 0s 2019-11-28T21:59:57.301 INFO:teuthology.orchestra.run.smithi074.stderr: 21350K .......... .......... .......... .......... .......... 29% 263M 0s 2019-11-28T21:59:57.301 INFO:teuthology.orchestra.run.smithi074.stderr: 21400K .......... .......... .......... .......... .......... 29% 360M 0s 2019-11-28T21:59:57.301 INFO:teuthology.orchestra.run.smithi074.stderr: 21450K .......... .......... .......... .......... .......... 29% 312M 0s 2019-11-28T21:59:57.301 INFO:teuthology.orchestra.run.smithi074.stderr: 21500K .......... .......... .......... .......... .......... 29% 286M 0s 2019-11-28T21:59:57.301 INFO:teuthology.orchestra.run.smithi074.stderr: 21550K .......... .......... .......... .......... .......... 29% 252M 0s 2019-11-28T21:59:57.301 INFO:teuthology.orchestra.run.smithi074.stderr: 21600K .......... .......... .......... .......... .......... 29% 328M 0s 2019-11-28T21:59:57.301 INFO:teuthology.orchestra.run.smithi074.stderr: 21650K .......... .......... .......... .......... .......... 29% 303M 0s 2019-11-28T21:59:57.302 INFO:teuthology.orchestra.run.smithi074.stderr: 21700K .......... .......... .......... .......... .......... 29% 330M 0s 2019-11-28T21:59:57.302 INFO:teuthology.orchestra.run.smithi074.stderr: 21750K .......... .......... .......... .......... .......... 29% 266M 0s 2019-11-28T21:59:57.302 INFO:teuthology.orchestra.run.smithi074.stderr: 21800K .......... .......... .......... .......... .......... 29% 338M 0s 2019-11-28T21:59:57.302 INFO:teuthology.orchestra.run.smithi074.stderr: 21850K .......... .......... .......... .......... .......... 29% 311M 0s 2019-11-28T21:59:57.302 INFO:teuthology.orchestra.run.smithi074.stderr: 21900K .......... .......... .......... .......... .......... 29% 330M 0s 2019-11-28T21:59:57.302 INFO:teuthology.orchestra.run.smithi074.stderr: 21950K .......... .......... .......... .......... .......... 29% 281M 0s 2019-11-28T21:59:57.302 INFO:teuthology.orchestra.run.smithi074.stderr: 22000K .......... .......... .......... .......... .......... 29% 333M 0s 2019-11-28T21:59:57.302 INFO:teuthology.orchestra.run.smithi074.stderr: 22050K .......... .......... .......... .......... .......... 30% 327M 0s 2019-11-28T21:59:57.303 INFO:teuthology.orchestra.run.smithi074.stderr: 22100K .......... .......... .......... .......... .......... 30% 318M 0s 2019-11-28T21:59:57.303 INFO:teuthology.orchestra.run.smithi074.stderr: 22150K .......... .......... .......... .......... .......... 30% 277M 0s 2019-11-28T21:59:57.303 INFO:teuthology.orchestra.run.smithi074.stderr: 22200K .......... .......... .......... .......... .......... 30% 326M 0s 2019-11-28T21:59:57.303 INFO:teuthology.orchestra.run.smithi074.stderr: 22250K .......... .......... .......... .......... .......... 30% 324M 0s 2019-11-28T21:59:57.303 INFO:teuthology.orchestra.run.smithi074.stderr: 22300K .......... .......... .......... .......... .......... 30% 329M 0s 2019-11-28T21:59:57.303 INFO:teuthology.orchestra.run.smithi074.stderr: 22350K .......... .......... .......... .......... .......... 30% 276M 0s 2019-11-28T21:59:57.304 INFO:teuthology.orchestra.run.smithi074.stderr: 22400K .......... .......... .......... .......... .......... 30% 342M 0s 2019-11-28T21:59:57.304 INFO:teuthology.orchestra.run.smithi074.stderr: 22450K .......... .......... .......... .......... .......... 30% 355M 0s 2019-11-28T21:59:57.304 INFO:teuthology.orchestra.run.smithi074.stderr: 22500K .......... .......... .......... .......... .......... 30% 345M 0s 2019-11-28T21:59:57.304 INFO:teuthology.orchestra.run.smithi074.stderr: 22550K .......... .......... .......... .......... .......... 30% 317M 0s 2019-11-28T21:59:57.304 INFO:teuthology.orchestra.run.smithi074.stderr: 22600K .......... .......... .......... .......... .......... 30% 345M 0s 2019-11-28T21:59:57.305 INFO:teuthology.orchestra.run.smithi074.stderr: 22650K .......... .......... .......... .......... .......... 30% 356M 0s 2019-11-28T21:59:57.305 INFO:teuthology.orchestra.run.smithi074.stderr: 22700K .......... .......... .......... .......... .......... 30% 317M 0s 2019-11-28T21:59:57.305 INFO:teuthology.orchestra.run.smithi074.stderr: 22750K .......... .......... .......... .......... .......... 30% 299M 0s 2019-11-28T21:59:57.305 INFO:teuthology.orchestra.run.smithi074.stderr: 22800K .......... .......... .......... .......... .......... 31% 354M 0s 2019-11-28T21:59:57.305 INFO:teuthology.orchestra.run.smithi074.stderr: 22850K .......... .......... .......... .......... .......... 31% 332M 0s 2019-11-28T21:59:57.305 INFO:teuthology.orchestra.run.smithi074.stderr: 22900K .......... .......... .......... .......... .......... 31% 324M 0s 2019-11-28T21:59:57.305 INFO:teuthology.orchestra.run.smithi074.stderr: 22950K .......... .......... .......... .......... .......... 31% 283M 0s 2019-11-28T21:59:57.305 INFO:teuthology.orchestra.run.smithi074.stderr: 23000K .......... .......... .......... .......... .......... 31% 353M 0s 2019-11-28T21:59:57.306 INFO:teuthology.orchestra.run.smithi074.stderr: 23050K .......... .......... .......... .......... .......... 31% 340M 0s 2019-11-28T21:59:57.306 INFO:teuthology.orchestra.run.smithi074.stderr: 23100K .......... .......... .......... .......... .......... 31% 355M 0s 2019-11-28T21:59:57.306 INFO:teuthology.orchestra.run.smithi074.stderr: 23150K .......... .......... .......... .......... .......... 31% 303M 0s 2019-11-28T21:59:57.306 INFO:teuthology.orchestra.run.smithi074.stderr: 23200K .......... .......... .......... .......... .......... 31% 365M 0s 2019-11-28T21:59:57.306 INFO:teuthology.orchestra.run.smithi074.stderr: 23250K .......... .......... .......... .......... .......... 31% 350M 0s 2019-11-28T21:59:57.306 INFO:teuthology.orchestra.run.smithi074.stderr: 23300K .......... .......... .......... .......... .......... 31% 350M 0s 2019-11-28T21:59:57.306 INFO:teuthology.orchestra.run.smithi074.stderr: 23350K .......... .......... .......... .......... .......... 31% 289M 0s 2019-11-28T21:59:57.307 INFO:teuthology.orchestra.run.smithi074.stderr: 23400K .......... .......... .......... .......... .......... 31% 350M 0s 2019-11-28T21:59:57.307 INFO:teuthology.orchestra.run.smithi074.stderr: 23450K .......... .......... .......... .......... .......... 31% 279M 0s 2019-11-28T21:59:57.307 INFO:teuthology.orchestra.run.smithi074.stderr: 23500K .......... .......... .......... .......... .......... 32% 221M 0s 2019-11-28T21:59:57.307 INFO:teuthology.orchestra.run.smithi074.stderr: 23550K .......... .......... .......... .......... .......... 32% 194M 0s 2019-11-28T21:59:57.307 INFO:teuthology.orchestra.run.smithi074.stderr: 23600K .......... .......... .......... .......... .......... 32% 232M 0s 2019-11-28T21:59:57.307 INFO:teuthology.orchestra.run.smithi074.stderr: 23650K .......... .......... .......... .......... .......... 32% 221M 0s 2019-11-28T21:59:57.307 INFO:teuthology.orchestra.run.smithi074.stderr: 23700K .......... .......... .......... .......... .......... 32% 234M 0s 2019-11-28T21:59:57.308 INFO:teuthology.orchestra.run.smithi074.stderr: 23750K .......... .......... .......... .......... .......... 32% 191M 0s 2019-11-28T21:59:57.308 INFO:teuthology.orchestra.run.smithi074.stderr: 23800K .......... .......... .......... .......... .......... 32% 190M 0s 2019-11-28T21:59:57.308 INFO:teuthology.orchestra.run.smithi074.stderr: 23850K .......... .......... .......... .......... .......... 32% 182M 0s 2019-11-28T21:59:57.308 INFO:teuthology.orchestra.run.smithi074.stderr: 23900K .......... .......... .......... .......... .......... 32% 227M 0s 2019-11-28T21:59:57.308 INFO:teuthology.orchestra.run.smithi074.stderr: 23950K .......... .......... .......... .......... .......... 32% 199M 0s 2019-11-28T21:59:57.308 INFO:teuthology.orchestra.run.smithi074.stderr: 24000K .......... .......... .......... .......... .......... 32% 224M 0s 2019-11-28T21:59:57.308 INFO:teuthology.orchestra.run.smithi074.stderr: 24050K .......... .......... .......... .......... .......... 32% 231M 0s 2019-11-28T21:59:57.309 INFO:teuthology.orchestra.run.smithi074.stderr: 24100K .......... .......... .......... .......... .......... 32% 225M 0s 2019-11-28T21:59:57.309 INFO:teuthology.orchestra.run.smithi074.stderr: 24150K .......... .......... .......... .......... .......... 32% 194M 0s 2019-11-28T21:59:57.309 INFO:teuthology.orchestra.run.smithi074.stderr: 24200K .......... .......... .......... .......... .......... 32% 232M 0s 2019-11-28T21:59:57.309 INFO:teuthology.orchestra.run.smithi074.stderr: 24250K .......... .......... .......... .......... .......... 33% 240M 0s 2019-11-28T21:59:57.309 INFO:teuthology.orchestra.run.smithi074.stderr: 24300K .......... .......... .......... .......... .......... 33% 234M 0s 2019-11-28T21:59:57.309 INFO:teuthology.orchestra.run.smithi074.stderr: 24350K .......... .......... .......... .......... .......... 33% 210M 0s 2019-11-28T21:59:57.309 INFO:teuthology.orchestra.run.smithi074.stderr: 24400K .......... .......... .......... .......... .......... 33% 230M 0s 2019-11-28T21:59:57.310 INFO:teuthology.orchestra.run.smithi074.stderr: 24450K .......... .......... .......... .......... .......... 33% 236M 0s 2019-11-28T21:59:57.310 INFO:teuthology.orchestra.run.smithi074.stderr: 24500K .......... .......... .......... .......... .......... 33% 229M 0s 2019-11-28T21:59:57.310 INFO:teuthology.orchestra.run.smithi074.stderr: 24550K .......... .......... .......... .......... .......... 33% 189M 0s 2019-11-28T21:59:57.310 INFO:teuthology.orchestra.run.smithi074.stderr: 24600K .......... .......... .......... .......... .......... 33% 231M 0s 2019-11-28T21:59:57.310 INFO:teuthology.orchestra.run.smithi074.stderr: 24650K .......... .......... .......... .......... .......... 33% 232M 0s 2019-11-28T21:59:57.310 INFO:teuthology.orchestra.run.smithi074.stderr: 24700K .......... .......... .......... .......... .......... 33% 236M 0s 2019-11-28T21:59:57.310 INFO:teuthology.orchestra.run.smithi074.stderr: 24750K .......... .......... .......... .......... .......... 33% 207M 0s 2019-11-28T21:59:57.311 INFO:teuthology.orchestra.run.smithi074.stderr: 24800K .......... .......... .......... .......... .......... 33% 226M 0s 2019-11-28T21:59:57.311 INFO:teuthology.orchestra.run.smithi074.stderr: 24850K .......... .......... .......... .......... .......... 33% 221M 0s 2019-11-28T21:59:57.311 INFO:teuthology.orchestra.run.smithi074.stderr: 24900K .......... .......... .......... .......... .......... 33% 231M 0s 2019-11-28T21:59:57.311 INFO:teuthology.orchestra.run.smithi074.stderr: 24950K .......... .......... .......... .......... .......... 33% 197M 0s 2019-11-28T21:59:57.311 INFO:teuthology.orchestra.run.smithi074.stderr: 25000K .......... .......... .......... .......... .......... 34% 223M 0s 2019-11-28T21:59:57.311 INFO:teuthology.orchestra.run.smithi074.stderr: 25050K .......... .......... .......... .......... .......... 34% 220M 0s 2019-11-28T21:59:57.311 INFO:teuthology.orchestra.run.smithi074.stderr: 25100K .......... .......... .......... .......... .......... 34% 214M 0s 2019-11-28T21:59:57.312 INFO:teuthology.orchestra.run.smithi074.stderr: 25150K .......... .......... .......... .......... .......... 34% 202M 0s 2019-11-28T21:59:57.312 INFO:teuthology.orchestra.run.smithi074.stderr: 25200K .......... .......... .......... .......... .......... 34% 218M 0s 2019-11-28T21:59:57.312 INFO:teuthology.orchestra.run.smithi074.stderr: 25250K .......... .......... .......... .......... .......... 34% 200M 0s 2019-11-28T21:59:57.312 INFO:teuthology.orchestra.run.smithi074.stderr: 25300K .......... .......... .......... .......... .......... 34% 168M 0s 2019-11-28T21:59:57.312 INFO:teuthology.orchestra.run.smithi074.stderr: 25350K .......... .......... .......... .......... .......... 34% 174M 0s 2019-11-28T21:59:57.312 INFO:teuthology.orchestra.run.smithi074.stderr: 25400K .......... .......... .......... .......... .......... 34% 234M 0s 2019-11-28T21:59:57.312 INFO:teuthology.orchestra.run.smithi074.stderr: 25450K .......... .......... .......... .......... .......... 34% 236M 0s 2019-11-28T21:59:57.313 INFO:teuthology.orchestra.run.smithi074.stderr: 25500K .......... .......... .......... .......... .......... 34% 235M 0s 2019-11-28T21:59:57.313 INFO:teuthology.orchestra.run.smithi074.stderr: 25550K .......... .......... .......... .......... .......... 34% 207M 0s 2019-11-28T21:59:57.313 INFO:teuthology.orchestra.run.smithi074.stderr: 25600K .......... .......... .......... .......... .......... 34% 231M 0s 2019-11-28T21:59:57.313 INFO:teuthology.orchestra.run.smithi074.stderr: 25650K .......... .......... .......... .......... .......... 34% 243M 0s 2019-11-28T21:59:57.313 INFO:teuthology.orchestra.run.smithi074.stderr: 25700K .......... .......... .......... .......... .......... 35% 238M 0s 2019-11-28T21:59:57.313 INFO:teuthology.orchestra.run.smithi074.stderr: 25750K .......... .......... .......... .......... .......... 35% 203M 0s 2019-11-28T21:59:57.313 INFO:teuthology.orchestra.run.smithi074.stderr: 25800K .......... .......... .......... .......... .......... 35% 242M 0s 2019-11-28T21:59:57.314 INFO:teuthology.orchestra.run.smithi074.stderr: 25850K .......... .......... .......... .......... .......... 35% 241M 0s 2019-11-28T21:59:57.314 INFO:teuthology.orchestra.run.smithi074.stderr: 25900K .......... .......... .......... .......... .......... 35% 247M 0s 2019-11-28T21:59:57.314 INFO:teuthology.orchestra.run.smithi074.stderr: 25950K .......... .......... .......... .......... .......... 35% 226M 0s 2019-11-28T21:59:57.314 INFO:teuthology.orchestra.run.smithi074.stderr: 26000K .......... .......... .......... .......... .......... 35% 216M 0s 2019-11-28T21:59:57.314 INFO:teuthology.orchestra.run.smithi074.stderr: 26050K .......... .......... .......... .......... .......... 35% 228M 0s 2019-11-28T21:59:57.314 INFO:teuthology.orchestra.run.smithi074.stderr: 26100K .......... .......... .......... .......... .......... 35% 235M 0s 2019-11-28T21:59:57.314 INFO:teuthology.orchestra.run.smithi074.stderr: 26150K .......... .......... .......... .......... .......... 35% 205M 0s 2019-11-28T21:59:57.314 INFO:teuthology.orchestra.run.smithi074.stderr: 26200K .......... .......... .......... .......... .......... 35% 243M 0s 2019-11-28T21:59:57.315 INFO:teuthology.orchestra.run.smithi074.stderr: 26250K .......... .......... .......... .......... .......... 35% 232M 0s 2019-11-28T21:59:57.315 INFO:teuthology.orchestra.run.smithi074.stderr: 26300K .......... .......... .......... .......... .......... 35% 239M 0s 2019-11-28T21:59:57.315 INFO:teuthology.orchestra.run.smithi074.stderr: 26350K .......... .......... .......... .......... .......... 35% 207M 0s 2019-11-28T21:59:57.315 INFO:teuthology.orchestra.run.smithi074.stderr: 26400K .......... .......... .......... .......... .......... 35% 241M 0s 2019-11-28T21:59:57.315 INFO:teuthology.orchestra.run.smithi074.stderr: 26450K .......... .......... .......... .......... .......... 36% 232M 0s 2019-11-28T21:59:57.315 INFO:teuthology.orchestra.run.smithi074.stderr: 26500K .......... .......... .......... .......... .......... 36% 246M 0s 2019-11-28T21:59:57.315 INFO:teuthology.orchestra.run.smithi074.stderr: 26550K .......... .......... .......... .......... .......... 36% 186M 0s 2019-11-28T21:59:57.316 INFO:teuthology.orchestra.run.smithi074.stderr: 26600K .......... .......... .......... .......... .......... 36% 222M 0s 2019-11-28T21:59:57.316 INFO:teuthology.orchestra.run.smithi074.stderr: 26650K .......... .......... .......... .......... .......... 36% 233M 0s 2019-11-28T21:59:57.316 INFO:teuthology.orchestra.run.smithi074.stderr: 26700K .......... .......... .......... .......... .......... 36% 227M 0s 2019-11-28T21:59:57.316 INFO:teuthology.orchestra.run.smithi074.stderr: 26750K .......... .......... .......... .......... .......... 36% 218M 0s 2019-11-28T21:59:57.316 INFO:teuthology.orchestra.run.smithi074.stderr: 26800K .......... .......... .......... .......... .......... 36% 248M 0s 2019-11-28T21:59:57.316 INFO:teuthology.orchestra.run.smithi074.stderr: 26850K .......... .......... .......... .......... .......... 36% 247M 0s 2019-11-28T21:59:57.317 INFO:teuthology.orchestra.run.smithi074.stderr: 26900K .......... .......... .......... .......... .......... 36% 233M 0s 2019-11-28T21:59:57.317 INFO:teuthology.orchestra.run.smithi074.stderr: 26950K .......... .......... .......... .......... .......... 36% 191M 0s 2019-11-28T21:59:57.317 INFO:teuthology.orchestra.run.smithi074.stderr: 27000K .......... .......... .......... .......... .......... 36% 238M 0s 2019-11-28T21:59:57.317 INFO:teuthology.orchestra.run.smithi074.stderr: 27050K .......... .......... .......... .......... .......... 36% 236M 0s 2019-11-28T21:59:57.319 INFO:teuthology.orchestra.run.smithi074.stderr: 27100K .......... .......... .......... .......... .......... 36% 235M 0s 2019-11-28T21:59:57.320 INFO:teuthology.orchestra.run.smithi074.stderr: 27150K .......... .......... .......... .......... .......... 36% 207M 0s 2019-11-28T21:59:57.320 INFO:teuthology.orchestra.run.smithi074.stderr: 27200K .......... .......... .......... .......... .......... 37% 248M 0s 2019-11-28T21:59:57.320 INFO:teuthology.orchestra.run.smithi074.stderr: 27250K .......... .......... .......... .......... .......... 37% 222M 0s 2019-11-28T21:59:57.320 INFO:teuthology.orchestra.run.smithi074.stderr: 27300K .......... .......... .......... .......... .......... 37% 195M 0s 2019-11-28T21:59:57.320 INFO:teuthology.orchestra.run.smithi074.stderr: 27350K .......... .......... .......... .......... .......... 37% 200M 0s 2019-11-28T21:59:57.320 INFO:teuthology.orchestra.run.smithi074.stderr: 27400K .......... .......... .......... .......... .......... 37% 241M 0s 2019-11-28T21:59:57.321 INFO:teuthology.orchestra.run.smithi074.stderr: 27450K .......... .......... .......... .......... .......... 37% 248M 0s 2019-11-28T21:59:57.321 INFO:teuthology.orchestra.run.smithi074.stderr: 27500K .......... .......... .......... .......... .......... 37% 237M 0s 2019-11-28T21:59:57.321 INFO:teuthology.orchestra.run.smithi074.stderr: 27550K .......... .......... .......... .......... .......... 37% 220M 0s 2019-11-28T21:59:57.321 INFO:teuthology.orchestra.run.smithi074.stderr: 27600K .......... .......... .......... .......... .......... 37% 245M 0s 2019-11-28T21:59:57.321 INFO:teuthology.orchestra.run.smithi074.stderr: 27650K .......... .......... .......... .......... .......... 37% 233M 0s 2019-11-28T21:59:57.321 INFO:teuthology.orchestra.run.smithi074.stderr: 27700K .......... .......... .......... .......... .......... 37% 247M 0s 2019-11-28T21:59:57.322 INFO:teuthology.orchestra.run.smithi074.stderr: 27750K .......... .......... .......... .......... .......... 37% 216M 0s 2019-11-28T21:59:57.322 INFO:teuthology.orchestra.run.smithi074.stderr: 27800K .......... .......... .......... .......... .......... 37% 247M 0s 2019-11-28T21:59:57.322 INFO:teuthology.orchestra.run.smithi074.stderr: 27850K .......... .......... .......... .......... .......... 37% 242M 0s 2019-11-28T21:59:57.322 INFO:teuthology.orchestra.run.smithi074.stderr: 27900K .......... .......... .......... .......... .......... 37% 231M 0s 2019-11-28T21:59:57.322 INFO:teuthology.orchestra.run.smithi074.stderr: 27950K .......... .......... .......... .......... .......... 38% 218M 0s 2019-11-28T21:59:57.322 INFO:teuthology.orchestra.run.smithi074.stderr: 28000K .......... .......... .......... .......... .......... 38% 241M 0s 2019-11-28T21:59:57.322 INFO:teuthology.orchestra.run.smithi074.stderr: 28050K .......... .......... .......... .......... .......... 38% 245M 0s 2019-11-28T21:59:57.323 INFO:teuthology.orchestra.run.smithi074.stderr: 28100K .......... .......... .......... .......... .......... 38% 240M 0s 2019-11-28T21:59:57.323 INFO:teuthology.orchestra.run.smithi074.stderr: 28150K .......... .......... .......... .......... .......... 38% 193M 0s 2019-11-28T21:59:57.323 INFO:teuthology.orchestra.run.smithi074.stderr: 28200K .......... .......... .......... .......... .......... 38% 249M 0s 2019-11-28T21:59:57.323 INFO:teuthology.orchestra.run.smithi074.stderr: 28250K .......... .......... .......... .......... .......... 38% 257M 0s 2019-11-28T21:59:57.323 INFO:teuthology.orchestra.run.smithi074.stderr: 28300K .......... .......... .......... .......... .......... 38% 233M 0s 2019-11-28T21:59:57.323 INFO:teuthology.orchestra.run.smithi074.stderr: 28350K .......... .......... .......... .......... .......... 38% 223M 0s 2019-11-28T21:59:57.323 INFO:teuthology.orchestra.run.smithi074.stderr: 28400K .......... .......... .......... .......... .......... 38% 232M 0s 2019-11-28T21:59:57.323 INFO:teuthology.orchestra.run.smithi074.stderr: 28450K .......... .......... .......... .......... .......... 38% 239M 0s 2019-11-28T21:59:57.324 INFO:teuthology.orchestra.run.smithi074.stderr: 28500K .......... .......... .......... .......... .......... 38% 236M 0s 2019-11-28T21:59:57.324 INFO:teuthology.orchestra.run.smithi074.stderr: 28550K .......... .......... .......... .......... .......... 38% 210M 0s 2019-11-28T21:59:57.324 INFO:teuthology.orchestra.run.smithi074.stderr: 28600K .......... .......... .......... .......... .......... 38% 228M 0s 2019-11-28T21:59:57.324 INFO:teuthology.orchestra.run.smithi074.stderr: 28650K .......... .......... .......... .......... .......... 39% 253M 0s 2019-11-28T21:59:57.324 INFO:teuthology.orchestra.run.smithi074.stderr: 28700K .......... .......... .......... .......... .......... 39% 252M 0s 2019-11-28T21:59:57.324 INFO:teuthology.orchestra.run.smithi074.stderr: 28750K .......... .......... .......... .......... .......... 39% 224M 0s 2019-11-28T21:59:57.325 INFO:teuthology.orchestra.run.smithi074.stderr: 28800K .......... .......... .......... .......... .......... 39% 228M 0s 2019-11-28T21:59:57.325 INFO:teuthology.orchestra.run.smithi074.stderr: 28850K .......... .......... .......... .......... .......... 39% 257M 0s 2019-11-28T21:59:57.325 INFO:teuthology.orchestra.run.smithi074.stderr: 28900K .......... .......... .......... .......... .......... 39% 247M 0s 2019-11-28T21:59:57.325 INFO:teuthology.orchestra.run.smithi074.stderr: 28950K .......... .......... .......... .......... .......... 39% 208M 0s 2019-11-28T21:59:57.325 INFO:teuthology.orchestra.run.smithi074.stderr: 29000K .......... .......... .......... .......... .......... 39% 255M 0s 2019-11-28T21:59:57.325 INFO:teuthology.orchestra.run.smithi074.stderr: 29050K .......... .......... .......... .......... .......... 39% 244M 0s 2019-11-28T21:59:57.325 INFO:teuthology.orchestra.run.smithi074.stderr: 29100K .......... .......... .......... .......... .......... 39% 253M 0s 2019-11-28T21:59:57.325 INFO:teuthology.orchestra.run.smithi074.stderr: 29150K .......... .......... .......... .......... .......... 39% 227M 0s 2019-11-28T21:59:57.326 INFO:teuthology.orchestra.run.smithi074.stderr: 29200K .......... .......... .......... .......... .......... 39% 253M 0s 2019-11-28T21:59:57.326 INFO:teuthology.orchestra.run.smithi074.stderr: 29250K .......... .......... .......... .......... .......... 39% 232M 0s 2019-11-28T21:59:57.326 INFO:teuthology.orchestra.run.smithi074.stderr: 29300K .......... .......... .......... .......... .......... 39% 245M 0s 2019-11-28T21:59:57.326 INFO:teuthology.orchestra.run.smithi074.stderr: 29350K .......... .......... .......... .......... .......... 39% 202M 0s 2019-11-28T21:59:57.326 INFO:teuthology.orchestra.run.smithi074.stderr: 29400K .......... .......... .......... .......... .......... 40% 238M 0s 2019-11-28T21:59:57.326 INFO:teuthology.orchestra.run.smithi074.stderr: 29450K .......... .......... .......... .......... .......... 40% 250M 0s 2019-11-28T21:59:57.326 INFO:teuthology.orchestra.run.smithi074.stderr: 29500K .......... .......... .......... .......... .......... 40% 248M 0s 2019-11-28T21:59:57.327 INFO:teuthology.orchestra.run.smithi074.stderr: 29550K .......... .......... .......... .......... .......... 40% 208M 0s 2019-11-28T21:59:57.327 INFO:teuthology.orchestra.run.smithi074.stderr: 29600K .......... .......... .......... .......... .......... 40% 242M 0s 2019-11-28T21:59:57.327 INFO:teuthology.orchestra.run.smithi074.stderr: 29650K .......... .......... .......... .......... .......... 40% 247M 0s 2019-11-28T21:59:57.327 INFO:teuthology.orchestra.run.smithi074.stderr: 29700K .......... .......... .......... .......... .......... 40% 247M 0s 2019-11-28T21:59:57.327 INFO:teuthology.orchestra.run.smithi074.stderr: 29750K .......... .......... .......... .......... .......... 40% 195M 0s 2019-11-28T21:59:57.327 INFO:teuthology.orchestra.run.smithi074.stderr: 29800K .......... .......... .......... .......... .......... 40% 236M 0s 2019-11-28T21:59:57.327 INFO:teuthology.orchestra.run.smithi074.stderr: 29850K .......... .......... .......... .......... .......... 40% 233M 0s 2019-11-28T21:59:57.328 INFO:teuthology.orchestra.run.smithi074.stderr: 29900K .......... .......... .......... .......... .......... 40% 243M 0s 2019-11-28T21:59:57.328 INFO:teuthology.orchestra.run.smithi074.stderr: 29950K .......... .......... .......... .......... .......... 40% 226M 0s 2019-11-28T21:59:57.328 INFO:teuthology.orchestra.run.smithi074.stderr: 30000K .......... .......... .......... .......... .......... 40% 237M 0s 2019-11-28T21:59:57.328 INFO:teuthology.orchestra.run.smithi074.stderr: 30050K .......... .......... .......... .......... .......... 40% 242M 0s 2019-11-28T21:59:57.328 INFO:teuthology.orchestra.run.smithi074.stderr: 30100K .......... .......... .......... .......... .......... 40% 249M 0s 2019-11-28T21:59:57.328 INFO:teuthology.orchestra.run.smithi074.stderr: 30150K .......... .......... .......... .......... .......... 41% 201M 0s 2019-11-28T21:59:57.328 INFO:teuthology.orchestra.run.smithi074.stderr: 30200K .......... .......... .......... .......... .......... 41% 222M 0s 2019-11-28T21:59:57.329 INFO:teuthology.orchestra.run.smithi074.stderr: 30250K .......... .......... .......... .......... .......... 41% 225M 0s 2019-11-28T21:59:57.329 INFO:teuthology.orchestra.run.smithi074.stderr: 30300K .......... .......... .......... .......... .......... 41% 262M 0s 2019-11-28T21:59:57.329 INFO:teuthology.orchestra.run.smithi074.stderr: 30350K .......... .......... .......... .......... .......... 41% 225M 0s 2019-11-28T21:59:57.329 INFO:teuthology.orchestra.run.smithi074.stderr: 30400K .......... .......... .......... .......... .......... 41% 254M 0s 2019-11-28T21:59:57.329 INFO:teuthology.orchestra.run.smithi074.stderr: 30450K .......... .......... .......... .......... .......... 41% 253M 0s 2019-11-28T21:59:57.329 INFO:teuthology.orchestra.run.smithi074.stderr: 30500K .......... .......... .......... .......... .......... 41% 256M 0s 2019-11-28T21:59:57.329 INFO:teuthology.orchestra.run.smithi074.stderr: 30550K .......... .......... .......... .......... .......... 41% 211M 0s 2019-11-28T21:59:57.329 INFO:teuthology.orchestra.run.smithi074.stderr: 30600K .......... .......... .......... .......... .......... 41% 265M 0s 2019-11-28T21:59:57.330 INFO:teuthology.orchestra.run.smithi074.stderr: 30650K .......... .......... .......... .......... .......... 41% 264M 0s 2019-11-28T21:59:57.330 INFO:teuthology.orchestra.run.smithi074.stderr: 30700K .......... .......... .......... .......... .......... 41% 262M 0s 2019-11-28T21:59:57.330 INFO:teuthology.orchestra.run.smithi074.stderr: 30750K .......... .......... .......... .......... .......... 41% 231M 0s 2019-11-28T21:59:57.330 INFO:teuthology.orchestra.run.smithi074.stderr: 30800K .......... .......... .......... .......... .......... 41% 242M 0s 2019-11-28T21:59:57.330 INFO:teuthology.orchestra.run.smithi074.stderr: 30850K .......... .......... .......... .......... .......... 42% 260M 0s 2019-11-28T21:59:57.330 INFO:teuthology.orchestra.run.smithi074.stderr: 30900K .......... .......... .......... .......... .......... 42% 255M 0s 2019-11-28T21:59:57.330 INFO:teuthology.orchestra.run.smithi074.stderr: 30950K .......... .......... .......... .......... .......... 42% 201M 0s 2019-11-28T21:59:57.331 INFO:teuthology.orchestra.run.smithi074.stderr: 31000K .......... .......... .......... .......... .......... 42% 227M 0s 2019-11-28T21:59:57.331 INFO:teuthology.orchestra.run.smithi074.stderr: 31050K .......... .......... .......... .......... .......... 42% 252M 0s 2019-11-28T21:59:57.331 INFO:teuthology.orchestra.run.smithi074.stderr: 31100K .......... .......... .......... .......... .......... 42% 242M 0s 2019-11-28T21:59:57.331 INFO:teuthology.orchestra.run.smithi074.stderr: 31150K .......... .......... .......... .......... .......... 42% 234M 0s 2019-11-28T21:59:57.331 INFO:teuthology.orchestra.run.smithi074.stderr: 31200K .......... .......... .......... .......... .......... 42% 232M 0s 2019-11-28T21:59:57.331 INFO:teuthology.orchestra.run.smithi074.stderr: 31250K .......... .......... .......... .......... .......... 42% 237M 0s 2019-11-28T21:59:57.331 INFO:teuthology.orchestra.run.smithi074.stderr: 31300K .......... .......... .......... .......... .......... 42% 263M 0s 2019-11-28T21:59:57.331 INFO:teuthology.orchestra.run.smithi074.stderr: 31350K .......... .......... .......... .......... .......... 42% 207M 0s 2019-11-28T21:59:57.332 INFO:teuthology.orchestra.run.smithi074.stderr: 31400K .......... .......... .......... .......... .......... 42% 242M 0s 2019-11-28T21:59:57.332 INFO:teuthology.orchestra.run.smithi074.stderr: 31450K .......... .......... .......... .......... .......... 42% 267M 0s 2019-11-28T21:59:57.332 INFO:teuthology.orchestra.run.smithi074.stderr: 31500K .......... .......... .......... .......... .......... 42% 256M 0s 2019-11-28T21:59:57.332 INFO:teuthology.orchestra.run.smithi074.stderr: 31550K .......... .......... .......... .......... .......... 42% 212M 0s 2019-11-28T21:59:57.332 INFO:teuthology.orchestra.run.smithi074.stderr: 31600K .......... .......... .......... .......... .......... 43% 262M 0s 2019-11-28T21:59:57.332 INFO:teuthology.orchestra.run.smithi074.stderr: 31650K .......... .......... .......... .......... .......... 43% 257M 0s 2019-11-28T21:59:57.332 INFO:teuthology.orchestra.run.smithi074.stderr: 31700K .......... .......... .......... .......... .......... 43% 253M 0s 2019-11-28T21:59:57.333 INFO:teuthology.orchestra.run.smithi074.stderr: 31750K .......... .......... .......... .......... .......... 43% 223M 0s 2019-11-28T21:59:57.333 INFO:teuthology.orchestra.run.smithi074.stderr: 31800K .......... .......... .......... .......... .......... 43% 266M 0s 2019-11-28T21:59:57.333 INFO:teuthology.orchestra.run.smithi074.stderr: 31850K .......... .......... .......... .......... .......... 43% 267M 0s 2019-11-28T21:59:57.333 INFO:teuthology.orchestra.run.smithi074.stderr: 31900K .......... .......... .......... .......... .......... 43% 254M 0s 2019-11-28T21:59:57.333 INFO:teuthology.orchestra.run.smithi074.stderr: 31950K .......... .......... .......... .......... .......... 43% 213M 0s 2019-11-28T21:59:57.333 INFO:teuthology.orchestra.run.smithi074.stderr: 32000K .......... .......... .......... .......... .......... 43% 249M 0s 2019-11-28T21:59:57.333 INFO:teuthology.orchestra.run.smithi074.stderr: 32050K .......... .......... .......... .......... .......... 43% 261M 0s 2019-11-28T21:59:57.334 INFO:teuthology.orchestra.run.smithi074.stderr: 32100K .......... .......... .......... .......... .......... 43% 260M 0s 2019-11-28T21:59:57.334 INFO:teuthology.orchestra.run.smithi074.stderr: 32150K .......... .......... .......... .......... .......... 43% 233M 0s 2019-11-28T21:59:57.334 INFO:teuthology.orchestra.run.smithi074.stderr: 32200K .......... .......... .......... .......... .......... 43% 259M 0s 2019-11-28T21:59:57.334 INFO:teuthology.orchestra.run.smithi074.stderr: 32250K .......... .......... .......... .......... .......... 43% 244M 0s 2019-11-28T21:59:57.334 INFO:teuthology.orchestra.run.smithi074.stderr: 32300K .......... .......... .......... .......... .......... 43% 254M 0s 2019-11-28T21:59:57.334 INFO:teuthology.orchestra.run.smithi074.stderr: 32350K .......... .......... .......... .......... .......... 44% 208M 0s 2019-11-28T21:59:57.334 INFO:teuthology.orchestra.run.smithi074.stderr: 32400K .......... .......... .......... .......... .......... 44% 258M 0s 2019-11-28T21:59:57.335 INFO:teuthology.orchestra.run.smithi074.stderr: 32450K .......... .......... .......... .......... .......... 44% 252M 0s 2019-11-28T21:59:57.335 INFO:teuthology.orchestra.run.smithi074.stderr: 32500K .......... .......... .......... .......... .......... 44% 254M 0s 2019-11-28T21:59:57.335 INFO:teuthology.orchestra.run.smithi074.stderr: 32550K .......... .......... .......... .......... .......... 44% 224M 0s 2019-11-28T21:59:57.335 INFO:teuthology.orchestra.run.smithi074.stderr: 32600K .......... .......... .......... .......... .......... 44% 249M 0s 2019-11-28T21:59:57.335 INFO:teuthology.orchestra.run.smithi074.stderr: 32650K .......... .......... .......... .......... .......... 44% 211M 0s 2019-11-28T21:59:57.335 INFO:teuthology.orchestra.run.smithi074.stderr: 32700K .......... .......... .......... .......... .......... 44% 177M 0s 2019-11-28T21:59:57.335 INFO:teuthology.orchestra.run.smithi074.stderr: 32750K .......... .......... .......... .......... .......... 44% 206M 0s 2019-11-28T21:59:57.336 INFO:teuthology.orchestra.run.smithi074.stderr: 32800K .......... .......... .......... .......... .......... 44% 254M 0s 2019-11-28T21:59:57.336 INFO:teuthology.orchestra.run.smithi074.stderr: 32850K .......... .......... .......... .......... .......... 44% 262M 0s 2019-11-28T21:59:57.336 INFO:teuthology.orchestra.run.smithi074.stderr: 32900K .......... .......... .......... .......... .......... 44% 264M 0s 2019-11-28T21:59:57.336 INFO:teuthology.orchestra.run.smithi074.stderr: 32950K .......... .......... .......... .......... .......... 44% 242M 0s 2019-11-28T21:59:57.336 INFO:teuthology.orchestra.run.smithi074.stderr: 33000K .......... .......... .......... .......... .......... 44% 274M 0s 2019-11-28T21:59:57.336 INFO:teuthology.orchestra.run.smithi074.stderr: 33050K .......... .......... .......... .......... .......... 44% 279M 0s 2019-11-28T21:59:57.336 INFO:teuthology.orchestra.run.smithi074.stderr: 33100K .......... .......... .......... .......... .......... 45% 270M 0s 2019-11-28T21:59:57.336 INFO:teuthology.orchestra.run.smithi074.stderr: 33150K .......... .......... .......... .......... .......... 45% 225M 0s 2019-11-28T21:59:57.337 INFO:teuthology.orchestra.run.smithi074.stderr: 33200K .......... .......... .......... .......... .......... 45% 277M 0s 2019-11-28T21:59:57.337 INFO:teuthology.orchestra.run.smithi074.stderr: 33250K .......... .......... .......... .......... .......... 45% 263M 0s 2019-11-28T21:59:57.337 INFO:teuthology.orchestra.run.smithi074.stderr: 33300K .......... .......... .......... .......... .......... 45% 275M 0s 2019-11-28T21:59:57.337 INFO:teuthology.orchestra.run.smithi074.stderr: 33350K .......... .......... .......... .......... .......... 45% 249M 0s 2019-11-28T21:59:57.337 INFO:teuthology.orchestra.run.smithi074.stderr: 33400K .......... .......... .......... .......... .......... 45% 237M 0s 2019-11-28T21:59:57.337 INFO:teuthology.orchestra.run.smithi074.stderr: 33450K .......... .......... .......... .......... .......... 45% 238M 0s 2019-11-28T21:59:57.337 INFO:teuthology.orchestra.run.smithi074.stderr: 33500K .......... .......... .......... .......... .......... 45% 255M 0s 2019-11-28T21:59:57.338 INFO:teuthology.orchestra.run.smithi074.stderr: 33550K .......... .......... .......... .......... .......... 45% 211M 0s 2019-11-28T21:59:57.338 INFO:teuthology.orchestra.run.smithi074.stderr: 33600K .......... .......... .......... .......... .......... 45% 270M 0s 2019-11-28T21:59:57.338 INFO:teuthology.orchestra.run.smithi074.stderr: 33650K .......... .......... .......... .......... .......... 45% 261M 0s 2019-11-28T21:59:57.338 INFO:teuthology.orchestra.run.smithi074.stderr: 33700K .......... .......... .......... .......... .......... 45% 252M 0s 2019-11-28T21:59:57.338 INFO:teuthology.orchestra.run.smithi074.stderr: 33750K .......... .......... .......... .......... .......... 45% 209M 0s 2019-11-28T21:59:57.338 INFO:teuthology.orchestra.run.smithi074.stderr: 33800K .......... .......... .......... .......... .......... 46% 262M 0s 2019-11-28T21:59:57.338 INFO:teuthology.orchestra.run.smithi074.stderr: 33850K .......... .......... .......... .......... .......... 46% 246M 0s 2019-11-28T21:59:57.339 INFO:teuthology.orchestra.run.smithi074.stderr: 33900K .......... .......... .......... .......... .......... 46% 259M 0s 2019-11-28T21:59:57.339 INFO:teuthology.orchestra.run.smithi074.stderr: 33950K .......... .......... .......... .......... .......... 46% 207M 0s 2019-11-28T21:59:57.339 INFO:teuthology.orchestra.run.smithi074.stderr: 34000K .......... .......... .......... .......... .......... 46% 255M 0s 2019-11-28T21:59:57.339 INFO:teuthology.orchestra.run.smithi074.stderr: 34050K .......... .......... .......... .......... .......... 46% 257M 0s 2019-11-28T21:59:57.339 INFO:teuthology.orchestra.run.smithi074.stderr: 34100K .......... .......... .......... .......... .......... 46% 251M 0s 2019-11-28T21:59:57.339 INFO:teuthology.orchestra.run.smithi074.stderr: 34150K .......... .......... .......... .......... .......... 46% 223M 0s 2019-11-28T21:59:57.339 INFO:teuthology.orchestra.run.smithi074.stderr: 34200K .......... .......... .......... .......... .......... 46% 249M 0s 2019-11-28T21:59:57.340 INFO:teuthology.orchestra.run.smithi074.stderr: 34250K .......... .......... .......... .......... .......... 46% 237M 0s 2019-11-28T21:59:57.340 INFO:teuthology.orchestra.run.smithi074.stderr: 34300K .......... .......... .......... .......... .......... 46% 273M 0s 2019-11-28T21:59:57.340 INFO:teuthology.orchestra.run.smithi074.stderr: 34350K .......... .......... .......... .......... .......... 46% 244M 0s 2019-11-28T21:59:57.340 INFO:teuthology.orchestra.run.smithi074.stderr: 34400K .......... .......... .......... .......... .......... 46% 271M 0s 2019-11-28T21:59:57.340 INFO:teuthology.orchestra.run.smithi074.stderr: 34450K .......... .......... .......... .......... .......... 46% 271M 0s 2019-11-28T21:59:57.340 INFO:teuthology.orchestra.run.smithi074.stderr: 34500K .......... .......... .......... .......... .......... 46% 256M 0s 2019-11-28T21:59:57.340 INFO:teuthology.orchestra.run.smithi074.stderr: 34550K .......... .......... .......... .......... .......... 47% 223M 0s 2019-11-28T21:59:57.341 INFO:teuthology.orchestra.run.smithi074.stderr: 34600K .......... .......... .......... .......... .......... 47% 266M 0s 2019-11-28T21:59:57.341 INFO:teuthology.orchestra.run.smithi074.stderr: 34650K .......... .......... .......... .......... .......... 47% 265M 0s 2019-11-28T21:59:57.341 INFO:teuthology.orchestra.run.smithi074.stderr: 34700K .......... .......... .......... .......... .......... 47% 270M 0s 2019-11-28T21:59:57.341 INFO:teuthology.orchestra.run.smithi074.stderr: 34750K .......... .......... .......... .......... .......... 47% 231M 0s 2019-11-28T21:59:57.341 INFO:teuthology.orchestra.run.smithi074.stderr: 34800K .......... .......... .......... .......... .......... 47% 262M 0s 2019-11-28T21:59:57.341 INFO:teuthology.orchestra.run.smithi074.stderr: 34850K .......... .......... .......... .......... .......... 47% 264M 0s 2019-11-28T21:59:57.341 INFO:teuthology.orchestra.run.smithi074.stderr: 34900K .......... .......... .......... .......... .......... 47% 277M 0s 2019-11-28T21:59:57.342 INFO:teuthology.orchestra.run.smithi074.stderr: 34950K .......... .......... .......... .......... .......... 47% 228M 0s 2019-11-28T21:59:57.342 INFO:teuthology.orchestra.run.smithi074.stderr: 35000K .......... .......... .......... .......... .......... 47% 266M 0s 2019-11-28T21:59:57.342 INFO:teuthology.orchestra.run.smithi074.stderr: 35050K .......... .......... .......... .......... .......... 47% 276M 0s 2019-11-28T21:59:57.342 INFO:teuthology.orchestra.run.smithi074.stderr: 35100K .......... .......... .......... .......... .......... 47% 262M 0s 2019-11-28T21:59:57.342 INFO:teuthology.orchestra.run.smithi074.stderr: 35150K .......... .......... .......... .......... .......... 47% 242M 0s 2019-11-28T21:59:57.342 INFO:teuthology.orchestra.run.smithi074.stderr: 35200K .......... .......... .......... .......... .......... 47% 255M 0s 2019-11-28T21:59:57.342 INFO:teuthology.orchestra.run.smithi074.stderr: 35250K .......... .......... .......... .......... .......... 47% 254M 0s 2019-11-28T21:59:57.343 INFO:teuthology.orchestra.run.smithi074.stderr: 35300K .......... .......... .......... .......... .......... 48% 273M 0s 2019-11-28T21:59:57.343 INFO:teuthology.orchestra.run.smithi074.stderr: 35350K .......... .......... .......... .......... .......... 48% 233M 0s 2019-11-28T21:59:57.343 INFO:teuthology.orchestra.run.smithi074.stderr: 35400K .......... .......... .......... .......... .......... 48% 271M 0s 2019-11-28T21:59:57.343 INFO:teuthology.orchestra.run.smithi074.stderr: 35450K .......... .......... .......... .......... .......... 48% 268M 0s 2019-11-28T21:59:57.343 INFO:teuthology.orchestra.run.smithi074.stderr: 35500K .......... .......... .......... .......... .......... 48% 266M 0s 2019-11-28T21:59:57.343 INFO:teuthology.orchestra.run.smithi074.stderr: 35550K .......... .......... .......... .......... .......... 48% 225M 0s 2019-11-28T21:59:57.343 INFO:teuthology.orchestra.run.smithi074.stderr: 35600K .......... .......... .......... .......... .......... 48% 261M 0s 2019-11-28T21:59:57.343 INFO:teuthology.orchestra.run.smithi074.stderr: 35650K .......... .......... .......... .......... .......... 48% 256M 0s 2019-11-28T21:59:57.344 INFO:teuthology.orchestra.run.smithi074.stderr: 35700K .......... .......... .......... .......... .......... 48% 262M 0s 2019-11-28T21:59:57.344 INFO:teuthology.orchestra.run.smithi074.stderr: 35750K .......... .......... .......... .......... .......... 48% 236M 0s 2019-11-28T21:59:57.344 INFO:teuthology.orchestra.run.smithi074.stderr: 35800K .......... .......... .......... .......... .......... 48% 183M 0s 2019-11-28T21:59:57.344 INFO:teuthology.orchestra.run.smithi074.stderr: 35850K .......... .......... .......... .......... .......... 48% 213M 0s 2019-11-28T21:59:57.344 INFO:teuthology.orchestra.run.smithi074.stderr: 35900K .......... .......... .......... .......... .......... 48% 230M 0s 2019-11-28T21:59:57.344 INFO:teuthology.orchestra.run.smithi074.stderr: 35950K .......... .......... .......... .......... .......... 48% 238M 0s 2019-11-28T21:59:57.344 INFO:teuthology.orchestra.run.smithi074.stderr: 36000K .......... .......... .......... .......... .......... 49% 264M 0s 2019-11-28T21:59:57.345 INFO:teuthology.orchestra.run.smithi074.stderr: 36050K .......... .......... .......... .......... .......... 49% 274M 0s 2019-11-28T21:59:57.345 INFO:teuthology.orchestra.run.smithi074.stderr: 36100K .......... .......... .......... .......... .......... 49% 268M 0s 2019-11-28T21:59:57.345 INFO:teuthology.orchestra.run.smithi074.stderr: 36150K .......... .......... .......... .......... .......... 49% 218M 0s 2019-11-28T21:59:57.345 INFO:teuthology.orchestra.run.smithi074.stderr: 36200K .......... .......... .......... .......... .......... 49% 275M 0s 2019-11-28T21:59:57.345 INFO:teuthology.orchestra.run.smithi074.stderr: 36250K .......... .......... .......... .......... .......... 49% 220M 0s 2019-11-28T21:59:57.345 INFO:teuthology.orchestra.run.smithi074.stderr: 36300K .......... .......... .......... .......... .......... 49% 211M 0s 2019-11-28T21:59:57.345 INFO:teuthology.orchestra.run.smithi074.stderr: 36350K .......... .......... .......... .......... .......... 49% 220M 0s 2019-11-28T21:59:57.346 INFO:teuthology.orchestra.run.smithi074.stderr: 36400K .......... .......... .......... .......... .......... 49% 270M 0s 2019-11-28T21:59:57.346 INFO:teuthology.orchestra.run.smithi074.stderr: 36450K .......... .......... .......... .......... .......... 49% 288M 0s 2019-11-28T21:59:57.346 INFO:teuthology.orchestra.run.smithi074.stderr: 36500K .......... .......... .......... .......... .......... 49% 278M 0s 2019-11-28T21:59:57.346 INFO:teuthology.orchestra.run.smithi074.stderr: 36550K .......... .......... .......... .......... .......... 49% 229M 0s 2019-11-28T21:59:57.346 INFO:teuthology.orchestra.run.smithi074.stderr: 36600K .......... .......... .......... .......... .......... 49% 271M 0s 2019-11-28T21:59:57.346 INFO:teuthology.orchestra.run.smithi074.stderr: 36650K .......... .......... .......... .......... .......... 49% 280M 0s 2019-11-28T21:59:57.346 INFO:teuthology.orchestra.run.smithi074.stderr: 36700K .......... .......... .......... .......... .......... 49% 282M 0s 2019-11-28T21:59:57.346 INFO:teuthology.orchestra.run.smithi074.stderr: 36750K .......... .......... .......... .......... .......... 50% 225M 0s 2019-11-28T21:59:57.347 INFO:teuthology.orchestra.run.smithi074.stderr: 36800K .......... .......... .......... .......... .......... 50% 269M 0s 2019-11-28T21:59:57.347 INFO:teuthology.orchestra.run.smithi074.stderr: 36850K .......... .......... .......... .......... .......... 50% 272M 0s 2019-11-28T21:59:57.347 INFO:teuthology.orchestra.run.smithi074.stderr: 36900K .......... .......... .......... .......... .......... 50% 280M 0s 2019-11-28T21:59:57.347 INFO:teuthology.orchestra.run.smithi074.stderr: 36950K .......... .......... .......... .......... .......... 50% 247M 0s 2019-11-28T21:59:57.347 INFO:teuthology.orchestra.run.smithi074.stderr: 37000K .......... .......... .......... .......... .......... 50% 276M 0s 2019-11-28T21:59:57.347 INFO:teuthology.orchestra.run.smithi074.stderr: 37050K .......... .......... .......... .......... .......... 50% 269M 0s 2019-11-28T21:59:57.347 INFO:teuthology.orchestra.run.smithi074.stderr: 37100K .......... .......... .......... .......... .......... 50% 230M 0s 2019-11-28T21:59:57.348 INFO:teuthology.orchestra.run.smithi074.stderr: 37150K .......... .......... .......... .......... .......... 50% 241M 0s 2019-11-28T21:59:57.348 INFO:teuthology.orchestra.run.smithi074.stderr: 37200K .......... .......... .......... .......... .......... 50% 285M 0s 2019-11-28T21:59:57.348 INFO:teuthology.orchestra.run.smithi074.stderr: 37250K .......... .......... .......... .......... .......... 50% 279M 0s 2019-11-28T21:59:57.348 INFO:teuthology.orchestra.run.smithi074.stderr: 37300K .......... .......... .......... .......... .......... 50% 240M 0s 2019-11-28T21:59:57.348 INFO:teuthology.orchestra.run.smithi074.stderr: 37350K .......... .......... .......... .......... .......... 50% 228M 0s 2019-11-28T21:59:57.348 INFO:teuthology.orchestra.run.smithi074.stderr: 37400K .......... .......... .......... .......... .......... 50% 285M 0s 2019-11-28T21:59:57.348 INFO:teuthology.orchestra.run.smithi074.stderr: 37450K .......... .......... .......... .......... .......... 50% 280M 0s 2019-11-28T21:59:57.349 INFO:teuthology.orchestra.run.smithi074.stderr: 37500K .......... .......... .......... .......... .......... 51% 245M 0s 2019-11-28T21:59:57.349 INFO:teuthology.orchestra.run.smithi074.stderr: 37550K .......... .......... .......... .......... .......... 51% 251M 0s 2019-11-28T21:59:57.349 INFO:teuthology.orchestra.run.smithi074.stderr: 37600K .......... .......... .......... .......... .......... 51% 242M 0s 2019-11-28T21:59:57.349 INFO:teuthology.orchestra.run.smithi074.stderr: 37650K .......... .......... .......... .......... .......... 51% 275M 0s 2019-11-28T21:59:57.349 INFO:teuthology.orchestra.run.smithi074.stderr: 37700K .......... .......... .......... .......... .......... 51% 199M 0s 2019-11-28T21:59:57.349 INFO:teuthology.orchestra.run.smithi074.stderr: 37750K .......... .......... .......... .......... .......... 51% 208M 0s 2019-11-28T21:59:57.349 INFO:teuthology.orchestra.run.smithi074.stderr: 37800K .......... .......... .......... .......... .......... 51% 260M 0s 2019-11-28T21:59:57.350 INFO:teuthology.orchestra.run.smithi074.stderr: 37850K .......... .......... .......... .......... .......... 51% 251M 0s 2019-11-28T21:59:57.350 INFO:teuthology.orchestra.run.smithi074.stderr: 37900K .......... .......... .......... .......... .......... 51% 259M 0s 2019-11-28T21:59:57.350 INFO:teuthology.orchestra.run.smithi074.stderr: 37950K .......... .......... .......... .......... .......... 51% 227M 0s 2019-11-28T21:59:57.350 INFO:teuthology.orchestra.run.smithi074.stderr: 38000K .......... .......... .......... .......... .......... 51% 257M 0s 2019-11-28T21:59:57.350 INFO:teuthology.orchestra.run.smithi074.stderr: 38050K .......... .......... .......... .......... .......... 51% 248M 0s 2019-11-28T21:59:57.350 INFO:teuthology.orchestra.run.smithi074.stderr: 38100K .......... .......... .......... .......... .......... 51% 256M 0s 2019-11-28T21:59:57.350 INFO:teuthology.orchestra.run.smithi074.stderr: 38150K .......... .......... .......... .......... .......... 51% 215M 0s 2019-11-28T21:59:57.351 INFO:teuthology.orchestra.run.smithi074.stderr: 38200K .......... .......... .......... .......... .......... 51% 280M 0s 2019-11-28T21:59:57.351 INFO:teuthology.orchestra.run.smithi074.stderr: 38250K .......... .......... .......... .......... .......... 52% 275M 0s 2019-11-28T21:59:57.351 INFO:teuthology.orchestra.run.smithi074.stderr: 38300K .......... .......... .......... .......... .......... 52% 272M 0s 2019-11-28T21:59:57.351 INFO:teuthology.orchestra.run.smithi074.stderr: 38350K .......... .......... .......... .......... .......... 52% 237M 0s 2019-11-28T21:59:57.351 INFO:teuthology.orchestra.run.smithi074.stderr: 38400K .......... .......... .......... .......... .......... 52% 248M 0s 2019-11-28T21:59:57.351 INFO:teuthology.orchestra.run.smithi074.stderr: 38450K .......... .......... .......... .......... .......... 52% 281M 0s 2019-11-28T21:59:57.351 INFO:teuthology.orchestra.run.smithi074.stderr: 38500K .......... .......... .......... .......... .......... 52% 271M 0s 2019-11-28T21:59:57.352 INFO:teuthology.orchestra.run.smithi074.stderr: 38550K .......... .......... .......... .......... .......... 52% 253M 0s 2019-11-28T21:59:57.352 INFO:teuthology.orchestra.run.smithi074.stderr: 38600K .......... .......... .......... .......... .......... 52% 272M 0s 2019-11-28T21:59:57.352 INFO:teuthology.orchestra.run.smithi074.stderr: 38650K .......... .......... .......... .......... .......... 52% 274M 0s 2019-11-28T21:59:57.352 INFO:teuthology.orchestra.run.smithi074.stderr: 38700K .......... .......... .......... .......... .......... 52% 286M 0s 2019-11-28T21:59:57.352 INFO:teuthology.orchestra.run.smithi074.stderr: 38750K .......... .......... .......... .......... .......... 52% 229M 0s 2019-11-28T21:59:57.352 INFO:teuthology.orchestra.run.smithi074.stderr: 38800K .......... .......... .......... .......... .......... 52% 276M 0s 2019-11-28T21:59:57.352 INFO:teuthology.orchestra.run.smithi074.stderr: 38850K .......... .......... .......... .......... .......... 52% 282M 0s 2019-11-28T21:59:57.352 INFO:teuthology.orchestra.run.smithi074.stderr: 38900K .......... .......... .......... .......... .......... 52% 272M 0s 2019-11-28T21:59:57.353 INFO:teuthology.orchestra.run.smithi074.stderr: 38950K .......... .......... .......... .......... .......... 53% 258M 0s 2019-11-28T21:59:57.353 INFO:teuthology.orchestra.run.smithi074.stderr: 39000K .......... .......... .......... .......... .......... 53% 283M 0s 2019-11-28T21:59:57.353 INFO:teuthology.orchestra.run.smithi074.stderr: 39050K .......... .......... .......... .......... .......... 53% 259M 0s 2019-11-28T21:59:57.353 INFO:teuthology.orchestra.run.smithi074.stderr: 39100K .......... .......... .......... .......... .......... 53% 274M 0s 2019-11-28T21:59:57.353 INFO:teuthology.orchestra.run.smithi074.stderr: 39150K .......... .......... .......... .......... .......... 53% 194M 0s 2019-11-28T21:59:57.353 INFO:teuthology.orchestra.run.smithi074.stderr: 39200K .......... .......... .......... .......... .......... 53% 243M 0s 2019-11-28T21:59:57.353 INFO:teuthology.orchestra.run.smithi074.stderr: 39250K .......... .......... .......... .......... .......... 53% 276M 0s 2019-11-28T21:59:57.354 INFO:teuthology.orchestra.run.smithi074.stderr: 39300K .......... .......... .......... .......... .......... 53% 271M 0s 2019-11-28T21:59:57.354 INFO:teuthology.orchestra.run.smithi074.stderr: 39350K .......... .......... .......... .......... .......... 53% 236M 0s 2019-11-28T21:59:57.354 INFO:teuthology.orchestra.run.smithi074.stderr: 39400K .......... .......... .......... .......... .......... 53% 277M 0s 2019-11-28T21:59:57.354 INFO:teuthology.orchestra.run.smithi074.stderr: 39450K .......... .......... .......... .......... .......... 53% 285M 0s 2019-11-28T21:59:57.354 INFO:teuthology.orchestra.run.smithi074.stderr: 39500K .......... .......... .......... .......... .......... 53% 266M 0s 2019-11-28T21:59:57.354 INFO:teuthology.orchestra.run.smithi074.stderr: 39550K .......... .......... .......... .......... .......... 53% 219M 0s 2019-11-28T21:59:57.354 INFO:teuthology.orchestra.run.smithi074.stderr: 39600K .......... .......... .......... .......... .......... 53% 275M 0s 2019-11-28T21:59:57.355 INFO:teuthology.orchestra.run.smithi074.stderr: 39650K .......... .......... .......... .......... .......... 53% 273M 0s 2019-11-28T21:59:57.355 INFO:teuthology.orchestra.run.smithi074.stderr: 39700K .......... .......... .......... .......... .......... 54% 274M 0s 2019-11-28T21:59:57.355 INFO:teuthology.orchestra.run.smithi074.stderr: 39750K .......... .......... .......... .......... .......... 54% 257M 0s 2019-11-28T21:59:57.355 INFO:teuthology.orchestra.run.smithi074.stderr: 39800K .......... .......... .......... .......... .......... 54% 253M 0s 2019-11-28T21:59:57.355 INFO:teuthology.orchestra.run.smithi074.stderr: 39850K .......... .......... .......... .......... .......... 54% 227M 0s 2019-11-28T21:59:57.355 INFO:teuthology.orchestra.run.smithi074.stderr: 39900K .......... .......... .......... .......... .......... 54% 245M 0s 2019-11-28T21:59:57.355 INFO:teuthology.orchestra.run.smithi074.stderr: 39950K .......... .......... .......... .......... .......... 54% 210M 0s 2019-11-28T21:59:57.356 INFO:teuthology.orchestra.run.smithi074.stderr: 40000K .......... .......... .......... .......... .......... 54% 232M 0s 2019-11-28T21:59:57.356 INFO:teuthology.orchestra.run.smithi074.stderr: 40050K .......... .......... .......... .......... .......... 54% 240M 0s 2019-11-28T21:59:57.356 INFO:teuthology.orchestra.run.smithi074.stderr: 40100K .......... .......... .......... .......... .......... 54% 242M 0s 2019-11-28T21:59:57.356 INFO:teuthology.orchestra.run.smithi074.stderr: 40150K .......... .......... .......... .......... .......... 54% 248M 0s 2019-11-28T21:59:57.356 INFO:teuthology.orchestra.run.smithi074.stderr: 40200K .......... .......... .......... .......... .......... 54% 272M 0s 2019-11-28T21:59:57.356 INFO:teuthology.orchestra.run.smithi074.stderr: 40250K .......... .......... .......... .......... .......... 54% 273M 0s 2019-11-28T21:59:57.356 INFO:teuthology.orchestra.run.smithi074.stderr: 40300K .......... .......... .......... .......... .......... 54% 279M 0s 2019-11-28T21:59:57.357 INFO:teuthology.orchestra.run.smithi074.stderr: 40350K .......... .......... .......... .......... .......... 54% 236M 0s 2019-11-28T21:59:57.357 INFO:teuthology.orchestra.run.smithi074.stderr: 40400K .......... .......... .......... .......... .......... 54% 278M 0s 2019-11-28T21:59:57.357 INFO:teuthology.orchestra.run.smithi074.stderr: 40450K .......... .......... .......... .......... .......... 55% 270M 0s 2019-11-28T21:59:57.357 INFO:teuthology.orchestra.run.smithi074.stderr: 40500K .......... .......... .......... .......... .......... 55% 266M 0s 2019-11-28T21:59:57.357 INFO:teuthology.orchestra.run.smithi074.stderr: 40550K .......... .......... .......... .......... .......... 55% 241M 0s 2019-11-28T21:59:57.357 INFO:teuthology.orchestra.run.smithi074.stderr: 40600K .......... .......... .......... .......... .......... 55% 271M 0s 2019-11-28T21:59:57.357 INFO:teuthology.orchestra.run.smithi074.stderr: 40650K .......... .......... .......... .......... .......... 55% 289M 0s 2019-11-28T21:59:57.358 INFO:teuthology.orchestra.run.smithi074.stderr: 40700K .......... .......... .......... .......... .......... 55% 272M 0s 2019-11-28T21:59:57.358 INFO:teuthology.orchestra.run.smithi074.stderr: 40750K .......... .......... .......... .......... .......... 55% 230M 0s 2019-11-28T21:59:57.358 INFO:teuthology.orchestra.run.smithi074.stderr: 40800K .......... .......... .......... .......... .......... 55% 265M 0s 2019-11-28T21:59:57.358 INFO:teuthology.orchestra.run.smithi074.stderr: 40850K .......... .......... .......... .......... .......... 55% 297M 0s 2019-11-28T21:59:57.358 INFO:teuthology.orchestra.run.smithi074.stderr: 40900K .......... .......... .......... .......... .......... 55% 307M 0s 2019-11-28T21:59:57.358 INFO:teuthology.orchestra.run.smithi074.stderr: 40950K .......... .......... .......... .......... .......... 55% 246M 0s 2019-11-28T21:59:57.358 INFO:teuthology.orchestra.run.smithi074.stderr: 41000K .......... .......... .......... .......... .......... 55% 283M 0s 2019-11-28T21:59:57.358 INFO:teuthology.orchestra.run.smithi074.stderr: 41050K .......... .......... .......... .......... .......... 55% 269M 0s 2019-11-28T21:59:57.359 INFO:teuthology.orchestra.run.smithi074.stderr: 41100K .......... .......... .......... .......... .......... 55% 310M 0s 2019-11-28T21:59:57.359 INFO:teuthology.orchestra.run.smithi074.stderr: 41150K .......... .......... .......... .......... .......... 56% 258M 0s 2019-11-28T21:59:57.359 INFO:teuthology.orchestra.run.smithi074.stderr: 41200K .......... .......... .......... .......... .......... 56% 302M 0s 2019-11-28T21:59:57.359 INFO:teuthology.orchestra.run.smithi074.stderr: 41250K .......... .......... .......... .......... .......... 56% 313M 0s 2019-11-28T21:59:57.359 INFO:teuthology.orchestra.run.smithi074.stderr: 41300K .......... .......... .......... .......... .......... 56% 265M 0s 2019-11-28T21:59:57.359 INFO:teuthology.orchestra.run.smithi074.stderr: 41350K .......... .......... .......... .......... .......... 56% 248M 0s 2019-11-28T21:59:57.360 INFO:teuthology.orchestra.run.smithi074.stderr: 41400K .......... .......... .......... .......... .......... 56% 303M 0s 2019-11-28T21:59:57.360 INFO:teuthology.orchestra.run.smithi074.stderr: 41450K .......... .......... .......... .......... .......... 56% 254M 0s 2019-11-28T21:59:57.360 INFO:teuthology.orchestra.run.smithi074.stderr: 41500K .......... .......... .......... .......... .......... 56% 303M 0s 2019-11-28T21:59:57.360 INFO:teuthology.orchestra.run.smithi074.stderr: 41550K .......... .......... .......... .......... .......... 56% 196M 0s 2019-11-28T21:59:57.360 INFO:teuthology.orchestra.run.smithi074.stderr: 41600K .......... .......... .......... .......... .......... 56% 256M 0s 2019-11-28T21:59:57.360 INFO:teuthology.orchestra.run.smithi074.stderr: 41650K .......... .......... .......... .......... .......... 56% 297M 0s 2019-11-28T21:59:57.360 INFO:teuthology.orchestra.run.smithi074.stderr: 41700K .......... .......... .......... .......... .......... 56% 296M 0s 2019-11-28T21:59:57.361 INFO:teuthology.orchestra.run.smithi074.stderr: 41750K .......... .......... .......... .......... .......... 56% 251M 0s 2019-11-28T21:59:57.361 INFO:teuthology.orchestra.run.smithi074.stderr: 41800K .......... .......... .......... .......... .......... 56% 274M 0s 2019-11-28T21:59:57.361 INFO:teuthology.orchestra.run.smithi074.stderr: 41850K .......... .......... .......... .......... .......... 56% 250M 0s 2019-11-28T21:59:57.361 INFO:teuthology.orchestra.run.smithi074.stderr: 41900K .......... .......... .......... .......... .......... 57% 257M 0s 2019-11-28T21:59:57.361 INFO:teuthology.orchestra.run.smithi074.stderr: 41950K .......... .......... .......... .......... .......... 57% 197M 0s 2019-11-28T21:59:57.361 INFO:teuthology.orchestra.run.smithi074.stderr: 42000K .......... .......... .......... .......... .......... 57% 245M 0s 2019-11-28T21:59:57.361 INFO:teuthology.orchestra.run.smithi074.stderr: 42050K .......... .......... .......... .......... .......... 57% 294M 0s 2019-11-28T21:59:57.362 INFO:teuthology.orchestra.run.smithi074.stderr: 42100K .......... .......... .......... .......... .......... 57% 288M 0s 2019-11-28T21:59:57.362 INFO:teuthology.orchestra.run.smithi074.stderr: 42150K .......... .......... .......... .......... .......... 57% 268M 0s 2019-11-28T21:59:57.362 INFO:teuthology.orchestra.run.smithi074.stderr: 42200K .......... .......... .......... .......... .......... 57% 304M 0s 2019-11-28T21:59:57.362 INFO:teuthology.orchestra.run.smithi074.stderr: 42250K .......... .......... .......... .......... .......... 57% 299M 0s 2019-11-28T21:59:57.362 INFO:teuthology.orchestra.run.smithi074.stderr: 42300K .......... .......... .......... .......... .......... 57% 262M 0s 2019-11-28T21:59:57.362 INFO:teuthology.orchestra.run.smithi074.stderr: 42350K .......... .......... .......... .......... .......... 57% 221M 0s 2019-11-28T21:59:57.362 INFO:teuthology.orchestra.run.smithi074.stderr: 42400K .......... .......... .......... .......... .......... 57% 308M 0s 2019-11-28T21:59:57.363 INFO:teuthology.orchestra.run.smithi074.stderr: 42450K .......... .......... .......... .......... .......... 57% 291M 0s 2019-11-28T21:59:57.363 INFO:teuthology.orchestra.run.smithi074.stderr: 42500K .......... .......... .......... .......... .......... 57% 289M 0s 2019-11-28T21:59:57.363 INFO:teuthology.orchestra.run.smithi074.stderr: 42550K .......... .......... .......... .......... .......... 57% 239M 0s 2019-11-28T21:59:57.363 INFO:teuthology.orchestra.run.smithi074.stderr: 42600K .......... .......... .......... .......... .......... 57% 295M 0s 2019-11-28T21:59:57.363 INFO:teuthology.orchestra.run.smithi074.stderr: 42650K .......... .......... .......... .......... .......... 58% 268M 0s 2019-11-28T21:59:57.363 INFO:teuthology.orchestra.run.smithi074.stderr: 42700K .......... .......... .......... .......... .......... 58% 290M 0s 2019-11-28T21:59:57.363 INFO:teuthology.orchestra.run.smithi074.stderr: 42750K .......... .......... .......... .......... .......... 58% 239M 0s 2019-11-28T21:59:57.363 INFO:teuthology.orchestra.run.smithi074.stderr: 42800K .......... .......... .......... .......... .......... 58% 291M 0s 2019-11-28T21:59:57.364 INFO:teuthology.orchestra.run.smithi074.stderr: 42850K .......... .......... .......... .......... .......... 58% 289M 0s 2019-11-28T21:59:57.364 INFO:teuthology.orchestra.run.smithi074.stderr: 42900K .......... .......... .......... .......... .......... 58% 286M 0s 2019-11-28T21:59:57.364 INFO:teuthology.orchestra.run.smithi074.stderr: 42950K .......... .......... .......... .......... .......... 58% 260M 0s 2019-11-28T21:59:57.364 INFO:teuthology.orchestra.run.smithi074.stderr: 43000K .......... .......... .......... .......... .......... 58% 283M 0s 2019-11-28T21:59:57.364 INFO:teuthology.orchestra.run.smithi074.stderr: 43050K .......... .......... .......... .......... .......... 58% 290M 0s 2019-11-28T21:59:57.364 INFO:teuthology.orchestra.run.smithi074.stderr: 43100K .......... .......... .......... .......... .......... 58% 294M 0s 2019-11-28T21:59:57.364 INFO:teuthology.orchestra.run.smithi074.stderr: 43150K .......... .......... .......... .......... .......... 58% 241M 0s 2019-11-28T21:59:57.365 INFO:teuthology.orchestra.run.smithi074.stderr: 43200K .......... .......... .......... .......... .......... 58% 295M 0s 2019-11-28T21:59:57.365 INFO:teuthology.orchestra.run.smithi074.stderr: 43250K .......... .......... .......... .......... .......... 58% 266M 0s 2019-11-28T21:59:57.365 INFO:teuthology.orchestra.run.smithi074.stderr: 43300K .......... .......... .......... .......... .......... 58% 284M 0s 2019-11-28T21:59:57.365 INFO:teuthology.orchestra.run.smithi074.stderr: 43350K .......... .......... .......... .......... .......... 59% 260M 0s 2019-11-28T21:59:57.365 INFO:teuthology.orchestra.run.smithi074.stderr: 43400K .......... .......... .......... .......... .......... 59% 266M 0s 2019-11-28T21:59:57.365 INFO:teuthology.orchestra.run.smithi074.stderr: 43450K .......... .......... .......... .......... .......... 59% 287M 0s 2019-11-28T21:59:57.365 INFO:teuthology.orchestra.run.smithi074.stderr: 43500K .......... .......... .......... .......... .......... 59% 277M 0s 2019-11-28T21:59:57.366 INFO:teuthology.orchestra.run.smithi074.stderr: 43550K .......... .......... .......... .......... .......... 59% 240M 0s 2019-11-28T21:59:57.366 INFO:teuthology.orchestra.run.smithi074.stderr: 43600K .......... .......... .......... .......... .......... 59% 286M 0s 2019-11-28T21:59:57.366 INFO:teuthology.orchestra.run.smithi074.stderr: 43650K .......... .......... .......... .......... .......... 59% 288M 0s 2019-11-28T21:59:57.366 INFO:teuthology.orchestra.run.smithi074.stderr: 43700K .......... .......... .......... .......... .......... 59% 266M 0s 2019-11-28T21:59:57.366 INFO:teuthology.orchestra.run.smithi074.stderr: 43750K .......... .......... .......... .......... .......... 59% 258M 0s 2019-11-28T21:59:57.366 INFO:teuthology.orchestra.run.smithi074.stderr: 43800K .......... .......... .......... .......... .......... 59% 268M 0s 2019-11-28T21:59:57.366 INFO:teuthology.orchestra.run.smithi074.stderr: 43850K .......... .......... .......... .......... .......... 59% 284M 0s 2019-11-28T21:59:57.367 INFO:teuthology.orchestra.run.smithi074.stderr: 43900K .......... .......... .......... .......... .......... 59% 278M 0s 2019-11-28T21:59:57.367 INFO:teuthology.orchestra.run.smithi074.stderr: 43950K .......... .......... .......... .......... .......... 59% 223M 0s 2019-11-28T21:59:57.367 INFO:teuthology.orchestra.run.smithi074.stderr: 44000K .......... .......... .......... .......... .......... 59% 267M 0s 2019-11-28T21:59:57.367 INFO:teuthology.orchestra.run.smithi074.stderr: 44050K .......... .......... .......... .......... .......... 59% 237M 0s 2019-11-28T21:59:57.367 INFO:teuthology.orchestra.run.smithi074.stderr: 44100K .......... .......... .......... .......... .......... 60% 288M 0s 2019-11-28T21:59:57.367 INFO:teuthology.orchestra.run.smithi074.stderr: 44150K .......... .......... .......... .......... .......... 60% 240M 0s 2019-11-28T21:59:57.367 INFO:teuthology.orchestra.run.smithi074.stderr: 44200K .......... .......... .......... .......... .......... 60% 285M 0s 2019-11-28T21:59:57.368 INFO:teuthology.orchestra.run.smithi074.stderr: 44250K .......... .......... .......... .......... .......... 60% 276M 0s 2019-11-28T21:59:57.368 INFO:teuthology.orchestra.run.smithi074.stderr: 44300K .......... .......... .......... .......... .......... 60% 268M 0s 2019-11-28T21:59:57.368 INFO:teuthology.orchestra.run.smithi074.stderr: 44350K .......... .......... .......... .......... .......... 60% 228M 0s 2019-11-28T21:59:57.368 INFO:teuthology.orchestra.run.smithi074.stderr: 44400K .......... .......... .......... .......... .......... 60% 248M 0s 2019-11-28T21:59:57.368 INFO:teuthology.orchestra.run.smithi074.stderr: 44450K .......... .......... .......... .......... .......... 60% 209M 0s 2019-11-28T21:59:57.368 INFO:teuthology.orchestra.run.smithi074.stderr: 44500K .......... .......... .......... .......... .......... 60% 289M 0s 2019-11-28T21:59:57.368 INFO:teuthology.orchestra.run.smithi074.stderr: 44550K .......... .......... .......... .......... .......... 60% 260M 0s 2019-11-28T21:59:57.368 INFO:teuthology.orchestra.run.smithi074.stderr: 44600K .......... .......... .......... .......... .......... 60% 225M 0s 2019-11-28T21:59:57.369 INFO:teuthology.orchestra.run.smithi074.stderr: 44650K .......... .......... .......... .......... .......... 60% 277M 0s 2019-11-28T21:59:57.369 INFO:teuthology.orchestra.run.smithi074.stderr: 44700K .......... .......... .......... .......... .......... 60% 259M 0s 2019-11-28T21:59:57.369 INFO:teuthology.orchestra.run.smithi074.stderr: 44750K .......... .......... .......... .......... .......... 60% 189M 0s 2019-11-28T21:59:57.369 INFO:teuthology.orchestra.run.smithi074.stderr: 44800K .......... .......... .......... .......... .......... 60% 294M 0s 2019-11-28T21:59:57.369 INFO:teuthology.orchestra.run.smithi074.stderr: 44850K .......... .......... .......... .......... .......... 61% 285M 0s 2019-11-28T21:59:57.369 INFO:teuthology.orchestra.run.smithi074.stderr: 44900K .......... .......... .......... .......... .......... 61% 291M 0s 2019-11-28T21:59:57.369 INFO:teuthology.orchestra.run.smithi074.stderr: 44950K .......... .......... .......... .......... .......... 61% 248M 0s 2019-11-28T21:59:57.370 INFO:teuthology.orchestra.run.smithi074.stderr: 45000K .......... .......... .......... .......... .......... 61% 288M 0s 2019-11-28T21:59:57.370 INFO:teuthology.orchestra.run.smithi074.stderr: 45050K .......... .......... .......... .......... .......... 61% 276M 0s 2019-11-28T21:59:57.370 INFO:teuthology.orchestra.run.smithi074.stderr: 45100K .......... .......... .......... .......... .......... 61% 282M 0s 2019-11-28T21:59:57.370 INFO:teuthology.orchestra.run.smithi074.stderr: 45150K .......... .......... .......... .......... .......... 61% 264M 0s 2019-11-28T21:59:57.370 INFO:teuthology.orchestra.run.smithi074.stderr: 45200K .......... .......... .......... .......... .......... 61% 270M 0s 2019-11-28T21:59:57.370 INFO:teuthology.orchestra.run.smithi074.stderr: 45250K .......... .......... .......... .......... .......... 61% 287M 0s 2019-11-28T21:59:57.370 INFO:teuthology.orchestra.run.smithi074.stderr: 45300K .......... .......... .......... .......... .......... 61% 253M 0s 2019-11-28T21:59:57.371 INFO:teuthology.orchestra.run.smithi074.stderr: 45350K .......... .......... .......... .......... .......... 61% 237M 0s 2019-11-28T21:59:57.371 INFO:teuthology.orchestra.run.smithi074.stderr: 45400K .......... .......... .......... .......... .......... 61% 279M 0s 2019-11-28T21:59:57.371 INFO:teuthology.orchestra.run.smithi074.stderr: 45450K .......... .......... .......... .......... .......... 61% 262M 0s 2019-11-28T21:59:57.371 INFO:teuthology.orchestra.run.smithi074.stderr: 45500K .......... .......... .......... .......... .......... 61% 278M 0s 2019-11-28T21:59:57.371 INFO:teuthology.orchestra.run.smithi074.stderr: 45550K .......... .......... .......... .......... .......... 61% 258M 0s 2019-11-28T21:59:57.371 INFO:teuthology.orchestra.run.smithi074.stderr: 45600K .......... .......... .......... .......... .......... 62% 263M 0s 2019-11-28T21:59:57.371 INFO:teuthology.orchestra.run.smithi074.stderr: 45650K .......... .......... .......... .......... .......... 62% 279M 0s 2019-11-28T21:59:57.372 INFO:teuthology.orchestra.run.smithi074.stderr: 45700K .......... .......... .......... .......... .......... 62% 281M 0s 2019-11-28T21:59:57.372 INFO:teuthology.orchestra.run.smithi074.stderr: 45750K .......... .......... .......... .......... .......... 62% 231M 0s 2019-11-28T21:59:57.372 INFO:teuthology.orchestra.run.smithi074.stderr: 45800K .......... .......... .......... .......... .......... 62% 284M 0s 2019-11-28T21:59:57.372 INFO:teuthology.orchestra.run.smithi074.stderr: 45850K .......... .......... .......... .......... .......... 62% 291M 0s 2019-11-28T21:59:57.372 INFO:teuthology.orchestra.run.smithi074.stderr: 45900K .......... .......... .......... .......... .......... 62% 261M 0s 2019-11-28T21:59:57.372 INFO:teuthology.orchestra.run.smithi074.stderr: 45950K .......... .......... .......... .......... .......... 62% 254M 0s 2019-11-28T21:59:57.372 INFO:teuthology.orchestra.run.smithi074.stderr: 46000K .......... .......... .......... .......... .......... 62% 257M 0s 2019-11-28T21:59:57.373 INFO:teuthology.orchestra.run.smithi074.stderr: 46050K .......... .......... .......... .......... .......... 62% 257M 0s 2019-11-28T21:59:57.373 INFO:teuthology.orchestra.run.smithi074.stderr: 46100K .......... .......... .......... .......... .......... 62% 251M 0s 2019-11-28T21:59:57.373 INFO:teuthology.orchestra.run.smithi074.stderr: 46150K .......... .......... .......... .......... .......... 62% 223M 0s 2019-11-28T21:59:57.373 INFO:teuthology.orchestra.run.smithi074.stderr: 46200K .......... .......... .......... .......... .......... 62% 279M 0s 2019-11-28T21:59:57.373 INFO:teuthology.orchestra.run.smithi074.stderr: 46250K .......... .......... .......... .......... .......... 62% 265M 0s 2019-11-28T21:59:57.373 INFO:teuthology.orchestra.run.smithi074.stderr: 46300K .......... .......... .......... .......... .......... 63% 277M 0s 2019-11-28T21:59:57.373 INFO:teuthology.orchestra.run.smithi074.stderr: 46350K .......... .......... .......... .......... .......... 63% 240M 0s 2019-11-28T21:59:57.373 INFO:teuthology.orchestra.run.smithi074.stderr: 46400K .......... .......... .......... .......... .......... 63% 292M 0s 2019-11-28T21:59:57.374 INFO:teuthology.orchestra.run.smithi074.stderr: 46450K .......... .......... .......... .......... .......... 63% 270M 0s 2019-11-28T21:59:57.374 INFO:teuthology.orchestra.run.smithi074.stderr: 46500K .......... .......... .......... .......... .......... 63% 287M 0s 2019-11-28T21:59:57.374 INFO:teuthology.orchestra.run.smithi074.stderr: 46550K .......... .......... .......... .......... .......... 63% 249M 0s 2019-11-28T21:59:57.374 INFO:teuthology.orchestra.run.smithi074.stderr: 46600K .......... .......... .......... .......... .......... 63% 288M 0s 2019-11-28T21:59:57.374 INFO:teuthology.orchestra.run.smithi074.stderr: 46650K .......... .......... .......... .......... .......... 63% 253M 0s 2019-11-28T21:59:57.374 INFO:teuthology.orchestra.run.smithi074.stderr: 46700K .......... .......... .......... .......... .......... 63% 303M 0s 2019-11-28T21:59:57.374 INFO:teuthology.orchestra.run.smithi074.stderr: 46750K .......... .......... .......... .......... .......... 63% 242M 0s 2019-11-28T21:59:57.375 INFO:teuthology.orchestra.run.smithi074.stderr: 46800K .......... .......... .......... .......... .......... 63% 281M 0s 2019-11-28T21:59:57.375 INFO:teuthology.orchestra.run.smithi074.stderr: 46850K .......... .......... .......... .......... .......... 63% 289M 0s 2019-11-28T21:59:57.375 INFO:teuthology.orchestra.run.smithi074.stderr: 46900K .......... .......... .......... .......... .......... 63% 265M 0s 2019-11-28T21:59:57.375 INFO:teuthology.orchestra.run.smithi074.stderr: 46950K .......... .......... .......... .......... .......... 63% 260M 0s 2019-11-28T21:59:57.375 INFO:teuthology.orchestra.run.smithi074.stderr: 47000K .......... .......... .......... .......... .......... 63% 268M 0s 2019-11-28T21:59:57.375 INFO:teuthology.orchestra.run.smithi074.stderr: 47050K .......... .......... .......... .......... .......... 64% 275M 0s 2019-11-28T21:59:57.375 INFO:teuthology.orchestra.run.smithi074.stderr: 47100K .......... .......... .......... .......... .......... 64% 244M 0s 2019-11-28T21:59:57.376 INFO:teuthology.orchestra.run.smithi074.stderr: 47150K .......... .......... .......... .......... .......... 64% 214M 0s 2019-11-28T21:59:57.376 INFO:teuthology.orchestra.run.smithi074.stderr: 47200K .......... .......... .......... .......... .......... 64% 203M 0s 2019-11-28T21:59:57.376 INFO:teuthology.orchestra.run.smithi074.stderr: 47250K .......... .......... .......... .......... .......... 64% 219M 0s 2019-11-28T21:59:57.376 INFO:teuthology.orchestra.run.smithi074.stderr: 47300K .......... .......... .......... .......... .......... 64% 251M 0s 2019-11-28T21:59:57.376 INFO:teuthology.orchestra.run.smithi074.stderr: 47350K .......... .......... .......... .......... .......... 64% 196M 0s 2019-11-28T21:59:57.376 INFO:teuthology.orchestra.run.smithi074.stderr: 47400K .......... .......... .......... .......... .......... 64% 237M 0s 2019-11-28T21:59:57.376 INFO:teuthology.orchestra.run.smithi074.stderr: 47450K .......... .......... .......... .......... .......... 64% 235M 0s 2019-11-28T21:59:57.376 INFO:teuthology.orchestra.run.smithi074.stderr: 47500K .......... .......... .......... .......... .......... 64% 295M 0s 2019-11-28T21:59:57.377 INFO:teuthology.orchestra.run.smithi074.stderr: 47550K .......... .......... .......... .......... .......... 64% 239M 0s 2019-11-28T21:59:57.377 INFO:teuthology.orchestra.run.smithi074.stderr: 47600K .......... .......... .......... .......... .......... 64% 236M 0s 2019-11-28T21:59:57.377 INFO:teuthology.orchestra.run.smithi074.stderr: 47650K .......... .......... .......... .......... .......... 64% 293M 0s 2019-11-28T21:59:57.377 INFO:teuthology.orchestra.run.smithi074.stderr: 47700K .......... .......... .......... .......... .......... 64% 263M 0s 2019-11-28T21:59:57.377 INFO:teuthology.orchestra.run.smithi074.stderr: 47750K .......... .......... .......... .......... .......... 64% 238M 0s 2019-11-28T21:59:57.377 INFO:teuthology.orchestra.run.smithi074.stderr: 47800K .......... .......... .......... .......... .......... 65% 273M 0s 2019-11-28T21:59:57.377 INFO:teuthology.orchestra.run.smithi074.stderr: 47850K .......... .......... .......... .......... .......... 65% 286M 0s 2019-11-28T21:59:57.378 INFO:teuthology.orchestra.run.smithi074.stderr: 47900K .......... .......... .......... .......... .......... 65% 290M 0s 2019-11-28T21:59:57.378 INFO:teuthology.orchestra.run.smithi074.stderr: 47950K .......... .......... .......... .......... .......... 65% 231M 0s 2019-11-28T21:59:57.378 INFO:teuthology.orchestra.run.smithi074.stderr: 48000K .......... .......... .......... .......... .......... 65% 283M 0s 2019-11-28T21:59:57.378 INFO:teuthology.orchestra.run.smithi074.stderr: 48050K .......... .......... .......... .......... .......... 65% 290M 0s 2019-11-28T21:59:57.378 INFO:teuthology.orchestra.run.smithi074.stderr: 48100K .......... .......... .......... .......... .......... 65% 263M 0s 2019-11-28T21:59:57.378 INFO:teuthology.orchestra.run.smithi074.stderr: 48150K .......... .......... .......... .......... .......... 65% 249M 0s 2019-11-28T21:59:57.378 INFO:teuthology.orchestra.run.smithi074.stderr: 48200K .......... .......... .......... .......... .......... 65% 315M 0s 2019-11-28T21:59:57.378 INFO:teuthology.orchestra.run.smithi074.stderr: 48250K .......... .......... .......... .......... .......... 65% 315M 0s 2019-11-28T21:59:57.379 INFO:teuthology.orchestra.run.smithi074.stderr: 48300K .......... .......... .......... .......... .......... 65% 297M 0s 2019-11-28T21:59:57.379 INFO:teuthology.orchestra.run.smithi074.stderr: 48350K .......... .......... .......... .......... .......... 65% 250M 0s 2019-11-28T21:59:57.379 INFO:teuthology.orchestra.run.smithi074.stderr: 48400K .......... .......... .......... .......... .......... 65% 287M 0s 2019-11-28T21:59:57.379 INFO:teuthology.orchestra.run.smithi074.stderr: 48450K .......... .......... .......... .......... .......... 65% 265M 0s 2019-11-28T21:59:57.379 INFO:teuthology.orchestra.run.smithi074.stderr: 48500K .......... .......... .......... .......... .......... 66% 275M 0s 2019-11-28T21:59:57.379 INFO:teuthology.orchestra.run.smithi074.stderr: 48550K .......... .......... .......... .......... .......... 66% 239M 0s 2019-11-28T21:59:57.379 INFO:teuthology.orchestra.run.smithi074.stderr: 48600K .......... .......... .......... .......... .......... 66% 273M 0s 2019-11-28T21:59:57.380 INFO:teuthology.orchestra.run.smithi074.stderr: 48650K .......... .......... .......... .......... .......... 66% 281M 0s 2019-11-28T21:59:57.380 INFO:teuthology.orchestra.run.smithi074.stderr: 48700K .......... .......... .......... .......... .......... 66% 286M 0s 2019-11-28T21:59:57.380 INFO:teuthology.orchestra.run.smithi074.stderr: 48750K .......... .......... .......... .......... .......... 66% 238M 0s 2019-11-28T21:59:57.380 INFO:teuthology.orchestra.run.smithi074.stderr: 48800K .......... .......... .......... .......... .......... 66% 277M 0s 2019-11-28T21:59:57.380 INFO:teuthology.orchestra.run.smithi074.stderr: 48850K .......... .......... .......... .......... .......... 66% 272M 0s 2019-11-28T21:59:57.380 INFO:teuthology.orchestra.run.smithi074.stderr: 48900K .......... .......... .......... .......... .......... 66% 274M 0s 2019-11-28T21:59:57.380 INFO:teuthology.orchestra.run.smithi074.stderr: 48950K .......... .......... .......... .......... .......... 66% 254M 0s 2019-11-28T21:59:57.380 INFO:teuthology.orchestra.run.smithi074.stderr: 49000K .......... .......... .......... .......... .......... 66% 279M 0s 2019-11-28T21:59:57.381 INFO:teuthology.orchestra.run.smithi074.stderr: 49050K .......... .......... .......... .......... .......... 66% 266M 0s 2019-11-28T21:59:57.381 INFO:teuthology.orchestra.run.smithi074.stderr: 49100K .......... .......... .......... .......... .......... 66% 275M 0s 2019-11-28T21:59:57.381 INFO:teuthology.orchestra.run.smithi074.stderr: 49150K .......... .......... .......... .......... .......... 66% 230M 0s 2019-11-28T21:59:57.381 INFO:teuthology.orchestra.run.smithi074.stderr: 49200K .......... .......... .......... .......... .......... 66% 268M 0s 2019-11-28T21:59:57.381 INFO:teuthology.orchestra.run.smithi074.stderr: 49250K .......... .......... .......... .......... .......... 67% 237M 0s 2019-11-28T21:59:57.381 INFO:teuthology.orchestra.run.smithi074.stderr: 49300K .......... .......... .......... .......... .......... 67% 297M 0s 2019-11-28T21:59:57.381 INFO:teuthology.orchestra.run.smithi074.stderr: 49350K .......... .......... .......... .......... .......... 67% 220M 0s 2019-11-28T21:59:57.382 INFO:teuthology.orchestra.run.smithi074.stderr: 49400K .......... .......... .......... .......... .......... 67% 256M 0s 2019-11-28T21:59:57.382 INFO:teuthology.orchestra.run.smithi074.stderr: 49450K .......... .......... .......... .......... .......... 67% 274M 0s 2019-11-28T21:59:57.382 INFO:teuthology.orchestra.run.smithi074.stderr: 49500K .......... .......... .......... .......... .......... 67% 279M 0s 2019-11-28T21:59:57.382 INFO:teuthology.orchestra.run.smithi074.stderr: 49550K .......... .......... .......... .......... .......... 67% 217M 0s 2019-11-28T21:59:57.382 INFO:teuthology.orchestra.run.smithi074.stderr: 49600K .......... .......... .......... .......... .......... 67% 257M 0s 2019-11-28T21:59:57.382 INFO:teuthology.orchestra.run.smithi074.stderr: 49650K .......... .......... .......... .......... .......... 67% 286M 0s 2019-11-28T21:59:57.382 INFO:teuthology.orchestra.run.smithi074.stderr: 49700K .......... .......... .......... .......... .......... 67% 293M 0s 2019-11-28T21:59:57.383 INFO:teuthology.orchestra.run.smithi074.stderr: 49750K .......... .......... .......... .......... .......... 67% 276M 0s 2019-11-28T21:59:57.383 INFO:teuthology.orchestra.run.smithi074.stderr: 49800K .......... .......... .......... .......... .......... 67% 303M 0s 2019-11-28T21:59:57.383 INFO:teuthology.orchestra.run.smithi074.stderr: 49850K .......... .......... .......... .......... .......... 67% 273M 0s 2019-11-28T21:59:57.383 INFO:teuthology.orchestra.run.smithi074.stderr: 49900K .......... .......... .......... .......... .......... 67% 265M 0s 2019-11-28T21:59:57.383 INFO:teuthology.orchestra.run.smithi074.stderr: 49950K .......... .......... .......... .......... .......... 67% 251M 0s 2019-11-28T21:59:57.383 INFO:teuthology.orchestra.run.smithi074.stderr: 50000K .......... .......... .......... .......... .......... 68% 304M 0s 2019-11-28T21:59:57.383 INFO:teuthology.orchestra.run.smithi074.stderr: 50050K .......... .......... .......... .......... .......... 68% 305M 0s 2019-11-28T21:59:57.383 INFO:teuthology.orchestra.run.smithi074.stderr: 50100K .......... .......... .......... .......... .......... 68% 252M 0s 2019-11-28T21:59:57.384 INFO:teuthology.orchestra.run.smithi074.stderr: 50150K .......... .......... .......... .......... .......... 68% 237M 0s 2019-11-28T21:59:57.384 INFO:teuthology.orchestra.run.smithi074.stderr: 50200K .......... .......... .......... .......... .......... 68% 247M 0s 2019-11-28T21:59:57.384 INFO:teuthology.orchestra.run.smithi074.stderr: 50250K .......... .......... .......... .......... .......... 68% 311M 0s 2019-11-28T21:59:57.384 INFO:teuthology.orchestra.run.smithi074.stderr: 50300K .......... .......... .......... .......... .......... 68% 309M 0s 2019-11-28T21:59:57.384 INFO:teuthology.orchestra.run.smithi074.stderr: 50350K .......... .......... .......... .......... .......... 68% 222M 0s 2019-11-28T21:59:57.384 INFO:teuthology.orchestra.run.smithi074.stderr: 50400K .......... .......... .......... .......... .......... 68% 223M 0s 2019-11-28T21:59:57.384 INFO:teuthology.orchestra.run.smithi074.stderr: 50450K .......... .......... .......... .......... .......... 68% 255M 0s 2019-11-28T21:59:57.385 INFO:teuthology.orchestra.run.smithi074.stderr: 50500K .......... .......... .......... .......... .......... 68% 283M 0s 2019-11-28T21:59:57.385 INFO:teuthology.orchestra.run.smithi074.stderr: 50550K .......... .......... .......... .......... .......... 68% 239M 0s 2019-11-28T21:59:57.385 INFO:teuthology.orchestra.run.smithi074.stderr: 50600K .......... .......... .......... .......... .......... 68% 301M 0s 2019-11-28T21:59:57.385 INFO:teuthology.orchestra.run.smithi074.stderr: 50650K .......... .......... .......... .......... .......... 68% 300M 0s 2019-11-28T21:59:57.385 INFO:teuthology.orchestra.run.smithi074.stderr: 50700K .......... .......... .......... .......... .......... 68% 260M 0s 2019-11-28T21:59:57.385 INFO:teuthology.orchestra.run.smithi074.stderr: 50750K .......... .......... .......... .......... .......... 69% 225M 0s 2019-11-28T21:59:57.385 INFO:teuthology.orchestra.run.smithi074.stderr: 50800K .......... .......... .......... .......... .......... 69% 260M 0s 2019-11-28T21:59:57.385 INFO:teuthology.orchestra.run.smithi074.stderr: 50850K .......... .......... .......... .......... .......... 69% 296M 0s 2019-11-28T21:59:57.386 INFO:teuthology.orchestra.run.smithi074.stderr: 50900K .......... .......... .......... .......... .......... 69% 280M 0s 2019-11-28T21:59:57.386 INFO:teuthology.orchestra.run.smithi074.stderr: 50950K .......... .......... .......... .......... .......... 69% 248M 0s 2019-11-28T21:59:57.386 INFO:teuthology.orchestra.run.smithi074.stderr: 51000K .......... .......... .......... .......... .......... 69% 265M 0s 2019-11-28T21:59:57.386 INFO:teuthology.orchestra.run.smithi074.stderr: 51050K .......... .......... .......... .......... .......... 69% 281M 0s 2019-11-28T21:59:57.386 INFO:teuthology.orchestra.run.smithi074.stderr: 51100K .......... .......... .......... .......... .......... 69% 266M 0s 2019-11-28T21:59:57.386 INFO:teuthology.orchestra.run.smithi074.stderr: 51150K .......... .......... .......... .......... .......... 69% 240M 0s 2019-11-28T21:59:57.386 INFO:teuthology.orchestra.run.smithi074.stderr: 51200K .......... .......... .......... .......... .......... 69% 247M 0s 2019-11-28T21:59:57.387 INFO:teuthology.orchestra.run.smithi074.stderr: 51250K .......... .......... .......... .......... .......... 69% 285M 0s 2019-11-28T21:59:57.387 INFO:teuthology.orchestra.run.smithi074.stderr: 51300K .......... .......... .......... .......... .......... 69% 273M 0s 2019-11-28T21:59:57.387 INFO:teuthology.orchestra.run.smithi074.stderr: 51350K .......... .......... .......... .......... .......... 69% 279M 0s 2019-11-28T21:59:57.387 INFO:teuthology.orchestra.run.smithi074.stderr: 51400K .......... .......... .......... .......... .......... 69% 264M 0s 2019-11-28T21:59:57.387 INFO:teuthology.orchestra.run.smithi074.stderr: 51450K .......... .......... .......... .......... .......... 70% 291M 0s 2019-11-28T21:59:57.387 INFO:teuthology.orchestra.run.smithi074.stderr: 51500K .......... .......... .......... .......... .......... 70% 283M 0s 2019-11-28T21:59:57.387 INFO:teuthology.orchestra.run.smithi074.stderr: 51550K .......... .......... .......... .......... .......... 70% 233M 0s 2019-11-28T21:59:57.388 INFO:teuthology.orchestra.run.smithi074.stderr: 51600K .......... .......... .......... .......... .......... 70% 290M 0s 2019-11-28T21:59:57.388 INFO:teuthology.orchestra.run.smithi074.stderr: 51650K .......... .......... .......... .......... .......... 70% 285M 0s 2019-11-28T21:59:57.388 INFO:teuthology.orchestra.run.smithi074.stderr: 51700K .......... .......... .......... .......... .......... 70% 293M 0s 2019-11-28T21:59:57.388 INFO:teuthology.orchestra.run.smithi074.stderr: 51750K .......... .......... .......... .......... .......... 70% 264M 0s 2019-11-28T21:59:57.388 INFO:teuthology.orchestra.run.smithi074.stderr: 51800K .......... .......... .......... .......... .......... 70% 297M 0s 2019-11-28T21:59:57.388 INFO:teuthology.orchestra.run.smithi074.stderr: 51850K .......... .......... .......... .......... .......... 70% 271M 0s 2019-11-28T21:59:57.389 INFO:teuthology.orchestra.run.smithi074.stderr: 51900K .......... .......... .......... .......... .......... 70% 292M 0s 2019-11-28T21:59:57.389 INFO:teuthology.orchestra.run.smithi074.stderr: 51950K .......... .......... .......... .......... .......... 70% 242M 0s 2019-11-28T21:59:57.389 INFO:teuthology.orchestra.run.smithi074.stderr: 52000K .......... .......... .......... .......... .......... 70% 256M 0s 2019-11-28T21:59:57.389 INFO:teuthology.orchestra.run.smithi074.stderr: 52050K .......... .......... .......... .......... .......... 70% 255M 0s 2019-11-28T21:59:57.389 INFO:teuthology.orchestra.run.smithi074.stderr: 52100K .......... .......... .......... .......... .......... 70% 210M 0s 2019-11-28T21:59:57.389 INFO:teuthology.orchestra.run.smithi074.stderr: 52150K .......... .......... .......... .......... .......... 70% 218M 0s 2019-11-28T21:59:57.389 INFO:teuthology.orchestra.run.smithi074.stderr: 52200K .......... .......... .......... .......... .......... 71% 243M 0s 2019-11-28T21:59:57.389 INFO:teuthology.orchestra.run.smithi074.stderr: 52250K .......... .......... .......... .......... .......... 71% 253M 0s 2019-11-28T21:59:57.390 INFO:teuthology.orchestra.run.smithi074.stderr: 52300K .......... .......... .......... .......... .......... 71% 279M 0s 2019-11-28T21:59:57.390 INFO:teuthology.orchestra.run.smithi074.stderr: 52350K .......... .......... .......... .......... .......... 71% 226M 0s 2019-11-28T21:59:57.390 INFO:teuthology.orchestra.run.smithi074.stderr: 52400K .......... .......... .......... .......... .......... 71% 273M 0s 2019-11-28T21:59:57.390 INFO:teuthology.orchestra.run.smithi074.stderr: 52450K .......... .......... .......... .......... .......... 71% 273M 0s 2019-11-28T21:59:57.390 INFO:teuthology.orchestra.run.smithi074.stderr: 52500K .......... .......... .......... .......... .......... 71% 272M 0s 2019-11-28T21:59:57.390 INFO:teuthology.orchestra.run.smithi074.stderr: 52550K .......... .......... .......... .......... .......... 71% 252M 0s 2019-11-28T21:59:57.390 INFO:teuthology.orchestra.run.smithi074.stderr: 52600K .......... .......... .......... .......... .......... 71% 274M 0s 2019-11-28T21:59:57.391 INFO:teuthology.orchestra.run.smithi074.stderr: 52650K .......... .......... .......... .......... .......... 71% 263M 0s 2019-11-28T21:59:57.391 INFO:teuthology.orchestra.run.smithi074.stderr: 52700K .......... .......... .......... .......... .......... 71% 287M 0s 2019-11-28T21:59:57.391 INFO:teuthology.orchestra.run.smithi074.stderr: 52750K .......... .......... .......... .......... .......... 71% 233M 0s 2019-11-28T21:59:57.391 INFO:teuthology.orchestra.run.smithi074.stderr: 52800K .......... .......... .......... .......... .......... 71% 283M 0s 2019-11-28T21:59:57.391 INFO:teuthology.orchestra.run.smithi074.stderr: 52850K .......... .......... .......... .......... .......... 71% 295M 0s 2019-11-28T21:59:57.391 INFO:teuthology.orchestra.run.smithi074.stderr: 52900K .......... .......... .......... .......... .......... 71% 282M 0s 2019-11-28T21:59:57.391 INFO:teuthology.orchestra.run.smithi074.stderr: 52950K .......... .......... .......... .......... .......... 72% 255M 0s 2019-11-28T21:59:57.392 INFO:teuthology.orchestra.run.smithi074.stderr: 53000K .......... .......... .......... .......... .......... 72% 294M 0s 2019-11-28T21:59:57.392 INFO:teuthology.orchestra.run.smithi074.stderr: 53050K .......... .......... .......... .......... .......... 72% 292M 0s 2019-11-28T21:59:57.392 INFO:teuthology.orchestra.run.smithi074.stderr: 53100K .......... .......... .......... .......... .......... 72% 284M 0s 2019-11-28T21:59:57.392 INFO:teuthology.orchestra.run.smithi074.stderr: 53150K .......... .......... .......... .......... .......... 72% 236M 0s 2019-11-28T21:59:57.392 INFO:teuthology.orchestra.run.smithi074.stderr: 53200K .......... .......... .......... .......... .......... 72% 283M 0s 2019-11-28T21:59:57.392 INFO:teuthology.orchestra.run.smithi074.stderr: 53250K .......... .......... .......... .......... .......... 72% 274M 0s 2019-11-28T21:59:57.392 INFO:teuthology.orchestra.run.smithi074.stderr: 53300K .......... .......... .......... .......... .......... 72% 290M 0s 2019-11-28T21:59:57.393 INFO:teuthology.orchestra.run.smithi074.stderr: 53350K .......... .......... .......... .......... .......... 72% 258M 0s 2019-11-28T21:59:57.393 INFO:teuthology.orchestra.run.smithi074.stderr: 53400K .......... .......... .......... .......... .......... 72% 296M 0s 2019-11-28T21:59:57.393 INFO:teuthology.orchestra.run.smithi074.stderr: 53450K .......... .......... .......... .......... .......... 72% 281M 0s 2019-11-28T21:59:57.393 INFO:teuthology.orchestra.run.smithi074.stderr: 53500K .......... .......... .......... .......... .......... 72% 289M 0s 2019-11-28T21:59:57.393 INFO:teuthology.orchestra.run.smithi074.stderr: 53550K .......... .......... .......... .......... .......... 72% 228M 0s 2019-11-28T21:59:57.393 INFO:teuthology.orchestra.run.smithi074.stderr: 53600K .......... .......... .......... .......... .......... 72% 289M 0s 2019-11-28T21:59:57.393 INFO:teuthology.orchestra.run.smithi074.stderr: 53650K .......... .......... .......... .......... .......... 73% 289M 0s 2019-11-28T21:59:57.394 INFO:teuthology.orchestra.run.smithi074.stderr: 53700K .......... .......... .......... .......... .......... 73% 240M 0s 2019-11-28T21:59:57.394 INFO:teuthology.orchestra.run.smithi074.stderr: 53750K .......... .......... .......... .......... .......... 73% 254M 0s 2019-11-28T21:59:57.394 INFO:teuthology.orchestra.run.smithi074.stderr: 53800K .......... .......... .......... .......... .......... 73% 279M 0s 2019-11-28T21:59:57.394 INFO:teuthology.orchestra.run.smithi074.stderr: 53850K .......... .......... .......... .......... .......... 73% 281M 0s 2019-11-28T21:59:57.394 INFO:teuthology.orchestra.run.smithi074.stderr: 53900K .......... .......... .......... .......... .......... 73% 252M 0s 2019-11-28T21:59:57.394 INFO:teuthology.orchestra.run.smithi074.stderr: 53950K .......... .......... .......... .......... .......... 73% 174M 0s 2019-11-28T21:59:57.394 INFO:teuthology.orchestra.run.smithi074.stderr: 54000K .......... .......... .......... .......... .......... 73% 224M 0s 2019-11-28T21:59:57.394 INFO:teuthology.orchestra.run.smithi074.stderr: 54050K .......... .......... .......... .......... .......... 73% 261M 0s 2019-11-28T21:59:57.395 INFO:teuthology.orchestra.run.smithi074.stderr: 54100K .......... .......... .......... .......... .......... 73% 248M 0s 2019-11-28T21:59:57.395 INFO:teuthology.orchestra.run.smithi074.stderr: 54150K .......... .......... .......... .......... .......... 73% 238M 0s 2019-11-28T21:59:57.395 INFO:teuthology.orchestra.run.smithi074.stderr: 54200K .......... .......... .......... .......... .......... 73% 254M 0s 2019-11-28T21:59:57.395 INFO:teuthology.orchestra.run.smithi074.stderr: 54250K .......... .......... .......... .......... .......... 73% 232M 0s 2019-11-28T21:59:57.395 INFO:teuthology.orchestra.run.smithi074.stderr: 54300K .......... .......... .......... .......... .......... 73% 288M 0s 2019-11-28T21:59:57.395 INFO:teuthology.orchestra.run.smithi074.stderr: 54350K .......... .......... .......... .......... .......... 73% 212M 0s 2019-11-28T21:59:57.395 INFO:teuthology.orchestra.run.smithi074.stderr: 54400K .......... .......... .......... .......... .......... 74% 245M 0s 2019-11-28T21:59:57.396 INFO:teuthology.orchestra.run.smithi074.stderr: 54450K .......... .......... .......... .......... .......... 74% 234M 0s 2019-11-28T21:59:57.396 INFO:teuthology.orchestra.run.smithi074.stderr: 54500K .......... .......... .......... .......... .......... 74% 250M 0s 2019-11-28T21:59:57.396 INFO:teuthology.orchestra.run.smithi074.stderr: 54550K .......... .......... .......... .......... .......... 74% 269M 0s 2019-11-28T21:59:57.396 INFO:teuthology.orchestra.run.smithi074.stderr: 54600K .......... .......... .......... .......... .......... 74% 297M 0s 2019-11-28T21:59:57.396 INFO:teuthology.orchestra.run.smithi074.stderr: 54650K .......... .......... .......... .......... .......... 74% 286M 0s 2019-11-28T21:59:57.396 INFO:teuthology.orchestra.run.smithi074.stderr: 54700K .......... .......... .......... .......... .......... 74% 281M 0s 2019-11-28T21:59:57.396 INFO:teuthology.orchestra.run.smithi074.stderr: 54750K .......... .......... .......... .......... .......... 74% 218M 0s 2019-11-28T21:59:57.397 INFO:teuthology.orchestra.run.smithi074.stderr: 54800K .......... .......... .......... .......... .......... 74% 306M 0s 2019-11-28T21:59:57.397 INFO:teuthology.orchestra.run.smithi074.stderr: 54850K .......... .......... .......... .......... .......... 74% 308M 0s 2019-11-28T21:59:57.397 INFO:teuthology.orchestra.run.smithi074.stderr: 54900K .......... .......... .......... .......... .......... 74% 303M 0s 2019-11-28T21:59:57.397 INFO:teuthology.orchestra.run.smithi074.stderr: 54950K .......... .......... .......... .......... .......... 74% 242M 0s 2019-11-28T21:59:57.397 INFO:teuthology.orchestra.run.smithi074.stderr: 55000K .......... .......... .......... .......... .......... 74% 276M 0s 2019-11-28T21:59:57.397 INFO:teuthology.orchestra.run.smithi074.stderr: 55050K .......... .......... .......... .......... .......... 74% 280M 0s 2019-11-28T21:59:57.397 INFO:teuthology.orchestra.run.smithi074.stderr: 55100K .......... .......... .......... .......... .......... 74% 285M 0s 2019-11-28T21:59:57.398 INFO:teuthology.orchestra.run.smithi074.stderr: 55150K .......... .......... .......... .......... .......... 75% 197M 0s 2019-11-28T21:59:57.398 INFO:teuthology.orchestra.run.smithi074.stderr: 55200K .......... .......... .......... .......... .......... 75% 243M 0s 2019-11-28T21:59:57.398 INFO:teuthology.orchestra.run.smithi074.stderr: 55250K .......... .......... .......... .......... .......... 75% 240M 0s 2019-11-28T21:59:57.398 INFO:teuthology.orchestra.run.smithi074.stderr: 55300K .......... .......... .......... .......... .......... 75% 255M 0s 2019-11-28T21:59:57.398 INFO:teuthology.orchestra.run.smithi074.stderr: 55350K .......... .......... .......... .......... .......... 75% 265M 0s 2019-11-28T21:59:57.398 INFO:teuthology.orchestra.run.smithi074.stderr: 55400K .......... .......... .......... .......... .......... 75% 289M 0s 2019-11-28T21:59:57.398 INFO:teuthology.orchestra.run.smithi074.stderr: 55450K .......... .......... .......... .......... .......... 75% 279M 0s 2019-11-28T21:59:57.398 INFO:teuthology.orchestra.run.smithi074.stderr: 55500K .......... .......... .......... .......... .......... 75% 286M 0s 2019-11-28T21:59:57.399 INFO:teuthology.orchestra.run.smithi074.stderr: 55550K .......... .......... .......... .......... .......... 75% 239M 0s 2019-11-28T21:59:57.399 INFO:teuthology.orchestra.run.smithi074.stderr: 55600K .......... .......... .......... .......... .......... 75% 275M 0s 2019-11-28T21:59:57.399 INFO:teuthology.orchestra.run.smithi074.stderr: 55650K .......... .......... .......... .......... .......... 75% 285M 0s 2019-11-28T21:59:57.399 INFO:teuthology.orchestra.run.smithi074.stderr: 55700K .......... .......... .......... .......... .......... 75% 277M 0s 2019-11-28T21:59:57.399 INFO:teuthology.orchestra.run.smithi074.stderr: 55750K .......... .......... .......... .......... .......... 75% 258M 0s 2019-11-28T21:59:57.399 INFO:teuthology.orchestra.run.smithi074.stderr: 55800K .......... .......... .......... .......... .......... 75% 278M 0s 2019-11-28T21:59:57.399 INFO:teuthology.orchestra.run.smithi074.stderr: 55850K .......... .......... .......... .......... .......... 75% 268M 0s 2019-11-28T21:59:57.399 INFO:teuthology.orchestra.run.smithi074.stderr: 55900K .......... .......... .......... .......... .......... 76% 275M 0s 2019-11-28T21:59:57.400 INFO:teuthology.orchestra.run.smithi074.stderr: 55950K .......... .......... .......... .......... .......... 76% 232M 0s 2019-11-28T21:59:57.400 INFO:teuthology.orchestra.run.smithi074.stderr: 56000K .......... .......... .......... .......... .......... 76% 270M 0s 2019-11-28T21:59:57.400 INFO:teuthology.orchestra.run.smithi074.stderr: 56050K .......... .......... .......... .......... .......... 76% 269M 0s 2019-11-28T21:59:57.400 INFO:teuthology.orchestra.run.smithi074.stderr: 56100K .......... .......... .......... .......... .......... 76% 265M 0s 2019-11-28T21:59:57.400 INFO:teuthology.orchestra.run.smithi074.stderr: 56150K .......... .......... .......... .......... .......... 76% 266M 0s 2019-11-28T21:59:57.400 INFO:teuthology.orchestra.run.smithi074.stderr: 56200K .......... .......... .......... .......... .......... 76% 283M 0s 2019-11-28T21:59:57.400 INFO:teuthology.orchestra.run.smithi074.stderr: 56250K .......... .......... .......... .......... .......... 76% 276M 0s 2019-11-28T21:59:57.401 INFO:teuthology.orchestra.run.smithi074.stderr: 56300K .......... .......... .......... .......... .......... 76% 274M 0s 2019-11-28T21:59:57.401 INFO:teuthology.orchestra.run.smithi074.stderr: 56350K .......... .......... .......... .......... .......... 76% 214M 0s 2019-11-28T21:59:57.401 INFO:teuthology.orchestra.run.smithi074.stderr: 56400K .......... .......... .......... .......... .......... 76% 303M 0s 2019-11-28T21:59:57.401 INFO:teuthology.orchestra.run.smithi074.stderr: 56450K .......... .......... .......... .......... .......... 76% 269M 0s 2019-11-28T21:59:57.401 INFO:teuthology.orchestra.run.smithi074.stderr: 56500K .......... .......... .......... .......... .......... 76% 275M 0s 2019-11-28T21:59:57.401 INFO:teuthology.orchestra.run.smithi074.stderr: 56550K .......... .......... .......... .......... .......... 76% 249M 0s 2019-11-28T21:59:57.401 INFO:teuthology.orchestra.run.smithi074.stderr: 56600K .......... .......... .......... .......... .......... 77% 211M 0s 2019-11-28T21:59:57.402 INFO:teuthology.orchestra.run.smithi074.stderr: 56650K .......... .......... .......... .......... .......... 77% 225M 0s 2019-11-28T21:59:57.402 INFO:teuthology.orchestra.run.smithi074.stderr: 56700K .......... .......... .......... .......... .......... 77% 281M 0s 2019-11-28T21:59:57.402 INFO:teuthology.orchestra.run.smithi074.stderr: 56750K .......... .......... .......... .......... .......... 77% 229M 0s 2019-11-28T21:59:57.402 INFO:teuthology.orchestra.run.smithi074.stderr: 56800K .......... .......... .......... .......... .......... 77% 269M 0s 2019-11-28T21:59:57.402 INFO:teuthology.orchestra.run.smithi074.stderr: 56850K .......... .......... .......... .......... .......... 77% 309M 0s 2019-11-28T21:59:57.402 INFO:teuthology.orchestra.run.smithi074.stderr: 56900K .......... .......... .......... .......... .......... 77% 305M 0s 2019-11-28T21:59:57.402 INFO:teuthology.orchestra.run.smithi074.stderr: 56950K .......... .......... .......... .......... .......... 77% 275M 0s 2019-11-28T21:59:57.403 INFO:teuthology.orchestra.run.smithi074.stderr: 57000K .......... .......... .......... .......... .......... 77% 274M 0s 2019-11-28T21:59:57.403 INFO:teuthology.orchestra.run.smithi074.stderr: 57050K .......... .......... .......... .......... .......... 77% 283M 0s 2019-11-28T21:59:57.403 INFO:teuthology.orchestra.run.smithi074.stderr: 57100K .......... .......... .......... .......... .......... 77% 258M 0s 2019-11-28T21:59:57.403 INFO:teuthology.orchestra.run.smithi074.stderr: 57150K .......... .......... .......... .......... .......... 77% 239M 0s 2019-11-28T21:59:57.403 INFO:teuthology.orchestra.run.smithi074.stderr: 57200K .......... .......... .......... .......... .......... 77% 266M 0s 2019-11-28T21:59:57.403 INFO:teuthology.orchestra.run.smithi074.stderr: 57250K .......... .......... .......... .......... .......... 77% 274M 0s 2019-11-28T21:59:57.403 INFO:teuthology.orchestra.run.smithi074.stderr: 57300K .......... .......... .......... .......... .......... 77% 245M 0s 2019-11-28T21:59:57.403 INFO:teuthology.orchestra.run.smithi074.stderr: 57350K .......... .......... .......... .......... .......... 78% 226M 0s 2019-11-28T21:59:57.404 INFO:teuthology.orchestra.run.smithi074.stderr: 57400K .......... .......... .......... .......... .......... 78% 307M 0s 2019-11-28T21:59:57.404 INFO:teuthology.orchestra.run.smithi074.stderr: 57450K .......... .......... .......... .......... .......... 78% 239M 0s 2019-11-28T21:59:57.404 INFO:teuthology.orchestra.run.smithi074.stderr: 57500K .......... .......... .......... .......... .......... 78% 256M 0s 2019-11-28T21:59:57.404 INFO:teuthology.orchestra.run.smithi074.stderr: 57550K .......... .......... .......... .......... .......... 78% 254M 0s 2019-11-28T21:59:57.404 INFO:teuthology.orchestra.run.smithi074.stderr: 57600K .......... .......... .......... .......... .......... 78% 262M 0s 2019-11-28T21:59:57.404 INFO:teuthology.orchestra.run.smithi074.stderr: 57650K .......... .......... .......... .......... .......... 78% 224M 0s 2019-11-28T21:59:57.404 INFO:teuthology.orchestra.run.smithi074.stderr: 57700K .......... .......... .......... .......... .......... 78% 229M 0s 2019-11-28T21:59:57.405 INFO:teuthology.orchestra.run.smithi074.stderr: 57750K .......... .......... .......... .......... .......... 78% 247M 0s 2019-11-28T21:59:57.405 INFO:teuthology.orchestra.run.smithi074.stderr: 57800K .......... .......... .......... .......... .......... 78% 262M 0s 2019-11-28T21:59:57.405 INFO:teuthology.orchestra.run.smithi074.stderr: 57850K .......... .......... .......... .......... .......... 78% 221M 0s 2019-11-28T21:59:57.405 INFO:teuthology.orchestra.run.smithi074.stderr: 57900K .......... .......... .......... .......... .......... 78% 253M 0s 2019-11-28T21:59:57.405 INFO:teuthology.orchestra.run.smithi074.stderr: 57950K .......... .......... .......... .......... .......... 78% 200M 0s 2019-11-28T21:59:57.405 INFO:teuthology.orchestra.run.smithi074.stderr: 58000K .......... .......... .......... .......... .......... 78% 293M 0s 2019-11-28T21:59:57.405 INFO:teuthology.orchestra.run.smithi074.stderr: 58050K .......... .......... .......... .......... .......... 78% 315M 0s 2019-11-28T21:59:57.405 INFO:teuthology.orchestra.run.smithi074.stderr: 58100K .......... .......... .......... .......... .......... 79% 286M 0s 2019-11-28T21:59:57.406 INFO:teuthology.orchestra.run.smithi074.stderr: 58150K .......... .......... .......... .......... .......... 79% 236M 0s 2019-11-28T21:59:57.406 INFO:teuthology.orchestra.run.smithi074.stderr: 58200K .......... .......... .......... .......... .......... 79% 281M 0s 2019-11-28T21:59:57.406 INFO:teuthology.orchestra.run.smithi074.stderr: 58250K .......... .......... .......... .......... .......... 79% 255M 0s 2019-11-28T21:59:57.406 INFO:teuthology.orchestra.run.smithi074.stderr: 58300K .......... .......... .......... .......... .......... 79% 285M 0s 2019-11-28T21:59:57.406 INFO:teuthology.orchestra.run.smithi074.stderr: 58350K .......... .......... .......... .......... .......... 79% 237M 0s 2019-11-28T21:59:57.406 INFO:teuthology.orchestra.run.smithi074.stderr: 58400K .......... .......... .......... .......... .......... 79% 287M 0s 2019-11-28T21:59:57.406 INFO:teuthology.orchestra.run.smithi074.stderr: 58450K .......... .......... .......... .......... .......... 79% 269M 0s 2019-11-28T21:59:57.406 INFO:teuthology.orchestra.run.smithi074.stderr: 58500K .......... .......... .......... .......... .......... 79% 280M 0s 2019-11-28T21:59:57.407 INFO:teuthology.orchestra.run.smithi074.stderr: 58550K .......... .......... .......... .......... .......... 79% 222M 0s 2019-11-28T21:59:57.407 INFO:teuthology.orchestra.run.smithi074.stderr: 58600K .......... .......... .......... .......... .......... 79% 305M 0s 2019-11-28T21:59:57.407 INFO:teuthology.orchestra.run.smithi074.stderr: 58650K .......... .......... .......... .......... .......... 79% 277M 0s 2019-11-28T21:59:57.407 INFO:teuthology.orchestra.run.smithi074.stderr: 58700K .......... .......... .......... .......... .......... 79% 281M 0s 2019-11-28T21:59:57.407 INFO:teuthology.orchestra.run.smithi074.stderr: 58750K .......... .......... .......... .......... .......... 79% 238M 0s 2019-11-28T21:59:57.407 INFO:teuthology.orchestra.run.smithi074.stderr: 58800K .......... .......... .......... .......... .......... 80% 249M 0s 2019-11-28T21:59:57.407 INFO:teuthology.orchestra.run.smithi074.stderr: 58850K .......... .......... .......... .......... .......... 80% 310M 0s 2019-11-28T21:59:57.408 INFO:teuthology.orchestra.run.smithi074.stderr: 58900K .......... .......... .......... .......... .......... 80% 303M 0s 2019-11-28T21:59:57.408 INFO:teuthology.orchestra.run.smithi074.stderr: 58950K .......... .......... .......... .......... .......... 80% 251M 0s 2019-11-28T21:59:57.408 INFO:teuthology.orchestra.run.smithi074.stderr: 59000K .......... .......... .......... .......... .......... 80% 255M 0s 2019-11-28T21:59:57.408 INFO:teuthology.orchestra.run.smithi074.stderr: 59050K .......... .......... .......... .......... .......... 80% 283M 0s 2019-11-28T21:59:57.408 INFO:teuthology.orchestra.run.smithi074.stderr: 59100K .......... .......... .......... .......... .......... 80% 260M 0s 2019-11-28T21:59:57.408 INFO:teuthology.orchestra.run.smithi074.stderr: 59150K .......... .......... .......... .......... .......... 80% 255M 0s 2019-11-28T21:59:57.408 INFO:teuthology.orchestra.run.smithi074.stderr: 59200K .......... .......... .......... .......... .......... 80% 303M 0s 2019-11-28T21:59:57.408 INFO:teuthology.orchestra.run.smithi074.stderr: 59250K .......... .......... .......... .......... .......... 80% 289M 0s 2019-11-28T21:59:57.409 INFO:teuthology.orchestra.run.smithi074.stderr: 59300K .......... .......... .......... .......... .......... 80% 265M 0s 2019-11-28T21:59:57.409 INFO:teuthology.orchestra.run.smithi074.stderr: 59350K .......... .......... .......... .......... .......... 80% 250M 0s 2019-11-28T21:59:57.409 INFO:teuthology.orchestra.run.smithi074.stderr: 59400K .......... .......... .......... .......... .......... 80% 276M 0s 2019-11-28T21:59:57.409 INFO:teuthology.orchestra.run.smithi074.stderr: 59450K .......... .......... .......... .......... .......... 80% 274M 0s 2019-11-28T21:59:57.409 INFO:teuthology.orchestra.run.smithi074.stderr: 59500K .......... .......... .......... .......... .......... 80% 245M 0s 2019-11-28T21:59:57.409 INFO:teuthology.orchestra.run.smithi074.stderr: 59550K .......... .......... .......... .......... .......... 81% 223M 0s 2019-11-28T21:59:57.409 INFO:teuthology.orchestra.run.smithi074.stderr: 59600K .......... .......... .......... .......... .......... 81% 280M 0s 2019-11-28T21:59:57.410 INFO:teuthology.orchestra.run.smithi074.stderr: 59650K .......... .......... .......... .......... .......... 81% 232M 0s 2019-11-28T21:59:57.410 INFO:teuthology.orchestra.run.smithi074.stderr: 59700K .......... .......... .......... .......... .......... 81% 287M 0s 2019-11-28T21:59:57.410 INFO:teuthology.orchestra.run.smithi074.stderr: 59750K .......... .......... .......... .......... .......... 81% 221M 0s 2019-11-28T21:59:57.410 INFO:teuthology.orchestra.run.smithi074.stderr: 59800K .......... .......... .......... .......... .......... 81% 294M 0s 2019-11-28T21:59:57.410 INFO:teuthology.orchestra.run.smithi074.stderr: 59850K .......... .......... .......... .......... .......... 81% 253M 0s 2019-11-28T21:59:57.410 INFO:teuthology.orchestra.run.smithi074.stderr: 59900K .......... .......... .......... .......... .......... 81% 265M 0s 2019-11-28T21:59:57.410 INFO:teuthology.orchestra.run.smithi074.stderr: 59950K .......... .......... .......... .......... .......... 81% 222M 0s 2019-11-28T21:59:57.411 INFO:teuthology.orchestra.run.smithi074.stderr: 60000K .......... .......... .......... .......... .......... 81% 251M 0s 2019-11-28T21:59:57.411 INFO:teuthology.orchestra.run.smithi074.stderr: 60050K .......... .......... .......... .......... .......... 81% 305M 0s 2019-11-28T21:59:57.411 INFO:teuthology.orchestra.run.smithi074.stderr: 60100K .......... .......... .......... .......... .......... 81% 261M 0s 2019-11-28T21:59:57.411 INFO:teuthology.orchestra.run.smithi074.stderr: 60150K .......... .......... .......... .......... .......... 81% 239M 0s 2019-11-28T21:59:57.411 INFO:teuthology.orchestra.run.smithi074.stderr: 60200K .......... .......... .......... .......... .......... 81% 294M 0s 2019-11-28T21:59:57.411 INFO:teuthology.orchestra.run.smithi074.stderr: 60250K .......... .......... .......... .......... .......... 81% 270M 0s 2019-11-28T21:59:57.411 INFO:teuthology.orchestra.run.smithi074.stderr: 60300K .......... .......... .......... .......... .......... 82% 252M 0s 2019-11-28T21:59:57.411 INFO:teuthology.orchestra.run.smithi074.stderr: 60350K .......... .......... .......... .......... .......... 82% 234M 0s 2019-11-28T21:59:57.412 INFO:teuthology.orchestra.run.smithi074.stderr: 60400K .......... .......... .......... .......... .......... 82% 287M 0s 2019-11-28T21:59:57.412 INFO:teuthology.orchestra.run.smithi074.stderr: 60450K .......... .......... .......... .......... .......... 82% 276M 0s 2019-11-28T21:59:57.412 INFO:teuthology.orchestra.run.smithi074.stderr: 60500K .......... .......... .......... .......... .......... 82% 276M 0s 2019-11-28T21:59:57.412 INFO:teuthology.orchestra.run.smithi074.stderr: 60550K .......... .......... .......... .......... .......... 82% 225M 0s 2019-11-28T21:59:57.412 INFO:teuthology.orchestra.run.smithi074.stderr: 60600K .......... .......... .......... .......... .......... 82% 256M 0s 2019-11-28T21:59:57.412 INFO:teuthology.orchestra.run.smithi074.stderr: 60650K .......... .......... .......... .......... .......... 82% 281M 0s 2019-11-28T21:59:57.413 INFO:teuthology.orchestra.run.smithi074.stderr: 60700K .......... .......... .......... .......... .......... 82% 315M 0s 2019-11-28T21:59:57.413 INFO:teuthology.orchestra.run.smithi074.stderr: 60750K .......... .......... .......... .......... .......... 82% 283M 0s 2019-11-28T21:59:57.413 INFO:teuthology.orchestra.run.smithi074.stderr: 60800K .......... .......... .......... .......... .......... 82% 286M 0s 2019-11-28T21:59:57.413 INFO:teuthology.orchestra.run.smithi074.stderr: 60850K .......... .......... .......... .......... .......... 82% 285M 0s 2019-11-28T21:59:57.413 INFO:teuthology.orchestra.run.smithi074.stderr: 60900K .......... .......... .......... .......... .......... 82% 258M 0s 2019-11-28T21:59:57.413 INFO:teuthology.orchestra.run.smithi074.stderr: 60950K .......... .......... .......... .......... .......... 82% 230M 0s 2019-11-28T21:59:57.413 INFO:teuthology.orchestra.run.smithi074.stderr: 61000K .......... .......... .......... .......... .......... 82% 278M 0s 2019-11-28T21:59:57.413 INFO:teuthology.orchestra.run.smithi074.stderr: 61050K .......... .......... .......... .......... .......... 83% 279M 0s 2019-11-28T21:59:57.414 INFO:teuthology.orchestra.run.smithi074.stderr: 61100K .......... .......... .......... .......... .......... 83% 300M 0s 2019-11-28T21:59:57.414 INFO:teuthology.orchestra.run.smithi074.stderr: 61150K .......... .......... .......... .......... .......... 83% 243M 0s 2019-11-28T21:59:57.414 INFO:teuthology.orchestra.run.smithi074.stderr: 61200K .......... .......... .......... .......... .......... 83% 261M 0s 2019-11-28T21:59:57.414 INFO:teuthology.orchestra.run.smithi074.stderr: 61250K .......... .......... .......... .......... .......... 83% 274M 0s 2019-11-28T21:59:57.414 INFO:teuthology.orchestra.run.smithi074.stderr: 61300K .......... .......... .......... .......... .......... 83% 286M 0s 2019-11-28T21:59:57.414 INFO:teuthology.orchestra.run.smithi074.stderr: 61350K .......... .......... .......... .......... .......... 83% 242M 0s 2019-11-28T21:59:57.414 INFO:teuthology.orchestra.run.smithi074.stderr: 61400K .......... .......... .......... .......... .......... 83% 282M 0s 2019-11-28T21:59:57.415 INFO:teuthology.orchestra.run.smithi074.stderr: 61450K .......... .......... .......... .......... .......... 83% 255M 0s 2019-11-28T21:59:57.415 INFO:teuthology.orchestra.run.smithi074.stderr: 61500K .......... .......... .......... .......... .......... 83% 212M 0s 2019-11-28T21:59:57.415 INFO:teuthology.orchestra.run.smithi074.stderr: 61550K .......... .......... .......... .......... .......... 83% 225M 0s 2019-11-28T21:59:57.415 INFO:teuthology.orchestra.run.smithi074.stderr: 61600K .......... .......... .......... .......... .......... 83% 240M 0s 2019-11-28T21:59:57.415 INFO:teuthology.orchestra.run.smithi074.stderr: 61650K .......... .......... .......... .......... .......... 83% 264M 0s 2019-11-28T21:59:57.415 INFO:teuthology.orchestra.run.smithi074.stderr: 61700K .......... .......... .......... .......... .......... 83% 275M 0s 2019-11-28T21:59:57.415 INFO:teuthology.orchestra.run.smithi074.stderr: 61750K .......... .......... .......... .......... .......... 84% 223M 0s 2019-11-28T21:59:57.415 INFO:teuthology.orchestra.run.smithi074.stderr: 61800K .......... .......... .......... .......... .......... 84% 285M 0s 2019-11-28T21:59:57.416 INFO:teuthology.orchestra.run.smithi074.stderr: 61850K .......... .......... .......... .......... .......... 84% 269M 0s 2019-11-28T21:59:57.416 INFO:teuthology.orchestra.run.smithi074.stderr: 61900K .......... .......... .......... .......... .......... 84% 274M 0s 2019-11-28T21:59:57.416 INFO:teuthology.orchestra.run.smithi074.stderr: 61950K .......... .......... .......... .......... .......... 84% 257M 0s 2019-11-28T21:59:57.416 INFO:teuthology.orchestra.run.smithi074.stderr: 62000K .......... .......... .......... .......... .......... 84% 273M 0s 2019-11-28T21:59:57.416 INFO:teuthology.orchestra.run.smithi074.stderr: 62050K .......... .......... .......... .......... .......... 84% 289M 0s 2019-11-28T21:59:57.416 INFO:teuthology.orchestra.run.smithi074.stderr: 62100K .......... .......... .......... .......... .......... 84% 271M 0s 2019-11-28T21:59:57.416 INFO:teuthology.orchestra.run.smithi074.stderr: 62150K .......... .......... .......... .......... .......... 84% 245M 0s 2019-11-28T21:59:57.417 INFO:teuthology.orchestra.run.smithi074.stderr: 62200K .......... .......... .......... .......... .......... 84% 314M 0s 2019-11-28T21:59:57.417 INFO:teuthology.orchestra.run.smithi074.stderr: 62250K .......... .......... .......... .......... .......... 84% 259M 0s 2019-11-28T21:59:57.417 INFO:teuthology.orchestra.run.smithi074.stderr: 62300K .......... .......... .......... .......... .......... 84% 277M 0s 2019-11-28T21:59:57.417 INFO:teuthology.orchestra.run.smithi074.stderr: 62350K .......... .......... .......... .......... .......... 84% 233M 0s 2019-11-28T21:59:57.417 INFO:teuthology.orchestra.run.smithi074.stderr: 62400K .......... .......... .......... .......... .......... 84% 259M 0s 2019-11-28T21:59:57.417 INFO:teuthology.orchestra.run.smithi074.stderr: 62450K .......... .......... .......... .......... .......... 84% 290M 0s 2019-11-28T21:59:57.417 INFO:teuthology.orchestra.run.smithi074.stderr: 62500K .......... .......... .......... .......... .......... 85% 265M 0s 2019-11-28T21:59:57.417 INFO:teuthology.orchestra.run.smithi074.stderr: 62550K .......... .......... .......... .......... .......... 85% 225M 0s 2019-11-28T21:59:57.418 INFO:teuthology.orchestra.run.smithi074.stderr: 62600K .......... .......... .......... .......... .......... 85% 247M 0s 2019-11-28T21:59:57.418 INFO:teuthology.orchestra.run.smithi074.stderr: 62650K .......... .......... .......... .......... .......... 85% 204M 0s 2019-11-28T21:59:57.418 INFO:teuthology.orchestra.run.smithi074.stderr: 62700K .......... .......... .......... .......... .......... 85% 261M 0s 2019-11-28T21:59:57.418 INFO:teuthology.orchestra.run.smithi074.stderr: 62750K .......... .......... .......... .......... .......... 85% 220M 0s 2019-11-28T21:59:57.418 INFO:teuthology.orchestra.run.smithi074.stderr: 62800K .......... .......... .......... .......... .......... 85% 269M 0s 2019-11-28T21:59:57.418 INFO:teuthology.orchestra.run.smithi074.stderr: 62850K .......... .......... .......... .......... .......... 85% 206M 0s 2019-11-28T21:59:57.418 INFO:teuthology.orchestra.run.smithi074.stderr: 62900K .......... .......... .......... .......... .......... 85% 247M 0s 2019-11-28T21:59:57.419 INFO:teuthology.orchestra.run.smithi074.stderr: 62950K .......... .......... .......... .......... .......... 85% 199M 0s 2019-11-28T21:59:57.419 INFO:teuthology.orchestra.run.smithi074.stderr: 63000K .......... .......... .......... .......... .......... 85% 279M 0s 2019-11-28T21:59:57.419 INFO:teuthology.orchestra.run.smithi074.stderr: 63050K .......... .......... .......... .......... .......... 85% 268M 0s 2019-11-28T21:59:57.419 INFO:teuthology.orchestra.run.smithi074.stderr: 63100K .......... .......... .......... .......... .......... 85% 265M 0s 2019-11-28T21:59:57.419 INFO:teuthology.orchestra.run.smithi074.stderr: 63150K .......... .......... .......... .......... .......... 85% 218M 0s 2019-11-28T21:59:57.419 INFO:teuthology.orchestra.run.smithi074.stderr: 63200K .......... .......... .......... .......... .......... 85% 285M 0s 2019-11-28T21:59:57.419 INFO:teuthology.orchestra.run.smithi074.stderr: 63250K .......... .......... .......... .......... .......... 86% 236M 0s 2019-11-28T21:59:57.419 INFO:teuthology.orchestra.run.smithi074.stderr: 63300K .......... .......... .......... .......... .......... 86% 221M 0s 2019-11-28T21:59:57.420 INFO:teuthology.orchestra.run.smithi074.stderr: 63350K .......... .......... .......... .......... .......... 86% 239M 0s 2019-11-28T21:59:57.420 INFO:teuthology.orchestra.run.smithi074.stderr: 63400K .......... .......... .......... .......... .......... 86% 272M 0s 2019-11-28T21:59:57.420 INFO:teuthology.orchestra.run.smithi074.stderr: 63450K .......... .......... .......... .......... .......... 86% 281M 0s 2019-11-28T21:59:57.420 INFO:teuthology.orchestra.run.smithi074.stderr: 63500K .......... .......... .......... .......... .......... 86% 271M 0s 2019-11-28T21:59:57.420 INFO:teuthology.orchestra.run.smithi074.stderr: 63550K .......... .......... .......... .......... .......... 86% 200M 0s 2019-11-28T21:59:57.420 INFO:teuthology.orchestra.run.smithi074.stderr: 63600K .......... .......... .......... .......... .......... 86% 211M 0s 2019-11-28T21:59:57.420 INFO:teuthology.orchestra.run.smithi074.stderr: 63650K .......... .......... .......... .......... .......... 86% 267M 0s 2019-11-28T21:59:57.421 INFO:teuthology.orchestra.run.smithi074.stderr: 63700K .......... .......... .......... .......... .......... 86% 293M 0s 2019-11-28T21:59:57.421 INFO:teuthology.orchestra.run.smithi074.stderr: 63750K .......... .......... .......... .......... .......... 86% 245M 0s 2019-11-28T21:59:57.421 INFO:teuthology.orchestra.run.smithi074.stderr: 63800K .......... .......... .......... .......... .......... 86% 285M 0s 2019-11-28T21:59:57.421 INFO:teuthology.orchestra.run.smithi074.stderr: 63850K .......... .......... .......... .......... .......... 86% 282M 0s 2019-11-28T21:59:57.421 INFO:teuthology.orchestra.run.smithi074.stderr: 63900K .......... .......... .......... .......... .......... 86% 246M 0s 2019-11-28T21:59:57.421 INFO:teuthology.orchestra.run.smithi074.stderr: 63950K .......... .......... .......... .......... .......... 87% 222M 0s 2019-11-28T21:59:57.421 INFO:teuthology.orchestra.run.smithi074.stderr: 64000K .......... .......... .......... .......... .......... 87% 265M 0s 2019-11-28T21:59:57.421 INFO:teuthology.orchestra.run.smithi074.stderr: 64050K .......... .......... .......... .......... .......... 87% 260M 0s 2019-11-28T21:59:57.422 INFO:teuthology.orchestra.run.smithi074.stderr: 64100K .......... .......... .......... .......... .......... 87% 314M 0s 2019-11-28T21:59:57.422 INFO:teuthology.orchestra.run.smithi074.stderr: 64150K .......... .......... .......... .......... .......... 87% 276M 0s 2019-11-28T21:59:57.422 INFO:teuthology.orchestra.run.smithi074.stderr: 64200K .......... .......... .......... .......... .......... 87% 274M 0s 2019-11-28T21:59:57.422 INFO:teuthology.orchestra.run.smithi074.stderr: 64250K .......... .......... .......... .......... .......... 87% 288M 0s 2019-11-28T21:59:57.422 INFO:teuthology.orchestra.run.smithi074.stderr: 64300K .......... .......... .......... .......... .......... 87% 259M 0s 2019-11-28T21:59:57.422 INFO:teuthology.orchestra.run.smithi074.stderr: 64350K .......... .......... .......... .......... .......... 87% 194M 0s 2019-11-28T21:59:57.422 INFO:teuthology.orchestra.run.smithi074.stderr: 64400K .......... .......... .......... .......... .......... 87% 282M 0s 2019-11-28T21:59:57.423 INFO:teuthology.orchestra.run.smithi074.stderr: 64450K .......... .......... .......... .......... .......... 87% 274M 0s 2019-11-28T21:59:57.423 INFO:teuthology.orchestra.run.smithi074.stderr: 64500K .......... .......... .......... .......... .......... 87% 267M 0s 2019-11-28T21:59:57.423 INFO:teuthology.orchestra.run.smithi074.stderr: 64550K .......... .......... .......... .......... .......... 87% 253M 0s 2019-11-28T21:59:57.423 INFO:teuthology.orchestra.run.smithi074.stderr: 64600K .......... .......... .......... .......... .......... 87% 268M 0s 2019-11-28T21:59:57.423 INFO:teuthology.orchestra.run.smithi074.stderr: 64650K .......... .......... .......... .......... .......... 87% 308M 0s 2019-11-28T21:59:57.423 INFO:teuthology.orchestra.run.smithi074.stderr: 64700K .......... .......... .......... .......... .......... 88% 313M 0s 2019-11-28T21:59:57.423 INFO:teuthology.orchestra.run.smithi074.stderr: 64750K .......... .......... .......... .......... .......... 88% 219M 0s 2019-11-28T21:59:57.423 INFO:teuthology.orchestra.run.smithi074.stderr: 64800K .......... .......... .......... .......... .......... 88% 186M 0s 2019-11-28T21:59:57.424 INFO:teuthology.orchestra.run.smithi074.stderr: 64850K .......... .......... .......... .......... .......... 88% 250M 0s 2019-11-28T21:59:57.424 INFO:teuthology.orchestra.run.smithi074.stderr: 64900K .......... .......... .......... .......... .......... 88% 252M 0s 2019-11-28T21:59:57.424 INFO:teuthology.orchestra.run.smithi074.stderr: 64950K .......... .......... .......... .......... .......... 88% 215M 0s 2019-11-28T21:59:57.424 INFO:teuthology.orchestra.run.smithi074.stderr: 65000K .......... .......... .......... .......... .......... 88% 286M 0s 2019-11-28T21:59:57.424 INFO:teuthology.orchestra.run.smithi074.stderr: 65050K .......... .......... .......... .......... .......... 88% 261M 0s 2019-11-28T21:59:57.424 INFO:teuthology.orchestra.run.smithi074.stderr: 65100K .......... .......... .......... .......... .......... 88% 256M 0s 2019-11-28T21:59:57.424 INFO:teuthology.orchestra.run.smithi074.stderr: 65150K .......... .......... .......... .......... .......... 88% 230M 0s 2019-11-28T21:59:57.425 INFO:teuthology.orchestra.run.smithi074.stderr: 65200K .......... .......... .......... .......... .......... 88% 299M 0s 2019-11-28T21:59:57.425 INFO:teuthology.orchestra.run.smithi074.stderr: 65250K .......... .......... .......... .......... .......... 88% 266M 0s 2019-11-28T21:59:57.425 INFO:teuthology.orchestra.run.smithi074.stderr: 65300K .......... .......... .......... .......... .......... 88% 259M 0s 2019-11-28T21:59:57.425 INFO:teuthology.orchestra.run.smithi074.stderr: 65350K .......... .......... .......... .......... .......... 88% 233M 0s 2019-11-28T21:59:57.425 INFO:teuthology.orchestra.run.smithi074.stderr: 65400K .......... .......... .......... .......... .......... 88% 273M 0s 2019-11-28T21:59:57.425 INFO:teuthology.orchestra.run.smithi074.stderr: 65450K .......... .......... .......... .......... .......... 89% 303M 0s 2019-11-28T21:59:57.425 INFO:teuthology.orchestra.run.smithi074.stderr: 65500K .......... .......... .......... .......... .......... 89% 273M 0s 2019-11-28T21:59:57.425 INFO:teuthology.orchestra.run.smithi074.stderr: 65550K .......... .......... .......... .......... .......... 89% 238M 0s 2019-11-28T21:59:57.426 INFO:teuthology.orchestra.run.smithi074.stderr: 65600K .......... .......... .......... .......... .......... 89% 240M 0s 2019-11-28T21:59:57.426 INFO:teuthology.orchestra.run.smithi074.stderr: 65650K .......... .......... .......... .......... .......... 89% 294M 0s 2019-11-28T21:59:57.426 INFO:teuthology.orchestra.run.smithi074.stderr: 65700K .......... .......... .......... .......... .......... 89% 273M 0s 2019-11-28T21:59:57.426 INFO:teuthology.orchestra.run.smithi074.stderr: 65750K .......... .......... .......... .......... .......... 89% 269M 0s 2019-11-28T21:59:57.426 INFO:teuthology.orchestra.run.smithi074.stderr: 65800K .......... .......... .......... .......... .......... 89% 307M 0s 2019-11-28T21:59:57.426 INFO:teuthology.orchestra.run.smithi074.stderr: 65850K .......... .......... .......... .......... .......... 89% 260M 0s 2019-11-28T21:59:57.426 INFO:teuthology.orchestra.run.smithi074.stderr: 65900K .......... .......... .......... .......... .......... 89% 255M 0s 2019-11-28T21:59:57.427 INFO:teuthology.orchestra.run.smithi074.stderr: 65950K .......... .......... .......... .......... .......... 89% 238M 0s 2019-11-28T21:59:57.427 INFO:teuthology.orchestra.run.smithi074.stderr: 66000K .......... .......... .......... .......... .......... 89% 309M 0s 2019-11-28T21:59:57.427 INFO:teuthology.orchestra.run.smithi074.stderr: 66050K .......... .......... .......... .......... .......... 89% 301M 0s 2019-11-28T21:59:57.427 INFO:teuthology.orchestra.run.smithi074.stderr: 66100K .......... .......... .......... .......... .......... 89% 239M 0s 2019-11-28T21:59:57.427 INFO:teuthology.orchestra.run.smithi074.stderr: 66150K .......... .......... .......... .......... .......... 89% 236M 0s 2019-11-28T21:59:57.427 INFO:teuthology.orchestra.run.smithi074.stderr: 66200K .......... .......... .......... .......... .......... 90% 211M 0s 2019-11-28T21:59:57.427 INFO:teuthology.orchestra.run.smithi074.stderr: 66250K .......... .......... .......... .......... .......... 90% 273M 0s 2019-11-28T21:59:57.427 INFO:teuthology.orchestra.run.smithi074.stderr: 66300K .......... .......... .......... .......... .......... 90% 221M 0s 2019-11-28T21:59:57.428 INFO:teuthology.orchestra.run.smithi074.stderr: 66350K .......... .......... .......... .......... .......... 90% 223M 0s 2019-11-28T21:59:57.428 INFO:teuthology.orchestra.run.smithi074.stderr: 66400K .......... .......... .......... .......... .......... 90% 208M 0s 2019-11-28T21:59:57.428 INFO:teuthology.orchestra.run.smithi074.stderr: 66450K .......... .......... .......... .......... .......... 90% 263M 0s 2019-11-28T21:59:57.428 INFO:teuthology.orchestra.run.smithi074.stderr: 66500K .......... .......... .......... .......... .......... 90% 248M 0s 2019-11-28T21:59:57.428 INFO:teuthology.orchestra.run.smithi074.stderr: 66550K .......... .......... .......... .......... .......... 90% 261M 0s 2019-11-28T21:59:57.428 INFO:teuthology.orchestra.run.smithi074.stderr: 66600K .......... .......... .......... .......... .......... 90% 296M 0s 2019-11-28T21:59:57.428 INFO:teuthology.orchestra.run.smithi074.stderr: 66650K .......... .......... .......... .......... .......... 90% 296M 0s 2019-11-28T21:59:57.429 INFO:teuthology.orchestra.run.smithi074.stderr: 66700K .......... .......... .......... .......... .......... 90% 300M 0s 2019-11-28T21:59:57.429 INFO:teuthology.orchestra.run.smithi074.stderr: 66750K .......... .......... .......... .......... .......... 90% 213M 0s 2019-11-28T21:59:57.429 INFO:teuthology.orchestra.run.smithi074.stderr: 66800K .......... .......... .......... .......... .......... 90% 254M 0s 2019-11-28T21:59:57.429 INFO:teuthology.orchestra.run.smithi074.stderr: 66850K .......... .......... .......... .......... .......... 90% 293M 0s 2019-11-28T21:59:57.429 INFO:teuthology.orchestra.run.smithi074.stderr: 66900K .......... .......... .......... .......... .......... 91% 283M 0s 2019-11-28T21:59:57.429 INFO:teuthology.orchestra.run.smithi074.stderr: 66950K .......... .......... .......... .......... .......... 91% 268M 0s 2019-11-28T21:59:57.429 INFO:teuthology.orchestra.run.smithi074.stderr: 67000K .......... .......... .......... .......... .......... 91% 268M 0s 2019-11-28T21:59:57.429 INFO:teuthology.orchestra.run.smithi074.stderr: 67050K .......... .......... .......... .......... .......... 91% 290M 0s 2019-11-28T21:59:57.430 INFO:teuthology.orchestra.run.smithi074.stderr: 67100K .......... .......... .......... .......... .......... 91% 275M 0s 2019-11-28T21:59:57.430 INFO:teuthology.orchestra.run.smithi074.stderr: 67150K .......... .......... .......... .......... .......... 91% 252M 0s 2019-11-28T21:59:57.430 INFO:teuthology.orchestra.run.smithi074.stderr: 67200K .......... .......... .......... .......... .......... 91% 296M 0s 2019-11-28T21:59:57.430 INFO:teuthology.orchestra.run.smithi074.stderr: 67250K .......... .......... .......... .......... .......... 91% 306M 0s 2019-11-28T21:59:57.430 INFO:teuthology.orchestra.run.smithi074.stderr: 67300K .......... .......... .......... .......... .......... 91% 268M 0s 2019-11-28T21:59:57.430 INFO:teuthology.orchestra.run.smithi074.stderr: 67350K .......... .......... .......... .......... .......... 91% 255M 0s 2019-11-28T21:59:57.430 INFO:teuthology.orchestra.run.smithi074.stderr: 67400K .......... .......... .......... .......... .......... 91% 277M 0s 2019-11-28T21:59:57.431 INFO:teuthology.orchestra.run.smithi074.stderr: 67450K .......... .......... .......... .......... .......... 91% 304M 0s 2019-11-28T21:59:57.431 INFO:teuthology.orchestra.run.smithi074.stderr: 67500K .......... .......... .......... .......... .......... 91% 265M 0s 2019-11-28T21:59:57.431 INFO:teuthology.orchestra.run.smithi074.stderr: 67550K .......... .......... .......... .......... .......... 91% 230M 0s 2019-11-28T21:59:57.431 INFO:teuthology.orchestra.run.smithi074.stderr: 67600K .......... .......... .......... .......... .......... 91% 301M 0s 2019-11-28T21:59:57.431 INFO:teuthology.orchestra.run.smithi074.stderr: 67650K .......... .......... .......... .......... .......... 92% 263M 0s 2019-11-28T21:59:57.431 INFO:teuthology.orchestra.run.smithi074.stderr: 67700K .......... .......... .......... .......... .......... 92% 274M 0s 2019-11-28T21:59:57.431 INFO:teuthology.orchestra.run.smithi074.stderr: 67750K .......... .......... .......... .......... .......... 92% 261M 0s 2019-11-28T21:59:57.431 INFO:teuthology.orchestra.run.smithi074.stderr: 67800K .......... .......... .......... .......... .......... 92% 303M 0s 2019-11-28T21:59:57.432 INFO:teuthology.orchestra.run.smithi074.stderr: 67850K .......... .......... .......... .......... .......... 92% 314M 0s 2019-11-28T21:59:57.432 INFO:teuthology.orchestra.run.smithi074.stderr: 67900K .......... .......... .......... .......... .......... 92% 267M 0s 2019-11-28T21:59:57.432 INFO:teuthology.orchestra.run.smithi074.stderr: 67950K .......... .......... .......... .......... .......... 92% 234M 0s 2019-11-28T21:59:57.432 INFO:teuthology.orchestra.run.smithi074.stderr: 68000K .......... .......... .......... .......... .......... 92% 265M 0s 2019-11-28T21:59:57.433 INFO:teuthology.orchestra.run.smithi074.stderr: 68050K .......... .......... .......... .......... .......... 92% 301M 0s 2019-11-28T21:59:57.433 INFO:teuthology.orchestra.run.smithi074.stderr: 68100K .......... .......... .......... .......... .......... 92% 284M 0s 2019-11-28T21:59:57.433 INFO:teuthology.orchestra.run.smithi074.stderr: 68150K .......... .......... .......... .......... .......... 92% 208M 0s 2019-11-28T21:59:57.433 INFO:teuthology.orchestra.run.smithi074.stderr: 68200K .......... .......... .......... .......... .......... 92% 247M 0s 2019-11-28T21:59:57.433 INFO:teuthology.orchestra.run.smithi074.stderr: 68250K .......... .......... .......... .......... .......... 92% 260M 0s 2019-11-28T21:59:57.433 INFO:teuthology.orchestra.run.smithi074.stderr: 68300K .......... .......... .......... .......... .......... 92% 262M 0s 2019-11-28T21:59:57.434 INFO:teuthology.orchestra.run.smithi074.stderr: 68350K .......... .......... .......... .......... .......... 92% 231M 0s 2019-11-28T21:59:57.434 INFO:teuthology.orchestra.run.smithi074.stderr: 68400K .......... .......... .......... .......... .......... 93% 248M 0s 2019-11-28T21:59:57.434 INFO:teuthology.orchestra.run.smithi074.stderr: 68450K .......... .......... .......... .......... .......... 93% 275M 0s 2019-11-28T21:59:57.434 INFO:teuthology.orchestra.run.smithi074.stderr: 68500K .......... .......... .......... .......... .......... 93% 268M 0s 2019-11-28T21:59:57.434 INFO:teuthology.orchestra.run.smithi074.stderr: 68550K .......... .......... .......... .......... .......... 93% 238M 0s 2019-11-28T21:59:57.434 INFO:teuthology.orchestra.run.smithi074.stderr: 68600K .......... .......... .......... .......... .......... 93% 279M 0s 2019-11-28T21:59:57.434 INFO:teuthology.orchestra.run.smithi074.stderr: 68650K .......... .......... .......... .......... .......... 93% 285M 0s 2019-11-28T21:59:57.435 INFO:teuthology.orchestra.run.smithi074.stderr: 68700K .......... .......... .......... .......... .......... 93% 290M 0s 2019-11-28T21:59:57.435 INFO:teuthology.orchestra.run.smithi074.stderr: 68750K .......... .......... .......... .......... .......... 93% 233M 0s 2019-11-28T21:59:57.435 INFO:teuthology.orchestra.run.smithi074.stderr: 68800K .......... .......... .......... .......... .......... 93% 298M 0s 2019-11-28T21:59:57.435 INFO:teuthology.orchestra.run.smithi074.stderr: 68850K .......... .......... .......... .......... .......... 93% 232M 0s 2019-11-28T21:59:57.435 INFO:teuthology.orchestra.run.smithi074.stderr: 68900K .......... .......... .......... .......... .......... 93% 236M 0s 2019-11-28T21:59:57.435 INFO:teuthology.orchestra.run.smithi074.stderr: 68950K .......... .......... .......... .......... .......... 93% 208M 0s 2019-11-28T21:59:57.435 INFO:teuthology.orchestra.run.smithi074.stderr: 69000K .......... .......... .......... .......... .......... 93% 296M 0s 2019-11-28T21:59:57.436 INFO:teuthology.orchestra.run.smithi074.stderr: 69050K .......... .......... .......... .......... .......... 93% 294M 0s 2019-11-28T21:59:57.436 INFO:teuthology.orchestra.run.smithi074.stderr: 69100K .......... .......... .......... .......... .......... 94% 284M 0s 2019-11-28T21:59:57.436 INFO:teuthology.orchestra.run.smithi074.stderr: 69150K .......... .......... .......... .......... .......... 94% 238M 0s 2019-11-28T21:59:57.436 INFO:teuthology.orchestra.run.smithi074.stderr: 69200K .......... .......... .......... .......... .......... 94% 295M 0s 2019-11-28T21:59:57.436 INFO:teuthology.orchestra.run.smithi074.stderr: 69250K .......... .......... .......... .......... .......... 94% 279M 0s 2019-11-28T21:59:57.436 INFO:teuthology.orchestra.run.smithi074.stderr: 69300K .......... .......... .......... .......... .......... 94% 292M 0s 2019-11-28T21:59:57.436 INFO:teuthology.orchestra.run.smithi074.stderr: 69350K .......... .......... .......... .......... .......... 94% 253M 0s 2019-11-28T21:59:57.437 INFO:teuthology.orchestra.run.smithi074.stderr: 69400K .......... .......... .......... .......... .......... 94% 284M 0s 2019-11-28T21:59:57.437 INFO:teuthology.orchestra.run.smithi074.stderr: 69450K .......... .......... .......... .......... .......... 94% 294M 0s 2019-11-28T21:59:57.437 INFO:teuthology.orchestra.run.smithi074.stderr: 69500K .......... .......... .......... .......... .......... 94% 288M 0s 2019-11-28T21:59:57.437 INFO:teuthology.orchestra.run.smithi074.stderr: 69550K .......... .......... .......... .......... .......... 94% 226M 0s 2019-11-28T21:59:57.437 INFO:teuthology.orchestra.run.smithi074.stderr: 69600K .......... .......... .......... .......... .......... 94% 275M 0s 2019-11-28T21:59:57.437 INFO:teuthology.orchestra.run.smithi074.stderr: 69650K .......... .......... .......... .......... .......... 94% 265M 0s 2019-11-28T21:59:57.437 INFO:teuthology.orchestra.run.smithi074.stderr: 69700K .......... .......... .......... .......... .......... 94% 233M 0s 2019-11-28T21:59:57.437 INFO:teuthology.orchestra.run.smithi074.stderr: 69750K .......... .......... .......... .......... .......... 94% 256M 0s 2019-11-28T21:59:57.438 INFO:teuthology.orchestra.run.smithi074.stderr: 69800K .......... .......... .......... .......... .......... 94% 270M 0s 2019-11-28T21:59:57.438 INFO:teuthology.orchestra.run.smithi074.stderr: 69850K .......... .......... .......... .......... .......... 95% 272M 0s 2019-11-28T21:59:57.438 INFO:teuthology.orchestra.run.smithi074.stderr: 69900K .......... .......... .......... .......... .......... 95% 277M 0s 2019-11-28T21:59:57.438 INFO:teuthology.orchestra.run.smithi074.stderr: 69950K .......... .......... .......... .......... .......... 95% 224M 0s 2019-11-28T21:59:57.438 INFO:teuthology.orchestra.run.smithi074.stderr: 70000K .......... .......... .......... .......... .......... 95% 268M 0s 2019-11-28T21:59:57.438 INFO:teuthology.orchestra.run.smithi074.stderr: 70050K .......... .......... .......... .......... .......... 95% 289M 0s 2019-11-28T21:59:57.438 INFO:teuthology.orchestra.run.smithi074.stderr: 70100K .......... .......... .......... .......... .......... 95% 279M 0s 2019-11-28T21:59:57.439 INFO:teuthology.orchestra.run.smithi074.stderr: 70150K .......... .......... .......... .......... .......... 95% 262M 0s 2019-11-28T21:59:57.439 INFO:teuthology.orchestra.run.smithi074.stderr: 70200K .......... .......... .......... .......... .......... 95% 283M 0s 2019-11-28T21:59:57.439 INFO:teuthology.orchestra.run.smithi074.stderr: 70250K .......... .......... .......... .......... .......... 95% 293M 0s 2019-11-28T21:59:57.439 INFO:teuthology.orchestra.run.smithi074.stderr: 70300K .......... .......... .......... .......... .......... 95% 277M 0s 2019-11-28T21:59:57.439 INFO:teuthology.orchestra.run.smithi074.stderr: 70350K .......... .......... .......... .......... .......... 95% 225M 0s 2019-11-28T21:59:57.439 INFO:teuthology.orchestra.run.smithi074.stderr: 70400K .......... .......... .......... .......... .......... 95% 272M 0s 2019-11-28T21:59:57.439 INFO:teuthology.orchestra.run.smithi074.stderr: 70450K .......... .......... .......... .......... .......... 95% 276M 0s 2019-11-28T21:59:57.440 INFO:teuthology.orchestra.run.smithi074.stderr: 70500K .......... .......... .......... .......... .......... 95% 260M 0s 2019-11-28T21:59:57.441 INFO:teuthology.orchestra.run.smithi074.stderr: 70550K .......... .......... .......... .......... .......... 95% 255M 0s 2019-11-28T21:59:57.441 INFO:teuthology.orchestra.run.smithi074.stderr: 70600K .......... .......... .......... .......... .......... 96% 295M 0s 2019-11-28T21:59:57.441 INFO:teuthology.orchestra.run.smithi074.stderr: 70650K .......... .......... .......... .......... .......... 96% 284M 0s 2019-11-28T21:59:57.441 INFO:teuthology.orchestra.run.smithi074.stderr: 70700K .......... .......... .......... .......... .......... 96% 303M 0s 2019-11-28T21:59:57.441 INFO:teuthology.orchestra.run.smithi074.stderr: 70750K .......... .......... .......... .......... .......... 96% 237M 0s 2019-11-28T21:59:57.441 INFO:teuthology.orchestra.run.smithi074.stderr: 70800K .......... .......... .......... .......... .......... 96% 296M 0s 2019-11-28T21:59:57.441 INFO:teuthology.orchestra.run.smithi074.stderr: 70850K .......... .......... .......... .......... .......... 96% 282M 0s 2019-11-28T21:59:57.442 INFO:teuthology.orchestra.run.smithi074.stderr: 70900K .......... .......... .......... .......... .......... 96% 275M 0s 2019-11-28T21:59:57.442 INFO:teuthology.orchestra.run.smithi074.stderr: 70950K .......... .......... .......... .......... .......... 96% 258M 0s 2019-11-28T21:59:57.442 INFO:teuthology.orchestra.run.smithi074.stderr: 71000K .......... .......... .......... .......... .......... 96% 283M 0s 2019-11-28T21:59:57.442 INFO:teuthology.orchestra.run.smithi074.stderr: 71050K .......... .......... .......... .......... .......... 96% 290M 0s 2019-11-28T21:59:57.442 INFO:teuthology.orchestra.run.smithi074.stderr: 71100K .......... .......... .......... .......... .......... 96% 286M 0s 2019-11-28T21:59:57.442 INFO:teuthology.orchestra.run.smithi074.stderr: 71150K .......... .......... .......... .......... .......... 96% 234M 0s 2019-11-28T21:59:57.442 INFO:teuthology.orchestra.run.smithi074.stderr: 71200K .......... .......... .......... .......... .......... 96% 286M 0s 2019-11-28T21:59:57.443 INFO:teuthology.orchestra.run.smithi074.stderr: 71250K .......... .......... .......... .......... .......... 96% 293M 0s 2019-11-28T21:59:57.443 INFO:teuthology.orchestra.run.smithi074.stderr: 71300K .......... .......... .......... .......... .......... 96% 266M 0s 2019-11-28T21:59:57.443 INFO:teuthology.orchestra.run.smithi074.stderr: 71350K .......... .......... .......... .......... .......... 97% 230M 0s 2019-11-28T21:59:57.443 INFO:teuthology.orchestra.run.smithi074.stderr: 71400K .......... .......... .......... .......... .......... 97% 274M 0s 2019-11-28T21:59:57.443 INFO:teuthology.orchestra.run.smithi074.stderr: 71450K .......... .......... .......... .......... .......... 97% 281M 0s 2019-11-28T21:59:57.443 INFO:teuthology.orchestra.run.smithi074.stderr: 71500K .......... .......... .......... .......... .......... 97% 285M 0s 2019-11-28T21:59:57.443 INFO:teuthology.orchestra.run.smithi074.stderr: 71550K .......... .......... .......... .......... .......... 97% 238M 0s 2019-11-28T21:59:57.444 INFO:teuthology.orchestra.run.smithi074.stderr: 71600K .......... .......... .......... .......... .......... 97% 264M 0s 2019-11-28T21:59:57.444 INFO:teuthology.orchestra.run.smithi074.stderr: 71650K .......... .......... .......... .......... .......... 97% 280M 0s 2019-11-28T21:59:57.444 INFO:teuthology.orchestra.run.smithi074.stderr: 71700K .......... .......... .......... .......... .......... 97% 281M 0s 2019-11-28T21:59:57.444 INFO:teuthology.orchestra.run.smithi074.stderr: 71750K .......... .......... .......... .......... .......... 97% 253M 0s 2019-11-28T21:59:57.444 INFO:teuthology.orchestra.run.smithi074.stderr: 71800K .......... .......... .......... .......... .......... 97% 253M 0s 2019-11-28T21:59:57.444 INFO:teuthology.orchestra.run.smithi074.stderr: 71850K .......... .......... .......... .......... .......... 97% 290M 0s 2019-11-28T21:59:57.444 INFO:teuthology.orchestra.run.smithi074.stderr: 71900K .......... .......... .......... .......... .......... 97% 293M 0s 2019-11-28T21:59:57.445 INFO:teuthology.orchestra.run.smithi074.stderr: 71950K .......... .......... .......... .......... .......... 97% 261M 0s 2019-11-28T21:59:57.445 INFO:teuthology.orchestra.run.smithi074.stderr: 72000K .......... .......... .......... .......... .......... 97% 266M 0s 2019-11-28T21:59:57.445 INFO:teuthology.orchestra.run.smithi074.stderr: 72050K .......... .......... .......... .......... .......... 98% 285M 0s 2019-11-28T21:59:57.445 INFO:teuthology.orchestra.run.smithi074.stderr: 72100K .......... .......... .......... .......... .......... 98% 271M 0s 2019-11-28T21:59:57.445 INFO:teuthology.orchestra.run.smithi074.stderr: 72150K .......... .......... .......... .......... .......... 98% 247M 0s 2019-11-28T21:59:57.445 INFO:teuthology.orchestra.run.smithi074.stderr: 72200K .......... .......... .......... .......... .......... 98% 305M 0s 2019-11-28T21:59:57.445 INFO:teuthology.orchestra.run.smithi074.stderr: 72250K .......... .......... .......... .......... .......... 98% 266M 0s 2019-11-28T21:59:57.446 INFO:teuthology.orchestra.run.smithi074.stderr: 72300K .......... .......... .......... .......... .......... 98% 292M 0s 2019-11-28T21:59:57.446 INFO:teuthology.orchestra.run.smithi074.stderr: 72350K .......... .......... .......... .......... .......... 98% 247M 0s 2019-11-28T21:59:57.446 INFO:teuthology.orchestra.run.smithi074.stderr: 72400K .......... .......... .......... .......... .......... 98% 288M 0s 2019-11-28T21:59:57.446 INFO:teuthology.orchestra.run.smithi074.stderr: 72450K .......... .......... .......... .......... .......... 98% 293M 0s 2019-11-28T21:59:57.446 INFO:teuthology.orchestra.run.smithi074.stderr: 72500K .......... .......... .......... .......... .......... 98% 295M 0s 2019-11-28T21:59:57.446 INFO:teuthology.orchestra.run.smithi074.stderr: 72550K .......... .......... .......... .......... .......... 98% 260M 0s 2019-11-28T21:59:57.446 INFO:teuthology.orchestra.run.smithi074.stderr: 72600K .......... .......... .......... .......... .......... 98% 288M 0s 2019-11-28T21:59:57.446 INFO:teuthology.orchestra.run.smithi074.stderr: 72650K .......... .......... .......... .......... .......... 98% 296M 0s 2019-11-28T21:59:57.447 INFO:teuthology.orchestra.run.smithi074.stderr: 72700K .......... .......... .......... .......... .......... 98% 277M 0s 2019-11-28T21:59:57.447 INFO:teuthology.orchestra.run.smithi074.stderr: 72750K .......... .......... .......... .......... .......... 98% 233M 0s 2019-11-28T21:59:57.447 INFO:teuthology.orchestra.run.smithi074.stderr: 72800K .......... .......... .......... .......... .......... 99% 282M 0s 2019-11-28T21:59:57.447 INFO:teuthology.orchestra.run.smithi074.stderr: 72850K .......... .......... .......... .......... .......... 99% 298M 0s 2019-11-28T21:59:57.447 INFO:teuthology.orchestra.run.smithi074.stderr: 72900K .......... .......... .......... .......... .......... 99% 280M 0s 2019-11-28T21:59:57.447 INFO:teuthology.orchestra.run.smithi074.stderr: 72950K .......... .......... .......... .......... .......... 99% 251M 0s 2019-11-28T21:59:57.447 INFO:teuthology.orchestra.run.smithi074.stderr: 73000K .......... .......... .......... .......... .......... 99% 285M 0s 2019-11-28T21:59:57.448 INFO:teuthology.orchestra.run.smithi074.stderr: 73050K .......... .......... .......... .......... .......... 99% 296M 0s 2019-11-28T21:59:57.448 INFO:teuthology.orchestra.run.smithi074.stderr: 73100K .......... .......... .......... .......... .......... 99% 281M 0s 2019-11-28T21:59:57.448 INFO:teuthology.orchestra.run.smithi074.stderr: 73150K .......... .......... .......... .......... .......... 99% 233M 0s 2019-11-28T21:59:57.448 INFO:teuthology.orchestra.run.smithi074.stderr: 73200K .......... .......... .......... .......... .......... 99% 280M 0s 2019-11-28T21:59:57.448 INFO:teuthology.orchestra.run.smithi074.stderr: 73250K .......... .......... .......... .......... .......... 99% 284M 0s 2019-11-28T21:59:57.448 INFO:teuthology.orchestra.run.smithi074.stderr: 73300K .......... .......... .......... .......... .......... 99% 293M 0s 2019-11-28T21:59:57.448 INFO:teuthology.orchestra.run.smithi074.stderr: 73350K .......... .......... .......... .......... .......... 99% 264M 0s 2019-11-28T21:59:57.449 INFO:teuthology.orchestra.run.smithi074.stderr: 73400K .......... .......... .......... .......... .......... 99% 297M 0s 2019-11-28T21:59:57.449 INFO:teuthology.orchestra.run.smithi074.stderr: 73450K .......... .......... .......... .......... .......... 99% 302M 0s 2019-11-28T21:59:57.449 INFO:teuthology.orchestra.run.smithi074.stderr: 73500K .......... .......... .......... .......... .......... 99% 298M 0s 2019-11-28T21:59:57.449 INFO:teuthology.orchestra.run.smithi074.stderr: 73550K ........ 100% 147M=0.3s 2019-11-28T21:59:57.449 INFO:teuthology.orchestra.run.smithi074.stderr: 2019-11-28T21:59:57.449 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28 21:59:56 (208 MB/s) - ‘gradle-4.7-bin.zip’ saved [75323957/75323957] 2019-11-28T21:59:57.449 INFO:teuthology.orchestra.run.smithi074.stderr: 2019-11-28T21:59:57.450 INFO:teuthology.orchestra.run.smithi074.stdout:Archive: gradle-4.7-bin.zip 2019-11-28T21:59:57.450 INFO:teuthology.orchestra.run.smithi074.stdout: creating: /opt/gradle/gradle-4.7/ 2019-11-28T21:59:57.450 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/getting-started.html 2019-11-28T21:59:57.450 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/LICENSE 2019-11-28T21:59:57.450 INFO:teuthology.orchestra.run.smithi074.stdout: creating: /opt/gradle/gradle-4.7/media/ 2019-11-28T21:59:57.450 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-64x64.png 2019-11-28T21:59:57.451 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-48x48.png 2019-11-28T21:59:57.451 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle.icns 2019-11-28T21:59:57.451 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-24x24.png 2019-11-28T21:59:57.451 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-256x256.png 2019-11-28T21:59:57.451 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-512x512.png 2019-11-28T21:59:57.451 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-16x16.png 2019-11-28T21:59:57.452 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-32x32.png 2019-11-28T21:59:57.452 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-128x128.png 2019-11-28T21:59:57.452 INFO:teuthology.orchestra.run.smithi074.stdout: creating: /opt/gradle/gradle-4.7/init.d/ 2019-11-28T21:59:57.452 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/init.d/readme.txt 2019-11-28T21:59:57.452 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/NOTICE 2019-11-28T21:59:57.452 INFO:teuthology.orchestra.run.smithi074.stdout: creating: /opt/gradle/gradle-4.7/bin/ 2019-11-28T21:59:57.452 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/bin/gradle.bat 2019-11-28T21:59:57.453 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/bin/gradle 2019-11-28T21:59:57.453 INFO:teuthology.orchestra.run.smithi074.stdout: creating: /opt/gradle/gradle-4.7/lib/ 2019-11-28T21:59:57.453 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/annotations-13.0.jar 2019-11-28T21:59:57.453 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-kotlin-dsl-0.16.3.jar 2019-11-28T21:59:57.453 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-kotlin-dsl-tooling-builders-0.16.3.jar 2019-11-28T21:59:57.453 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-kotlin-dsl-tooling-models-0.16.3.jar 2019-11-28T21:59:57.453 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-compiler-embeddable-1.2.31.jar 2019-11-28T21:59:57.454 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-reflect-1.2.31.jar 2019-11-28T21:59:57.454 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-sam-with-receiver-compiler-plugin-1.2.31.jar 2019-11-28T21:59:57.454 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-script-runtime-1.2.31.jar 2019-11-28T21:59:57.454 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-stdlib-1.2.31.jar 2019-11-28T21:59:57.454 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-stdlib-jdk7-1.2.31.jar 2019-11-28T21:59:57.454 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-stdlib-jdk8-1.2.31.jar 2019-11-28T21:59:57.454 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-launcher-4.7.jar 2019-11-28T21:59:57.455 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-runtime-api-info-4.7.jar 2019-11-28T21:59:57.455 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-tooling-api-4.7.jar 2019-11-28T21:59:57.455 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-wrapper-4.7.jar 2019-11-28T21:59:57.455 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-installation-beacon-4.7.jar 2019-11-28T21:59:57.455 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-core-4.7.jar 2019-11-28T21:59:57.455 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-jvm-services-4.7.jar 2019-11-28T21:59:57.455 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-core-api-4.7.jar 2019-11-28T21:59:57.456 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-build-cache-4.7.jar 2019-11-28T21:59:57.456 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-logging-4.7.jar 2019-11-28T21:59:57.456 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-process-services-4.7.jar 2019-11-28T21:59:57.456 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-resources-4.7.jar 2019-11-28T21:59:57.456 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-persistent-cache-4.7.jar 2019-11-28T21:59:57.456 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-native-4.7.jar 2019-11-28T21:59:57.456 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-model-groovy-4.7.jar 2019-11-28T21:59:57.457 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-model-core-4.7.jar 2019-11-28T21:59:57.457 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-base-services-groovy-4.7.jar 2019-11-28T21:59:57.457 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-messaging-4.7.jar 2019-11-28T21:59:57.457 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-base-services-4.7.jar 2019-11-28T21:59:57.457 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-build-option-4.7.jar 2019-11-28T21:59:57.457 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-cli-4.7.jar 2019-11-28T21:59:57.457 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-docs-4.7.jar 2019-11-28T21:59:57.457 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/asm-commons-6.1.1.jar 2019-11-28T21:59:57.458 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/asm-analysis-6.1.1.jar 2019-11-28T21:59:57.458 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/asm-tree-6.1.1.jar 2019-11-28T21:59:57.458 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/kryo-2.20.jar 2019-11-28T21:59:57.458 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/reflectasm-1.07-shaded.jar 2019-11-28T21:59:57.458 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/asm-6.1.1.jar 2019-11-28T21:59:57.458 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/commons-io-2.4.jar 2019-11-28T21:59:57.458 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/jcl-over-slf4j-1.7.16.jar 2019-11-28T21:59:57.459 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/jul-to-slf4j-1.7.16.jar 2019-11-28T21:59:57.459 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/log4j-over-slf4j-1.7.16.jar 2019-11-28T21:59:57.459 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/slf4j-api-1.7.16.jar 2019-11-28T21:59:57.459 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/guava-jdk5-17.0.jar 2019-11-28T21:59:57.459 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/jsr305-2.0.1.jar 2019-11-28T21:59:57.459 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/fastutil-7.2.1-min.jar 2019-11-28T21:59:57.459 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/commons-lang-2.6.jar 2019-11-28T21:59:57.460 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/jcip-annotations-1.0.jar 2019-11-28T21:59:57.460 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/groovy-all-2.4.12.jar 2019-11-28T21:59:57.460 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/ant-1.9.9.jar 2019-11-28T21:59:57.460 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/javax.inject-1.jar 2019-11-28T21:59:57.460 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/commons-collections-3.2.2.jar 2019-11-28T21:59:57.460 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-0.14.jar 2019-11-28T21:59:57.460 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/commons-compress-1.14.jar 2019-11-28T21:59:57.461 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/xml-apis-1.4.01.jar 2019-11-28T21:59:57.461 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/jansi-1.14.jar 2019-11-28T21:59:57.461 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/ant-launcher-1.9.9.jar 2019-11-28T21:59:57.461 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-freebsd-amd64-libcpp-0.14.jar 2019-11-28T21:59:57.461 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-freebsd-amd64-libstdcpp-0.14.jar 2019-11-28T21:59:57.461 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-freebsd-i386-libcpp-0.14.jar 2019-11-28T21:59:57.461 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-freebsd-i386-libstdcpp-0.14.jar 2019-11-28T21:59:57.461 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-amd64-0.14.jar 2019-11-28T21:59:57.462 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-i386-0.14.jar 2019-11-28T21:59:57.462 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-osx-amd64-0.14.jar 2019-11-28T21:59:57.462 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-osx-i386-0.14.jar 2019-11-28T21:59:57.462 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-windows-amd64-0.14.jar 2019-11-28T21:59:57.462 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-windows-i386-0.14.jar 2019-11-28T21:59:57.462 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-amd64-ncurses5-0.14.jar 2019-11-28T21:59:57.462 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-amd64-ncurses6-0.14.jar 2019-11-28T21:59:57.463 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-i386-ncurses5-0.14.jar 2019-11-28T21:59:57.463 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-i386-ncurses6-0.14.jar 2019-11-28T21:59:57.463 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/minlog-1.2.jar 2019-11-28T21:59:57.463 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/objenesis-1.2.jar 2019-11-28T21:59:57.463 INFO:teuthology.orchestra.run.smithi074.stdout: creating: /opt/gradle/gradle-4.7/lib/plugins/ 2019-11-28T21:59:57.463 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-announce-4.7.jar 2019-11-28T21:59:57.463 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-antlr-4.7.jar 2019-11-28T21:59:57.464 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-code-quality-4.7.jar 2019-11-28T21:59:57.464 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-osgi-4.7.jar 2019-11-28T21:59:57.464 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-signing-4.7.jar 2019-11-28T21:59:57.464 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ide-native-4.7.jar 2019-11-28T21:59:57.464 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-testing-native-4.7.jar 2019-11-28T21:59:57.464 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-native-4.7.jar 2019-11-28T21:59:57.464 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-plugin-development-4.7.jar 2019-11-28T21:59:57.465 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-maven-4.7.jar 2019-11-28T21:59:57.465 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ide-play-4.7.jar 2019-11-28T21:59:57.465 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ide-4.7.jar 2019-11-28T21:59:57.465 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-scala-4.7.jar 2019-11-28T21:59:57.465 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-build-comparison-4.7.jar 2019-11-28T21:59:57.465 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ear-4.7.jar 2019-11-28T21:59:57.465 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-platform-play-4.7.jar 2019-11-28T21:59:57.466 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-javascript-4.7.jar 2019-11-28T21:59:57.466 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ivy-4.7.jar 2019-11-28T21:59:57.466 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-jacoco-4.7.jar 2019-11-28T21:59:57.466 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-build-init-4.7.jar 2019-11-28T21:59:57.466 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-plugins-4.7.jar 2019-11-28T21:59:57.466 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-tooling-api-builders-4.7.jar 2019-11-28T21:59:57.466 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-test-kit-4.7.jar 2019-11-28T21:59:57.467 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-composite-builds-4.7.jar 2019-11-28T21:59:57.467 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-groovy-4.7.jar 2019-11-28T21:59:57.467 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-scala-4.7.jar 2019-11-28T21:59:57.467 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-testing-junit-platform-4.7.jar 2019-11-28T21:59:57.467 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-testing-jvm-4.7.jar 2019-11-28T21:59:57.467 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-java-4.7.jar 2019-11-28T21:59:57.467 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-jvm-4.7.jar 2019-11-28T21:59:57.467 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-platform-jvm-4.7.jar 2019-11-28T21:59:57.468 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-platform-native-4.7.jar 2019-11-28T21:59:57.468 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-diagnostics-4.7.jar 2019-11-28T21:59:57.468 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-testing-base-4.7.jar 2019-11-28T21:59:57.468 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-reporting-4.7.jar 2019-11-28T21:59:57.468 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-publish-4.7.jar 2019-11-28T21:59:57.468 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-platform-base-4.7.jar 2019-11-28T21:59:57.468 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-plugin-use-4.7.jar 2019-11-28T21:59:57.469 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-resources-s3-4.7.jar 2019-11-28T21:59:57.469 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-resources-gcs-4.7.jar 2019-11-28T21:59:57.469 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-build-cache-http-4.7.jar 2019-11-28T21:59:57.469 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-dependency-management-4.7.jar 2019-11-28T21:59:57.469 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-resources-http-4.7.jar 2019-11-28T21:59:57.469 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-resources-sftp-4.7.jar 2019-11-28T21:59:57.469 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-workers-4.7.jar 2019-11-28T21:59:57.470 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-version-control-4.7.jar 2019-11-28T21:59:57.470 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aws-java-sdk-s3-1.11.267.jar 2019-11-28T21:59:57.470 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aws-java-sdk-kms-1.11.267.jar 2019-11-28T21:59:57.470 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aws-java-sdk-core-1.11.267.jar 2019-11-28T21:59:57.470 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/org.eclipse.jgit-4.5.3.201708160445-r.jar 2019-11-28T21:59:57.470 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/wagon-http-2.4.jar 2019-11-28T21:59:57.470 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/wagon-http-shared4-2.4.jar 2019-11-28T21:59:57.471 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-api-services-storage-v1-rev116-1.23.0.jar 2019-11-28T21:59:57.471 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-api-client-1.23.0.jar 2019-11-28T21:59:57.471 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-oauth-client-1.23.0.jar 2019-11-28T21:59:57.471 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-http-client-jackson2-1.23.0.jar 2019-11-28T21:59:57.471 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-http-client-1.23.0.jar 2019-11-28T21:59:57.471 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/httpclient-4.5.5.jar 2019-11-28T21:59:57.471 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/commons-codec-1.10.jar 2019-11-28T21:59:57.471 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-container-default-1.5.5.jar 2019-11-28T21:59:57.472 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/xbean-reflect-3.4.jar 2019-11-28T21:59:57.472 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/asm-util-6.1.1.jar 2019-11-28T21:59:57.472 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jatl-0.2.2.jar 2019-11-28T21:59:57.472 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/commons-cli-1.2.jar 2019-11-28T21:59:57.472 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/biz.aQute.bndlib-3.4.0.jar 2019-11-28T21:59:57.472 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/ivy-2.2.0.jar 2019-11-28T21:59:57.472 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-compat-3.0.4.jar 2019-11-28T21:59:57.473 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-core-3.0.4.jar 2019-11-28T21:59:57.473 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/pmaven-common-0.8-20100325.jar 2019-11-28T21:59:57.473 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/pmaven-groovy-0.8-20100325.jar 2019-11-28T21:59:57.473 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/wagon-file-2.4.jar 2019-11-28T21:59:57.473 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-connector-wagon-1.13.1.jar 2019-11-28T21:59:57.473 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/bcpg-jdk15on-1.58.jar 2019-11-28T21:59:57.473 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/rhino-1.7R3.jar 2019-11-28T21:59:57.474 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gson-2.7.jar 2019-11-28T21:59:57.474 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/simple-4.1.21.jar 2019-11-28T21:59:57.474 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-plugin-api-3.0.4.jar 2019-11-28T21:59:57.474 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/testng-6.3.1.jar 2019-11-28T21:59:57.474 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/snakeyaml-1.6.jar 2019-11-28T21:59:57.474 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/dd-plist-1.20.jar 2019-11-28T21:59:57.474 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/junit-4.12.jar 2019-11-28T21:59:57.475 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/bsh-2.0b6.jar 2019-11-28T21:59:57.475 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/junit-platform-launcher-1.0.3.jar 2019-11-28T21:59:57.475 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jcifs-1.3.17.jar 2019-11-28T21:59:57.475 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/nekohtml-1.9.20.jar 2019-11-28T21:59:57.475 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/xercesImpl-2.11.0.jar 2019-11-28T21:59:57.475 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jsch-0.1.54.jar 2019-11-28T21:59:57.475 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jmespath-java-1.11.267.jar 2019-11-28T21:59:57.475 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jackson-databind-2.8.11.jar 2019-11-28T21:59:57.476 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jackson-core-2.8.11.jar 2019-11-28T21:59:57.476 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jackson-annotations-2.8.11.jar 2019-11-28T21:59:57.476 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/joda-time-2.8.2.jar 2019-11-28T21:59:57.476 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/bcprov-jdk15on-1.58.jar 2019-11-28T21:59:57.476 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-aether-provider-3.0.4.jar 2019-11-28T21:59:57.476 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-impl-1.13.1.jar 2019-11-28T21:59:57.476 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-spi-1.13.1.jar 2019-11-28T21:59:57.477 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-util-1.13.1.jar 2019-11-28T21:59:57.477 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-api-1.13.1.jar 2019-11-28T21:59:57.477 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/wagon-provider-api-2.4.jar 2019-11-28T21:59:57.477 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-classworlds-2.4.jar 2019-11-28T21:59:57.477 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-model-builder-3.0.4.jar 2019-11-28T21:59:57.477 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-model-3.0.4.jar 2019-11-28T21:59:57.477 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-settings-builder-3.0.4.jar 2019-11-28T21:59:57.478 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-artifact-3.0.4.jar 2019-11-28T21:59:57.478 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-settings-3.0.4.jar 2019-11-28T21:59:57.478 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-sec-dispatcher-1.3.jar 2019-11-28T21:59:57.478 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-repository-metadata-3.0.4.jar 2019-11-28T21:59:57.478 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-utils-3.0.8.jar 2019-11-28T21:59:57.478 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/ion-java-1.0.2.jar 2019-11-28T21:59:57.478 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/httpcore-4.4.9.jar 2019-11-28T21:59:57.479 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/hamcrest-core-1.3.jar 2019-11-28T21:59:57.479 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/junit-platform-engine-1.0.3.jar 2019-11-28T21:59:57.479 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/junit-platform-commons-1.0.3.jar 2019-11-28T21:59:57.479 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/apiguardian-api-1.0.0.jar 2019-11-28T21:59:57.479 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jcommander-1.47.jar 2019-11-28T21:59:57.479 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-interpolation-1.14.jar 2019-11-28T21:59:57.479 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-component-annotations-1.5.5.jar 2019-11-28T21:59:57.479 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/opentest4j-1.0.0.jar 2019-11-28T21:59:57.480 INFO:teuthology.orchestra.run.smithi074.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-cipher-1.7.jar 2019-11-28T21:59:57.480 INFO:teuthology.orchestra.run.smithi074.stdout:export PATH=/opt/gradle/gradle-4.7/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/usr/bin 2019-11-28T21:59:58.182 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:59:58.182 INFO:teuthology.orchestra.run.smithi074.stdout:Welcome to Gradle 4.7! 2019-11-28T21:59:58.182 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:59:58.182 INFO:teuthology.orchestra.run.smithi074.stdout:Here are the highlights of this release: 2019-11-28T21:59:58.182 INFO:teuthology.orchestra.run.smithi074.stdout: - Incremental annotation processing 2019-11-28T21:59:58.182 INFO:teuthology.orchestra.run.smithi074.stdout: - JDK 10 support 2019-11-28T21:59:58.183 INFO:teuthology.orchestra.run.smithi074.stdout: - Grouped non-interactive console logs 2019-11-28T21:59:58.183 INFO:teuthology.orchestra.run.smithi074.stdout: - Failed tests are re-run first for quicker feedback 2019-11-28T21:59:58.183 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:59:58.183 INFO:teuthology.orchestra.run.smithi074.stdout:For more details see https://docs.gradle.org/4.7/release-notes.html 2019-11-28T21:59:58.183 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:59:58.545 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:59:58.545 INFO:teuthology.orchestra.run.smithi074.stdout:------------------------------------------------------------ 2019-11-28T21:59:58.545 INFO:teuthology.orchestra.run.smithi074.stdout:Gradle 4.7 2019-11-28T21:59:58.545 INFO:teuthology.orchestra.run.smithi074.stdout:------------------------------------------------------------ 2019-11-28T21:59:58.545 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:59:58.546 INFO:teuthology.orchestra.run.smithi074.stdout:Build time: 2018-04-18 09:09:12 UTC 2019-11-28T21:59:58.546 INFO:teuthology.orchestra.run.smithi074.stdout:Revision: b9a962bf70638332300e7f810689cb2febbd4a6c 2019-11-28T21:59:58.547 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:59:58.547 INFO:teuthology.orchestra.run.smithi074.stdout:Groovy: 2.4.12 2019-11-28T21:59:58.547 INFO:teuthology.orchestra.run.smithi074.stdout:Ant: Apache Ant(TM) version 1.9.9 compiled on February 2 2017 2019-11-28T21:59:58.547 INFO:teuthology.orchestra.run.smithi074.stdout:JVM: 1.8.0_232 (Oracle Corporation 25.232-b09) 2019-11-28T21:59:58.547 INFO:teuthology.orchestra.run.smithi074.stdout:OS: Linux 3.10.0-1062.4.3.el7.x86_64 amd64 2019-11-28T21:59:58.547 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T21:59:58.557 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2019-11-28T21:59:58.557 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2019-11-28T21:59:58.557 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi074.front.sepia.ceph.com 2019-11-28T21:59:58.557 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2019-11-28T21:59:58.557 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi141.front.sepia.ceph.com 2019-11-28T21:59:58.557 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2019-11-28T21:59:58.967 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 's3dir': 'folder', 'endpoint': None, 'display_name': None, 'region': 'mexico', 'port': None, 'access_secret': None, 'SSE': 'AES256', 'is_secure': None, 'email': None, 'dir': '../data'}} 2019-11-28T21:59:58.967 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2019-11-28T21:59:58.968 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'OMTYFQXZGAMWETBLEPSY', 's3dir': 'folder', 'endpoint': 'smithi074.front.sepia.ceph.com:80', 'display_name': 'Ms. tester.client.0', 'user_id': 'tester.client.0', 'region': 'mexico', 'port': 80, 'access_secret': '3xRF1bH/k+X8WxMcgi6FGqLyf/8vRFv3EpW0GXeCsdcWYzVxiTLBeQ==', 'host': 'smithi074.front.sepia.ceph.com', 'SSE': 'AES256', 'is_secure': False, 'email': 'tester.client.0_test@test.test', 'dir': '../data'} 2019-11-28T21:59:58.968 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2019-11-28T21:59:58.968 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'OMTYFQXZGAMWETBLEPSY', '--secret', '3xRF1bH/k+X8WxMcgi6FGqLyf/8vRFv3EpW0GXeCsdcWYzVxiTLBeQ==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2019-11-28T21:59:58.969 INFO:teuthology.orchestra.run.smithi074:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key OMTYFQXZGAMWETBLEPSY --secret 3xRF1bH/k+X8WxMcgi6FGqLyf/8vRFv3EpW0GXeCsdcWYzVxiTLBeQ== --email tester.client.0_test@test.test --cluster ceph 2019-11-28T21:59:59.093 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.107+0000 7fc415b99ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:59.122 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.137+0000 7fc415b99ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:59:59.123 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.137+0000 7fc415b99ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:59.139 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.153+0000 7fc415b99ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:59:59.139 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.153+0000 7fc415b99ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:59.148 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.162+0000 7fc415b99ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:59:59.148 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.162+0000 7fc415b99ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:59.164 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.178+0000 7fc415b99ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T21:59:59.393 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.407+0000 7fc415b99ec0 20 RGWRados::pool_iterate: got zonegroup_info.cb1773b4-411c-4317-a760-df89ca0f54fc 2019-11-28T21:59:59.393 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.407+0000 7fc415b99ec0 20 RGWRados::pool_iterate: got zone_info.bd5ae442-b074-4d35-94cc-b1d71bd6ac02 2019-11-28T21:59:59.393 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.407+0000 7fc415b99ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-28T21:59:59.393 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.407+0000 7fc415b99ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-28T21:59:59.394 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.407+0000 7fc415b99ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:59.405 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.419+0000 7fc415b99ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T21:59:59.406 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.419+0000 7fc415b99ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:59.419 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.433+0000 7fc415b99ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T21:59:59.419 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.433+0000 7fc415b99ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:59.430 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.444+0000 7fc415b99ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T21:59:59.430 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.445+0000 7fc415b99ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:59.448 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.462+0000 7fc415b99ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T21:59:59.448 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.462+0000 7fc415b99ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:59.462 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.476+0000 7fc415b99ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:59:59.462 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.476+0000 7fc415b99ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-28T21:59:59.462 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.476+0000 7fc415b99ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:59.475 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.489+0000 7fc415b99ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:59:59.475 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.489+0000 7fc415b99ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:59.494 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.509+0000 7fc415b99ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T21:59:59.495 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.509+0000 7fc415b99ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:59.509 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.523+0000 7fc415b99ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T21:59:59.509 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.523+0000 7fc415b99ec0 20 zonegroup default 2019-11-28T21:59:59.509 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.523+0000 7fc415b99ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:59.525 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.539+0000 7fc415b99ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:59:59.525 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.539+0000 7fc415b99ec0 10 Cannot find current period zone using local zone 2019-11-28T21:59:59.525 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.539+0000 7fc415b99ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:59.535 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.549+0000 7fc415b99ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T21:59:59.535 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.550+0000 7fc415b99ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:59.554 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.569+0000 7fc415b99ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T21:59:59.555 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.569+0000 7fc415b99ec0 20 rados->read ofs=0 len=0 2019-11-28T21:59:59.572 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.586+0000 7fc415b99ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T21:59:59.573 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.587+0000 7fc415b99ec0 20 zone default found 2019-11-28T21:59:59.573 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.587+0000 7fc415b99ec0 20 started sync module instance, tier type = 2019-11-28T21:59:59.573 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.587+0000 7fc415b99ec0 20 started zone id=bd5ae442-b074-4d35-94cc-b1d71bd6ac02 (name=default) with tier type = 2019-11-28T21:59:59.953 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.968+0000 7fc415b99ec0 20 add_watcher() i=0 2019-11-28T21:59:59.954 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.968+0000 7fc415b99ec0 20 add_watcher() i=1 2019-11-28T21:59:59.954 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.968+0000 7fc415b99ec0 20 add_watcher() i=2 2019-11-28T21:59:59.954 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.968+0000 7fc415b99ec0 20 add_watcher() i=3 2019-11-28T21:59:59.954 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.968+0000 7fc415b99ec0 20 add_watcher() i=4 2019-11-28T21:59:59.954 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.968+0000 7fc415b99ec0 20 add_watcher() i=5 2019-11-28T21:59:59.954 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T21:59:59.968+0000 7fc415b99ec0 20 add_watcher() i=6 2019-11-28T21:59:59.994 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:00.008+0000 7fc415b99ec0 20 add_watcher() i=7 2019-11-28T21:59:59.994 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:00.008+0000 7fc415b99ec0 2 all 8 watchers are set, enabling cache 2019-11-28T21:59:59.995 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:00.009+0000 7fc3d37de700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-28T22:00:00.005 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:00.019+0000 7fc4025c5700 0 -- 172.21.15.74:0/1961690569 >> [v2:172.21.15.74:3301/0,v1:172.21.15.74:6790/0] conn(0x55fc6b980c30 msgr2=0x55fc6b983120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-28T22:00:00.048 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:00.062+0000 7fc402dc6700 0 -- 172.21.15.74:0/267457313 >> [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] conn(0x55fc6b991da0 msgr2=0x55fc6b9941c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-28T22:00:01.870 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:01.882+0000 7fc341ffb700 20 reqs_thread_entry: start 2019-11-28T22:00:01.870 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:01.883+0000 7fc33b7fe700 20 reqs_thread_entry: start 2019-11-28T22:00:01.870 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:01.883+0000 7fc415b99ec0 20 init_complete bucket index max shards: 0 2019-11-28T22:00:01.870 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:01.883+0000 7fc339ffb700 20 reqs_thread_entry: start 2019-11-28T22:00:01.870 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:01.883+0000 7fc415b99ec0 20 get_system_obj_state: rctx=0x7fffa5362358 obj=default.rgw.meta:users.uid:tester.client.0 state=0x55fc6b9fb590 s->prefetch_data=0 2019-11-28T22:00:01.871 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:01.883+0000 7fc415b99ec0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2019-11-28T22:00:01.883 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:01.897+0000 7fc415b99ec0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2019-11-28T22:00:01.883 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:01.897+0000 7fc415b99ec0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2019-11-28T22:00:01.883 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:01.897+0000 7fc415b99ec0 20 get_system_obj_state: rctx=0x7fffa5362368 obj=default.rgw.meta:users.email:tester.client.0_test@test.test state=0x55fc6b9fd320 s->prefetch_data=0 2019-11-28T22:00:01.883 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:01.897+0000 7fc415b99ec0 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2019-11-28T22:00:01.894 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:01.908+0000 7fc415b99ec0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2019-11-28T22:00:01.894 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:01.908+0000 7fc415b99ec0 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2019-11-28T22:00:01.894 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:01.908+0000 7fc415b99ec0 20 get_system_obj_state: rctx=0x7fffa5362368 obj=default.rgw.meta:users.keys:OMTYFQXZGAMWETBLEPSY state=0x55fc6b9fd320 s->prefetch_data=0 2019-11-28T22:00:01.894 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:01.908+0000 7fc415b99ec0 10 cache get: name=default.rgw.meta+users.keys+OMTYFQXZGAMWETBLEPSY : miss 2019-11-28T22:00:01.903 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:01.917+0000 7fc415b99ec0 10 cache put: name=default.rgw.meta+users.keys+OMTYFQXZGAMWETBLEPSY info.flags=0x0 2019-11-28T22:00:01.903 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:01.917+0000 7fc415b99ec0 10 adding default.rgw.meta+users.keys+OMTYFQXZGAMWETBLEPSY to cache LRU end 2019-11-28T22:00:01.903 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:01.917+0000 7fc415b99ec0 20 get_system_obj_state: rctx=0x7fffa5361f78 obj=default.rgw.meta:users.keys:OMTYFQXZGAMWETBLEPSY state=0x55fc6b9fd320 s->prefetch_data=0 2019-11-28T22:00:01.903 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:01.917+0000 7fc415b99ec0 10 cache get: name=default.rgw.meta+users.keys+OMTYFQXZGAMWETBLEPSY : type miss (requested=0x6, cached=0x0) 2019-11-28T22:00:01.913 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:01.927+0000 7fc415b99ec0 10 cache put: name=default.rgw.meta+users.keys+OMTYFQXZGAMWETBLEPSY info.flags=0x0 2019-11-28T22:00:01.913 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:01.927+0000 7fc415b99ec0 10 moving default.rgw.meta+users.keys+OMTYFQXZGAMWETBLEPSY to cache LRU end 2019-11-28T22:00:01.913 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:01.927+0000 7fc415b99ec0 20 get_system_obj_state: rctx=0x7fffa53620f8 obj=default.rgw.meta:users.keys:OMTYFQXZGAMWETBLEPSY state=0x55fc6b9fd320 s->prefetch_data=0 2019-11-28T22:00:01.913 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:01.927+0000 7fc415b99ec0 10 cache get: name=default.rgw.meta+users.keys+OMTYFQXZGAMWETBLEPSY : type miss (requested=0x6, cached=0x0) 2019-11-28T22:00:01.920 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:01.934+0000 7fc415b99ec0 10 cache put: name=default.rgw.meta+users.keys+OMTYFQXZGAMWETBLEPSY info.flags=0x0 2019-11-28T22:00:01.920 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:01.934+0000 7fc415b99ec0 10 moving default.rgw.meta+users.keys+OMTYFQXZGAMWETBLEPSY to cache LRU end 2019-11-28T22:00:01.970 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:01.984+0000 7fc415b99ec0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2019-11-28T22:00:01.970 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:01.984+0000 7fc415b99ec0 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2019-11-28T22:00:01.970 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:01.984+0000 7fc415b99ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=632 2019-11-28T22:00:01.979 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:01.993+0000 7fc3e3fff700 10 RGWWatcher::handle_notify() notify_id 579820584962 cookie 94542625165312 notifier 4460 bl.length()=632 2019-11-28T22:00:01.979 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:01.993+0000 7fc3e3fff700 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2019-11-28T22:00:01.979 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:01.993+0000 7fc3e3fff700 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2019-11-28T22:00:02.529 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:02.543+0000 7fc415b99ec0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2019-11-28T22:00:02.529 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:02.543+0000 7fc415b99ec0 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2019-11-28T22:00:02.529 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:02.543+0000 7fc415b99ec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=200 2019-11-28T22:00:02.542 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:02.556+0000 7fc3e3fff700 10 RGWWatcher::handle_notify() notify_id 579820584964 cookie 94542625154832 notifier 4460 bl.length()=200 2019-11-28T22:00:02.542 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:02.556+0000 7fc3e3fff700 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2019-11-28T22:00:02.542 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:02.556+0000 7fc3e3fff700 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2019-11-28T22:00:02.866 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:02.880+0000 7fc415b99ec0 10 cache put: name=default.rgw.meta+users.keys+OMTYFQXZGAMWETBLEPSY info.flags=0x7 2019-11-28T22:00:02.866 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:02.880+0000 7fc415b99ec0 10 moving default.rgw.meta+users.keys+OMTYFQXZGAMWETBLEPSY to cache LRU end 2019-11-28T22:00:02.866 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:02.880+0000 7fc415b99ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=189 2019-11-28T22:00:02.879 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:02.894+0000 7fc3e3fff700 10 RGWWatcher::handle_notify() notify_id 579820584973 cookie 94542625161024 notifier 4460 bl.length()=189 2019-11-28T22:00:02.879 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:02.894+0000 7fc3e3fff700 10 cache put: name=default.rgw.meta+users.keys+OMTYFQXZGAMWETBLEPSY info.flags=0x7 2019-11-28T22:00:02.880 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:02.894+0000 7fc3e3fff700 10 moving default.rgw.meta+users.keys+OMTYFQXZGAMWETBLEPSY to cache LRU end 2019-11-28T22:00:03.213 INFO:teuthology.orchestra.run.smithi074.stdout:{ 2019-11-28T22:00:03.213 INFO:teuthology.orchestra.run.smithi074.stdout: "user_id": "tester.client.0", 2019-11-28T22:00:03.213 INFO:teuthology.orchestra.run.smithi074.stdout: "display_name": "Ms. tester.client.0", 2019-11-28T22:00:03.213 INFO:teuthology.orchestra.run.smithi074.stdout: "email": "tester.client.0_test@test.test", 2019-11-28T22:00:03.213 INFO:teuthology.orchestra.run.smithi074.stdout: "suspended": 0, 2019-11-28T22:00:03.214 INFO:teuthology.orchestra.run.smithi074.stdout: "max_buckets": 1000, 2019-11-28T22:00:03.214 INFO:teuthology.orchestra.run.smithi074.stdout: "subusers": [], 2019-11-28T22:00:03.214 INFO:teuthology.orchestra.run.smithi074.stdout: "keys": [ 2019-11-28T22:00:03.214 INFO:teuthology.orchestra.run.smithi074.stdout: { 2019-11-28T22:00:03.214 INFO:teuthology.orchestra.run.smithi074.stdout: "user": "tester.client.0", 2019-11-28T22:00:03.214 INFO:teuthology.orchestra.run.smithi074.stdout: "access_key": "OMTYFQXZGAMWETBLEPSY", 2019-11-28T22:00:03.214 INFO:teuthology.orchestra.run.smithi074.stdout: "secret_key": "3xRF1bH/k+X8WxMcgi6FGqLyf/8vRFv3EpW0GXeCsdcWYzVxiTLBeQ==" 2019-11-28T22:00:03.215 INFO:teuthology.orchestra.run.smithi074.stdout: } 2019-11-28T22:00:03.215 INFO:teuthology.orchestra.run.smithi074.stdout: ], 2019-11-28T22:00:03.215 INFO:teuthology.orchestra.run.smithi074.stdout: "swift_keys": [], 2019-11-28T22:00:03.215 INFO:teuthology.orchestra.run.smithi074.stdout: "caps": [], 2019-11-28T22:00:03.215 INFO:teuthology.orchestra.run.smithi074.stdout: "op_mask": "read, write, delete", 2019-11-28T22:00:03.215 INFO:teuthology.orchestra.run.smithi074.stdout: "default_placement": "", 2019-11-28T22:00:03.215 INFO:teuthology.orchestra.run.smithi074.stdout: "default_storage_class": "", 2019-11-28T22:00:03.216 INFO:teuthology.orchestra.run.smithi074.stdout: "placement_tags": [], 2019-11-28T22:00:03.216 INFO:teuthology.orchestra.run.smithi074.stdout: "bucket_quota": { 2019-11-28T22:00:03.216 INFO:teuthology.orchestra.run.smithi074.stdout: "enabled": false, 2019-11-28T22:00:03.216 INFO:teuthology.orchestra.run.smithi074.stdout: "check_on_raw": false, 2019-11-28T22:00:03.216 INFO:teuthology.orchestra.run.smithi074.stdout: "max_size": -1, 2019-11-28T22:00:03.216 INFO:teuthology.orchestra.run.smithi074.stdout: "max_size_kb": 0, 2019-11-28T22:00:03.216 INFO:teuthology.orchestra.run.smithi074.stdout: "max_objects": -1 2019-11-28T22:00:03.217 INFO:teuthology.orchestra.run.smithi074.stdout: }, 2019-11-28T22:00:03.217 INFO:teuthology.orchestra.run.smithi074.stdout: "user_quota": { 2019-11-28T22:00:03.217 INFO:teuthology.orchestra.run.smithi074.stdout: "enabled": false, 2019-11-28T22:00:03.217 INFO:teuthology.orchestra.run.smithi074.stdout: "check_on_raw": false, 2019-11-28T22:00:03.217 INFO:teuthology.orchestra.run.smithi074.stdout: "max_size": -1, 2019-11-28T22:00:03.217 INFO:teuthology.orchestra.run.smithi074.stdout: "max_size_kb": 0, 2019-11-28T22:00:03.217 INFO:teuthology.orchestra.run.smithi074.stdout: "max_objects": -1 2019-11-28T22:00:03.218 INFO:teuthology.orchestra.run.smithi074.stdout: }, 2019-11-28T22:00:03.218 INFO:teuthology.orchestra.run.smithi074.stdout: "temp_url_keys": [], 2019-11-28T22:00:03.218 INFO:teuthology.orchestra.run.smithi074.stdout: "type": "rgw", 2019-11-28T22:00:03.218 INFO:teuthology.orchestra.run.smithi074.stdout: "mfa_ids": [] 2019-11-28T22:00:03.218 INFO:teuthology.orchestra.run.smithi074.stdout:} 2019-11-28T22:00:03.218 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:00:03.251 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:03.266+0000 7fc415b99ec0 20 remove_watcher() i=0 2019-11-28T22:00:03.252 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:03.266+0000 7fc415b99ec0 2 removed watcher, disabling cache 2019-11-28T22:00:03.293 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:03.307+0000 7fc415b99ec0 20 remove_watcher() i=1 2019-11-28T22:00:03.330 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:03.345+0000 7fc415b99ec0 20 remove_watcher() i=2 2019-11-28T22:00:03.370 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:03.384+0000 7fc415b99ec0 20 remove_watcher() i=3 2019-11-28T22:00:03.411 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:03.426+0000 7fc415b99ec0 20 remove_watcher() i=4 2019-11-28T22:00:03.451 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:03.464+0000 7fc415b99ec0 20 remove_watcher() i=5 2019-11-28T22:00:03.506 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:03.520+0000 7fc415b99ec0 20 remove_watcher() i=6 2019-11-28T22:00:03.541 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:03.555+0000 7fc415b99ec0 20 remove_watcher() i=7 2019-11-28T22:00:03.550 INFO:teuthology.orchestra.run.smithi074:> cat > /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2019-11-28T22:00:03.618 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2019-11-28T22:00:03.619 INFO:teuthology.orchestra.run.smithi074:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2019-11-28T22:00:03.745 INFO:teuthology.orchestra.run.smithi074:> radosgw-admin gc process --include-all 2019-11-28T22:00:03.868 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:03.882+0000 7fdf06ca1ec0 20 rados->read ofs=0 len=0 2019-11-28T22:00:03.906 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:03.920+0000 7fdf06ca1ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:00:03.906 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:03.920+0000 7fdf06ca1ec0 20 rados->read ofs=0 len=0 2019-11-28T22:00:03.919 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:03.933+0000 7fdf06ca1ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:00:03.919 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:03.933+0000 7fdf06ca1ec0 20 rados->read ofs=0 len=0 2019-11-28T22:00:03.930 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:03.944+0000 7fdf06ca1ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:00:03.930 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:03.944+0000 7fdf06ca1ec0 20 rados->read ofs=0 len=0 2019-11-28T22:00:03.955 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:03.970+0000 7fdf06ca1ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:00:04.192 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.206+0000 7fdf06ca1ec0 20 RGWRados::pool_iterate: got zonegroup_info.cb1773b4-411c-4317-a760-df89ca0f54fc 2019-11-28T22:00:04.192 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.206+0000 7fdf06ca1ec0 20 RGWRados::pool_iterate: got zone_info.bd5ae442-b074-4d35-94cc-b1d71bd6ac02 2019-11-28T22:00:04.193 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.206+0000 7fdf06ca1ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-28T22:00:04.193 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.206+0000 7fdf06ca1ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-28T22:00:04.193 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.206+0000 7fdf06ca1ec0 20 rados->read ofs=0 len=0 2019-11-28T22:00:04.207 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.222+0000 7fdf06ca1ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:00:04.208 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.222+0000 7fdf06ca1ec0 20 rados->read ofs=0 len=0 2019-11-28T22:00:04.235 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.242+0000 7fdf06ca1ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T22:00:04.235 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.242+0000 7fdf06ca1ec0 20 rados->read ofs=0 len=0 2019-11-28T22:00:04.237 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.252+0000 7fdf06ca1ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:00:04.237 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.252+0000 7fdf06ca1ec0 20 rados->read ofs=0 len=0 2019-11-28T22:00:04.255 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.269+0000 7fdf06ca1ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T22:00:04.255 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.269+0000 7fdf06ca1ec0 20 rados->read ofs=0 len=0 2019-11-28T22:00:04.266 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.281+0000 7fdf06ca1ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:00:04.267 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.281+0000 7fdf06ca1ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-28T22:00:04.267 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.281+0000 7fdf06ca1ec0 20 rados->read ofs=0 len=0 2019-11-28T22:00:04.277 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.292+0000 7fdf06ca1ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:00:04.278 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.292+0000 7fdf06ca1ec0 20 rados->read ofs=0 len=0 2019-11-28T22:00:04.289 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.303+0000 7fdf06ca1ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:00:04.289 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.303+0000 7fdf06ca1ec0 20 rados->read ofs=0 len=0 2019-11-28T22:00:04.302 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.316+0000 7fdf06ca1ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T22:00:04.302 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.316+0000 7fdf06ca1ec0 20 zonegroup default 2019-11-28T22:00:04.303 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.316+0000 7fdf06ca1ec0 20 rados->read ofs=0 len=0 2019-11-28T22:00:04.312 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.326+0000 7fdf06ca1ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:00:04.312 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.326+0000 7fdf06ca1ec0 10 Cannot find current period zone using local zone 2019-11-28T22:00:04.312 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.326+0000 7fdf06ca1ec0 20 rados->read ofs=0 len=0 2019-11-28T22:00:04.320 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.335+0000 7fdf06ca1ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:00:04.320 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.335+0000 7fdf06ca1ec0 20 rados->read ofs=0 len=0 2019-11-28T22:00:04.333 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.347+0000 7fdf06ca1ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:00:04.333 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.347+0000 7fdf06ca1ec0 20 rados->read ofs=0 len=0 2019-11-28T22:00:04.342 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.356+0000 7fdf06ca1ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T22:00:04.342 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.356+0000 7fdf06ca1ec0 20 zone default found 2019-11-28T22:00:04.342 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.356+0000 7fdf06ca1ec0 20 started sync module instance, tier type = 2019-11-28T22:00:04.342 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.356+0000 7fdf06ca1ec0 20 started zone id=bd5ae442-b074-4d35-94cc-b1d71bd6ac02 (name=default) with tier type = 2019-11-28T22:00:04.777 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.790+0000 7fdf06ca1ec0 20 add_watcher() i=0 2019-11-28T22:00:04.777 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.790+0000 7fdf06ca1ec0 20 add_watcher() i=1 2019-11-28T22:00:04.777 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.790+0000 7fdf06ca1ec0 20 add_watcher() i=2 2019-11-28T22:00:04.777 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.790+0000 7fdf06ca1ec0 20 add_watcher() i=3 2019-11-28T22:00:04.777 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.790+0000 7fdf06ca1ec0 20 add_watcher() i=4 2019-11-28T22:00:04.778 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.790+0000 7fdf06ca1ec0 20 add_watcher() i=5 2019-11-28T22:00:04.778 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.790+0000 7fdf06ca1ec0 20 add_watcher() i=6 2019-11-28T22:00:04.816 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.830+0000 7fdf06ca1ec0 20 add_watcher() i=7 2019-11-28T22:00:04.816 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.830+0000 7fdf06ca1ec0 2 all 8 watchers are set, enabling cache 2019-11-28T22:00:04.816 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.830+0000 7fde47fff700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-28T22:00:04.835 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.847+0000 7fdef36cd700 0 -- >> v1:172.21.15.74:6789/0 conn(0x55739dbdd410 legacy=0x55739dbc42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-28T22:00:04.922 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:04.936+0000 7fdef46cf700 0 -- 172.21.15.74:0/3214966239 >> [v2:172.21.15.141:6818/9904,v1:172.21.15.141:6820/9904] conn(0x55739dbedce0 msgr2=0x55739dbf0100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-28T22:00:06.532 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:06.544+0000 7fde327fc700 20 reqs_thread_entry: start 2019-11-28T22:00:06.532 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:06.544+0000 7fde2bfff700 20 reqs_thread_entry: start 2019-11-28T22:00:06.532 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:06.545+0000 7fdf06ca1ec0 20 init_complete bucket index max shards: 0 2019-11-28T22:00:06.533 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:06.545+0000 7fde2a7fc700 20 reqs_thread_entry: start 2019-11-28T22:00:06.533 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:06.545+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-28T22:00:06.576 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:06.591+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:06.592 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:06.607+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:06.601 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:06.616+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:06.643 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:06.657+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-28T22:00:06.720 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:06.734+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:06.736 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:06.751+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:06.767 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:06.781+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-28T22:00:06.767 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:06.781+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process iterating over entry tag='_mSI5bECG4F72uTKoG4jyZgunwUfYfQ9', time=2019-11-28T23:59:36.351172+0000, chain.objs.size()=2 2019-11-28T22:00:06.767 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:06.781+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9__shadow_.0kz4zLRM1eSRiYzVPKN14YGqaw_ZRyu_1 2019-11-28T22:00:06.767 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:06.781+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9__shadow_.0kz4zLRM1eSRiYzVPKN14YGqaw_ZRyu_2 2019-11-28T22:00:06.901 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:06.915+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:00:07.071 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:07.085+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-28T22:00:07.123 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:07.137+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:07.140 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:07.154+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:07.149 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:07.164+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:07.186 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:07.200+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-28T22:00:07.250 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:07.264+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:07.278 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:07.286+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:07.284 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:07.295+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:07.314 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:07.329+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-28T22:00:07.377 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:07.391+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:07.395 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:07.409+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:07.430 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:07.443+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-28T22:00:07.430 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:07.443+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.20', time=2019-11-28T23:59:26.759076+0000, chain.objs.size()=4 2019-11-28T22:00:07.430 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:07.443+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.2__multipart_foo.2~cESquwmPGpVWN7qCRRwJLal-VBAWR3H.1 2019-11-28T22:00:07.430 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:07.443+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.2__multipart_foo.2~cESquwmPGpVWN7qCRRwJLal-VBAWR3H.2 2019-11-28T22:00:07.430 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:07.443+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.2__multipart_foo.2~cESquwmPGpVWN7qCRRwJLal-VBAWR3H.3 2019-11-28T22:00:07.430 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:07.443+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.2__multipart_foo.2~cESquwmPGpVWN7qCRRwJLal-VBAWR3H.4 2019-11-28T22:00:07.430 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:07.443+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.108', time=2019-11-28T23:59:32.434017+0000, chain.objs.size()=2 2019-11-28T22:00:07.431 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:07.443+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.7__shadow_.udtSWTokDyo7_iT7lYvscQ8TVwZyQS-_0 2019-11-28T22:00:07.431 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:07.444+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.7__shadow_.udtSWTokDyo7_iT7lYvscQ8TVwZyQS-_1 2019-11-28T22:00:07.574 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:07.588+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:00:07.682 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:07.696+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-28T22:00:07.804 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:07.818+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:07.835 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:07.849+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:07.869 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:07.884+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-28T22:00:07.870 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:07.884+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process iterating over entry tag='_NQHrbkXtrZC5mQP_UIfCJXTh-hjsKho', time=2019-11-28T23:59:34.593951+0000, chain.objs.size()=1 2019-11-28T22:00:07.870 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:07.884+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.7__shadow_._-Z0YZMQPheOKfTBmDoK8t5AOGHG6Hu_0 2019-11-28T22:00:07.950 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:07.964+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:00:08.082 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:08.096+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-28T22:00:08.159 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:08.173+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:08.191 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:08.206+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:08.212 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:08.227+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-28T22:00:08.213 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:08.227+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process iterating over entry tag='_yrnaNfVBAs60y7CHO7x31b1HHge4f3N', time=2019-11-28T23:59:33.884587+0000, chain.objs.size()=1 2019-11-28T22:00:08.213 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:08.227+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.7__shadow_.MNOTd7gm0ewtonDf5pPWWW1XRGR8nP2_1 2019-11-28T22:00:08.213 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:08.227+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process iterating over entry tag='_QZicgdBI3bBFDcZlsysrGgYUuLEamB8', time=2019-11-28T23:59:37.670623+0000, chain.objs.size()=1 2019-11-28T22:00:08.213 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:08.227+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9__shadow_.AJCHLcbNx-TWxLyhWDLUAcdGlvppYD7_0 2019-11-28T22:00:08.337 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:08.351+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:00:08.485 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:08.499+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-28T22:00:08.542 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:08.557+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:08.578 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:08.581+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:08.615 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:08.629+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-28T22:00:08.615 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:08.629+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process iterating over entry tag='_0cJGMy8xh1j_HmTT_CWNO_ryHSg-lP4', time=2019-11-28T23:59:37.503001+0000, chain.objs.size()=1 2019-11-28T22:00:08.615 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:08.629+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9__shadow_.iG52HhgmtcrFTaP8n0jqX0wlw62PMpK_0 2019-11-28T22:00:08.670 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:08.684+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:00:08.804 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:08.819+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-28T22:00:08.875 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:08.889+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:08.917 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:08.931+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:08.930 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:08.944+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-28T22:00:08.930 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:08.944+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process iterating over entry tag='_SVQYoSH2-U0choYlwvay4vk3biJbCq9', time=2019-11-28T23:59:36.702547+0000, chain.objs.size()=3 2019-11-28T22:00:08.930 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:08.944+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9__shadow_.vZLGGoPwolm8GH_lu-WfoPmKaWLdD6L_0 2019-11-28T22:00:08.930 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:08.944+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9__shadow_.vZLGGoPwolm8GH_lu-WfoPmKaWLdD6L_1 2019-11-28T22:00:08.930 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:08.944+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9__shadow_.vZLGGoPwolm8GH_lu-WfoPmKaWLdD6L_2 2019-11-28T22:00:09.100 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:09.114+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:00:09.224 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:09.239+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-28T22:00:09.281 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:09.296+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:09.301 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:09.315+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:09.311 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:09.325+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:09.337 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:09.352+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-28T22:00:09.439 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:09.454+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:09.467 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:09.482+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:09.491 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:09.505+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-28T22:00:09.492 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:09.505+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.114', time=2019-11-28T23:59:33.621058+0000, chain.objs.size()=2 2019-11-28T22:00:09.492 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:09.505+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.7__shadow_.YJEHsiUO4xTsX6pInw_0bdH6RxqM-0F_0 2019-11-28T22:00:09.492 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:09.505+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.7__shadow_.YJEHsiUO4xTsX6pInw_0bdH6RxqM-0F_1 2019-11-28T22:00:09.492 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:09.505+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.224', time=2019-11-28T23:59:35.749277+0000, chain.objs.size()=5 2019-11-28T22:00:09.492 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:09.505+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9__multipart_foo-FROZEN.2~tYSfORmeQYTpmfzvGAuRyW9Vvguixwf.1 2019-11-28T22:00:09.492 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:09.505+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9__shadow_foo-FROZEN.2~tYSfORmeQYTpmfzvGAuRyW9Vvguixwf.1_1 2019-11-28T22:00:09.493 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:09.505+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9__multipart_foo-FROZEN.2~tYSfORmeQYTpmfzvGAuRyW9Vvguixwf.2 2019-11-28T22:00:09.493 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:09.505+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9__shadow_foo-FROZEN.2~tYSfORmeQYTpmfzvGAuRyW9Vvguixwf.2_1 2019-11-28T22:00:09.493 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:09.505+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9__multipart_foo-FROZEN.2~tYSfORmeQYTpmfzvGAuRyW9Vvguixwf.3 2019-11-28T22:00:09.609 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:09.624+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:00:09.748 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:09.762+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-28T22:00:09.821 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:09.835+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:09.859 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:09.872+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:09.904 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:09.918+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-28T22:00:09.904 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:09.918+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.40', time=2019-11-28T23:59:28.450551+0000, chain.objs.size()=4 2019-11-28T22:00:09.904 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:09.918+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.3__multipart_foo.2~WWwVCcA94N4eyfC2chEUIFSTSyK0KKy.1 2019-11-28T22:00:09.904 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:09.918+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.3__multipart_foo.2~WWwVCcA94N4eyfC2chEUIFSTSyK0KKy.2 2019-11-28T22:00:09.905 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:09.918+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.3__multipart_foo.2~WWwVCcA94N4eyfC2chEUIFSTSyK0KKy.3 2019-11-28T22:00:09.905 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:09.918+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.3__multipart_foo.2~WWwVCcA94N4eyfC2chEUIFSTSyK0KKy.4 2019-11-28T22:00:09.905 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:09.918+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process iterating over entry tag='_zxRKISFc_tl2St0MRpkZtGgpm_hIm6I', time=2019-11-28T23:59:33.026656+0000, chain.objs.size()=1 2019-11-28T22:00:09.905 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:09.918+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.7__shadow_.N4uwTzow6Zmj3kdlg3t_TN_BMy2yhO3_1 2019-11-28T22:00:10.066 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:10.080+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:00:10.184 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:10.198+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-28T22:00:10.243 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:10.256+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:10.258 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:10.272+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:10.267 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:10.281+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:10.311 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:10.320+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-28T22:00:10.373 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:10.388+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:10.389 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:10.404+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:10.420 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:10.434+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-28T22:00:10.421 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:10.434+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process iterating over entry tag='_IEATfTzS-h3E8dK63Zq8tUreTSzNGgk', time=2019-11-28T23:59:36.156824+0000, chain.objs.size()=3 2019-11-28T22:00:10.421 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:10.434+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9__shadow_.OcYGM8DFm09Ghlw36mBL22qZQwoG7Wd_0 2019-11-28T22:00:10.421 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:10.434+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9__shadow_.OcYGM8DFm09Ghlw36mBL22qZQwoG7Wd_1 2019-11-28T22:00:10.421 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:10.434+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9__shadow_.OcYGM8DFm09Ghlw36mBL22qZQwoG7Wd_2 2019-11-28T22:00:10.422 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:10.434+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process iterating over entry tag='_ReRNX686st47kmYceMnoZ6AkPpWPINo', time=2019-11-28T23:59:37.095852+0000, chain.objs.size()=2 2019-11-28T22:00:10.422 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:10.434+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9__shadow_.CELnQvz-B68xMTta0UVDwdU3_3uw52V_1 2019-11-28T22:00:10.422 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:10.434+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9__shadow_.CELnQvz-B68xMTta0UVDwdU3_3uw52V_2 2019-11-28T22:00:10.592 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:10.607+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:00:10.699 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:10.713+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-28T22:00:10.746 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:10.761+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:10.761 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:10.776+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:10.776 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:10.790+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-28T22:00:10.776 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:10.790+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process iterating over entry tag='_0Fs3jJY9vi0z3omNxbzogEaTAGp59oa', time=2019-11-28T23:59:34.399133+0000, chain.objs.size()=1 2019-11-28T22:00:10.777 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:10.790+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.7__shadow_.D_FYUb5RF55Dh4aReQbVUMxJ_hk54SS_0 2019-11-28T22:00:10.777 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:10.790+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.210', time=2019-11-28T23:59:39.156724+0000, chain.objs.size()=5 2019-11-28T22:00:10.777 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:10.790+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.8__multipart_foo-STANDARD.2~qQmit8DFY333_S4oI0VyENYV8-8_VFn.1 2019-11-28T22:00:10.777 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:10.790+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.8__shadow_foo-STANDARD.2~qQmit8DFY333_S4oI0VyENYV8-8_VFn.1_1 2019-11-28T22:00:10.777 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:10.790+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.8__multipart_foo-STANDARD.2~qQmit8DFY333_S4oI0VyENYV8-8_VFn.2 2019-11-28T22:00:10.778 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:10.790+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.8__shadow_foo-STANDARD.2~qQmit8DFY333_S4oI0VyENYV8-8_VFn.2_1 2019-11-28T22:00:10.778 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:10.790+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.8__multipart_foo-STANDARD.2~qQmit8DFY333_S4oI0VyENYV8-8_VFn.3 2019-11-28T22:00:10.994 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:11.008+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:00:11.086 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:11.100+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-28T22:00:11.134 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:11.148+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:11.149 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:11.164+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:11.166 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:11.180+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2019-11-28T22:00:11.166 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:11.180+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process iterating over entry tag='_Sq95DGM3Xh-BnsDYGemWdwUn7q3rkMD', time=2019-11-28T23:59:32.814758+0000, chain.objs.size()=2 2019-11-28T22:00:11.167 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:11.180+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.7__shadow_.NIuWnkINsPjFq0-5bb1OBsSKb9_17es_0 2019-11-28T22:00:11.167 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:11.180+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.7__shadow_.NIuWnkINsPjFq0-5bb1OBsSKb9_17es_1 2019-11-28T22:00:11.167 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:11.180+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.112', time=2019-11-28T23:59:33.219735+0000, chain.objs.size()=2 2019-11-28T22:00:11.167 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:11.180+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.7__shadow_.YJEHsiUO4xTsX6pInw_0bdH6RxqM-0F_0 2019-11-28T22:00:11.167 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:11.180+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.7__shadow_.YJEHsiUO4xTsX6pInw_0bdH6RxqM-0F_1 2019-11-28T22:00:11.167 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:11.180+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.84', time=2019-11-28T23:59:40.702682+0000, chain.objs.size()=3 2019-11-28T22:00:11.167 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:11.180+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.6__shadow_.unEHtX2FFaie1vXcl321se83AZPbN5b_0 2019-11-28T22:00:11.168 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:11.180+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.6__shadow_.unEHtX2FFaie1vXcl321se83AZPbN5b_1 2019-11-28T22:00:11.168 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:11.180+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.6__shadow_.unEHtX2FFaie1vXcl321se83AZPbN5b_2 2019-11-28T22:00:11.378 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:11.393+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:00:11.468 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:11.483+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-28T22:00:11.549 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:11.563+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:11.594 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:11.608+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:11.608 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:11.623+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:11.669 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:11.684+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-28T22:00:11.756 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:11.769+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:11.780 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:11.795+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:11.793 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:11.807+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-28T22:00:11.793 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:11.807+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.242', time=2019-11-28T23:59:37.292313+0000, chain.objs.size()=3 2019-11-28T22:00:11.793 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:11.807+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9__multipart_foo-STANDARD.2~KDo9Txa-ekI1e_8Y3N0Dk2W77l5lpKY.1 2019-11-28T22:00:11.794 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:11.807+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9__multipart_foo-STANDARD.2~KDo9Txa-ekI1e_8Y3N0Dk2W77l5lpKY.2 2019-11-28T22:00:11.794 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:11.807+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9__multipart_foo-STANDARD.2~KDo9Txa-ekI1e_8Y3N0Dk2W77l5lpKY.3 2019-11-28T22:00:11.909 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:11.923+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:00:12.012 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:12.024+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-28T22:00:12.054 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:12.069+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:12.070 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:12.084+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:12.078 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:12.093+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:12.115 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:12.130+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-28T22:00:12.151 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:12.166+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:12.168 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:12.181+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:12.176 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:12.191+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:12.207 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:12.221+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-28T22:00:12.262 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:12.277+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:12.281 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:12.296+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:12.293 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:12.308+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-28T22:00:12.294 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:12.308+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.109', time=2019-11-28T23:59:32.637739+0000, chain.objs.size()=2 2019-11-28T22:00:12.294 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:12.308+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.7__shadow_.udtSWTokDyo7_iT7lYvscQ8TVwZyQS-_0 2019-11-28T22:00:12.294 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:12.308+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.7__shadow_.udtSWTokDyo7_iT7lYvscQ8TVwZyQS-_1 2019-11-28T22:00:12.420 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:12.435+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:00:12.533 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:12.547+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-28T22:00:12.608 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:12.623+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:12.638 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:12.652+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:12.656 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:12.670+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:12.699 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:12.713+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-28T22:00:12.755 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:12.770+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:12.778 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:12.792+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:12.786 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:12.801+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:12.827 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:12.842+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-28T22:00:12.882 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:12.896+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:12.898 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:12.913+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:12.922 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:12.936+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-28T22:00:12.922 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:12.936+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.55', time=2019-11-28T23:59:30.008401+0000, chain.objs.size()=4 2019-11-28T22:00:12.923 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:12.936+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.4__multipart_foo.2~O_biPP8-AfvopJQh_TtPkQSg1XT3Oy-.1 2019-11-28T22:00:12.923 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:12.936+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.4__multipart_foo.2~O_biPP8-AfvopJQh_TtPkQSg1XT3Oy-.2 2019-11-28T22:00:12.923 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:12.936+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.4__multipart_foo.2~O_biPP8-AfvopJQh_TtPkQSg1XT3Oy-.3 2019-11-28T22:00:12.923 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:12.936+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.4__multipart_foo.2~O_biPP8-AfvopJQh_TtPkQSg1XT3Oy-.4 2019-11-28T22:00:13.039 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:13.054+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:00:13.155 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:13.170+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-28T22:00:13.203 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:13.217+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:13.219 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:13.234+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:13.231 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:13.245+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-28T22:00:13.231 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:13.245+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.203', time=2019-11-28T23:59:38.990407+0000, chain.objs.size()=5 2019-11-28T22:00:13.231 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:13.245+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.8__multipart_foo-LUKEWARM.2~7vEkaM3Bg2C9eY1FXQmwp7dGLFLtjJi.1 2019-11-28T22:00:13.231 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:13.245+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.8__shadow_foo-LUKEWARM.2~7vEkaM3Bg2C9eY1FXQmwp7dGLFLtjJi.1_1 2019-11-28T22:00:13.231 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:13.245+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.8__multipart_foo-LUKEWARM.2~7vEkaM3Bg2C9eY1FXQmwp7dGLFLtjJi.2 2019-11-28T22:00:13.231 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:13.245+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.8__shadow_foo-LUKEWARM.2~7vEkaM3Bg2C9eY1FXQmwp7dGLFLtjJi.2_1 2019-11-28T22:00:13.231 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:13.245+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.8__multipart_foo-LUKEWARM.2~7vEkaM3Bg2C9eY1FXQmwp7dGLFLtjJi.3 2019-11-28T22:00:13.391 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:13.405+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:00:13.492 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:13.506+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-28T22:00:13.542 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:13.555+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:13.559 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:13.573+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:13.568 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:13.583+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:13.609 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:13.623+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-28T22:00:13.670 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:13.685+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:13.694 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:13.708+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:13.711 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:13.725+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-28T22:00:13.711 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:13.725+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.225', time=2019-11-28T23:59:35.965040+0000, chain.objs.size()=5 2019-11-28T22:00:13.711 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:13.725+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9__multipart_foo-FROZEN.2~tYSfORmeQYTpmfzvGAuRyW9Vvguixwf.1 2019-11-28T22:00:13.711 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:13.725+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9__shadow_foo-FROZEN.2~tYSfORmeQYTpmfzvGAuRyW9Vvguixwf.1_1 2019-11-28T22:00:13.712 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:13.726+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9__multipart_foo-FROZEN.2~tYSfORmeQYTpmfzvGAuRyW9Vvguixwf.2 2019-11-28T22:00:13.712 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:13.726+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9__shadow_foo-FROZEN.2~tYSfORmeQYTpmfzvGAuRyW9Vvguixwf.2_1 2019-11-28T22:00:13.712 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:13.726+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9__multipart_foo-FROZEN.2~tYSfORmeQYTpmfzvGAuRyW9Vvguixwf.3 2019-11-28T22:00:13.911 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:13.925+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:00:14.022 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:14.036+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-28T22:00:14.095 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:14.109+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:14.121 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:14.136+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:14.145 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:14.159+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2019-11-28T22:00:14.146 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:14.159+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process iterating over entry tag='_0hqE0yKCoCL1IAmEhY26pFjfo1dDRds', time=2019-11-28T23:59:33.397913+0000, chain.objs.size()=2 2019-11-28T22:00:14.146 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:14.159+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.7__shadow_.hOGTi-R3Ki1m2sReEJLoR5wA4SVoVR1_0 2019-11-28T22:00:14.146 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:14.159+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.7__shadow_.hOGTi-R3Ki1m2sReEJLoR5wA4SVoVR1_1 2019-11-28T22:00:14.146 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:14.159+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.233', time=2019-11-28T23:59:36.551736+0000, chain.objs.size()=5 2019-11-28T22:00:14.146 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:14.159+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9__multipart_foo-LUKEWARM.2~wQfwmnLmbBlsKx2ZcwcR1iqckVd1hTH.1 2019-11-28T22:00:14.146 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:14.159+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9__shadow_foo-LUKEWARM.2~wQfwmnLmbBlsKx2ZcwcR1iqckVd1hTH.1_1 2019-11-28T22:00:14.147 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:14.159+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9__multipart_foo-LUKEWARM.2~wQfwmnLmbBlsKx2ZcwcR1iqckVd1hTH.2 2019-11-28T22:00:14.147 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:14.159+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9__shadow_foo-LUKEWARM.2~wQfwmnLmbBlsKx2ZcwcR1iqckVd1hTH.2_1 2019-11-28T22:00:14.147 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:14.159+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9__multipart_foo-LUKEWARM.2~wQfwmnLmbBlsKx2ZcwcR1iqckVd1hTH.3 2019-11-28T22:00:14.147 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:14.159+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.235', time=2019-11-28T23:59:36.898661+0000, chain.objs.size()=5 2019-11-28T22:00:14.147 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:14.159+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9__multipart_foo-LUKEWARM.2~wQfwmnLmbBlsKx2ZcwcR1iqckVd1hTH.1 2019-11-28T22:00:14.147 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:14.159+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9__shadow_foo-LUKEWARM.2~wQfwmnLmbBlsKx2ZcwcR1iqckVd1hTH.1_1 2019-11-28T22:00:14.148 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:14.159+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9__multipart_foo-LUKEWARM.2~wQfwmnLmbBlsKx2ZcwcR1iqckVd1hTH.2 2019-11-28T22:00:14.148 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:14.159+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9__shadow_foo-LUKEWARM.2~wQfwmnLmbBlsKx2ZcwcR1iqckVd1hTH.2_1 2019-11-28T22:00:14.148 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:14.159+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9__multipart_foo-LUKEWARM.2~wQfwmnLmbBlsKx2ZcwcR1iqckVd1hTH.3 2019-11-28T22:00:14.539 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:14.553+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:00:14.715 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:14.730+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-28T22:00:14.779 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:14.793+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:14.806 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:14.821+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:14.863 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:14.877+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-28T22:00:14.863 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:14.877+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.245', time=2019-11-28T23:59:37.850122+0000, chain.objs.size()=3 2019-11-28T22:00:14.864 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:14.877+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9__multipart_foo-STANDARD.2~KDo9Txa-ekI1e_8Y3N0Dk2W77l5lpKY.1 2019-11-28T22:00:14.864 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:14.877+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9__multipart_foo-STANDARD.2~KDo9Txa-ekI1e_8Y3N0Dk2W77l5lpKY.2 2019-11-28T22:00:14.864 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:14.877+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.9__multipart_foo-STANDARD.2~KDo9Txa-ekI1e_8Y3N0Dk2W77l5lpKY.3 2019-11-28T22:00:14.864 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:14.877+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.196', time=2019-11-28T23:59:38.735864+0000, chain.objs.size()=5 2019-11-28T22:00:14.864 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:14.877+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.8__multipart_foo-FROZEN.2~IdkL4qdNI3Bx2iiVbExTckYv1TsnR7d.1 2019-11-28T22:00:14.864 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:14.877+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.8__shadow_foo-FROZEN.2~IdkL4qdNI3Bx2iiVbExTckYv1TsnR7d.1_1 2019-11-28T22:00:14.864 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:14.878+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.8__multipart_foo-FROZEN.2~IdkL4qdNI3Bx2iiVbExTckYv1TsnR7d.2 2019-11-28T22:00:14.865 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:14.878+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.8__shadow_foo-FROZEN.2~IdkL4qdNI3Bx2iiVbExTckYv1TsnR7d.2_1 2019-11-28T22:00:14.865 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:14.878+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.8__multipart_foo-FROZEN.2~IdkL4qdNI3Bx2iiVbExTckYv1TsnR7d.3 2019-11-28T22:00:15.129 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:15.143+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:00:15.276 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:15.291+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-28T22:00:15.324 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:15.339+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:15.340 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:15.354+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:15.348 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:15.363+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:15.389 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:15.404+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-28T22:00:15.473 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:15.488+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:15.500 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:15.515+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:15.520 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:15.535+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-28T22:00:15.521 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:15.535+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.71', time=2019-11-28T23:59:31.434236+0000, chain.objs.size()=4 2019-11-28T22:00:15.521 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:15.535+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.5__multipart_foo.2~2J3sJ-ha-VEp5to_NDWM6qp74c_6bUd.1 2019-11-28T22:00:15.521 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:15.535+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.5__multipart_foo.2~2J3sJ-ha-VEp5to_NDWM6qp74c_6bUd.2 2019-11-28T22:00:15.521 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:15.535+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.5__multipart_foo.2~2J3sJ-ha-VEp5to_NDWM6qp74c_6bUd.3 2019-11-28T22:00:15.521 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:15.535+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.5__multipart_foo.2~2J3sJ-ha-VEp5to_NDWM6qp74c_6bUd.4 2019-11-28T22:00:15.677 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:15.691+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:00:15.777 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:15.791+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-28T22:00:15.834 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:15.848+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:15.854 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:15.869+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:15.882 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:15.889+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-28T22:00:15.882 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:15.889+0000 7fdf06ca1ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.85', time=2019-11-28T23:59:40.872643+0000, chain.objs.size()=3 2019-11-28T22:00:15.882 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:15.889+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.6__shadow_.7tw0PHUdB7GKzSidjoIyZN80UofzuTN_0 2019-11-28T22:00:15.882 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:15.889+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.6__shadow_.7tw0PHUdB7GKzSidjoIyZN80UofzuTN_1 2019-11-28T22:00:15.882 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:15.889+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.6__shadow_.7tw0PHUdB7GKzSidjoIyZN80UofzuTN_2 2019-11-28T22:00:16.095 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:16.110+0000 7fdf06ca1ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:00:16.230 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:16.245+0000 7fdf06ca1ec0 20 remove_watcher() i=0 2019-11-28T22:00:16.230 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:16.245+0000 7fdf06ca1ec0 2 removed watcher, disabling cache 2019-11-28T22:00:16.282 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:16.297+0000 7fdf06ca1ec0 20 remove_watcher() i=1 2019-11-28T22:00:16.316 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:16.330+0000 7fdf06ca1ec0 20 remove_watcher() i=2 2019-11-28T22:00:16.369 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:16.384+0000 7fdf06ca1ec0 20 remove_watcher() i=3 2019-11-28T22:00:16.404 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:16.418+0000 7fdf06ca1ec0 20 remove_watcher() i=4 2019-11-28T22:00:16.444 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:16.459+0000 7fdf06ca1ec0 20 remove_watcher() i=5 2019-11-28T22:00:16.477 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:16.492+0000 7fdf06ca1ec0 20 remove_watcher() i=6 2019-11-28T22:00:16.507 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:16.521+0000 7fdf06ca1ec0 20 remove_watcher() i=7 2019-11-28T22:00:16.514 INFO:teuthology.orchestra.run.smithi074:> radosgw-admin gc process --include-all 2019-11-28T22:00:16.627 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:16.641+0000 7f64b3a13ec0 20 rados->read ofs=0 len=0 2019-11-28T22:00:16.654 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:16.669+0000 7f64b3a13ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:00:16.655 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:16.669+0000 7f64b3a13ec0 20 rados->read ofs=0 len=0 2019-11-28T22:00:16.665 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:16.680+0000 7f64b3a13ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:00:16.666 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:16.680+0000 7f64b3a13ec0 20 rados->read ofs=0 len=0 2019-11-28T22:00:16.677 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:16.691+0000 7f64b3a13ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:00:16.677 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:16.691+0000 7f64b3a13ec0 20 rados->read ofs=0 len=0 2019-11-28T22:00:16.695 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:16.709+0000 7f64b3a13ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:00:16.890 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:16.904+0000 7f64b3a13ec0 20 RGWRados::pool_iterate: got zonegroup_info.cb1773b4-411c-4317-a760-df89ca0f54fc 2019-11-28T22:00:16.890 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:16.904+0000 7f64b3a13ec0 20 RGWRados::pool_iterate: got zone_info.bd5ae442-b074-4d35-94cc-b1d71bd6ac02 2019-11-28T22:00:16.890 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:16.904+0000 7f64b3a13ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-28T22:00:16.890 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:16.904+0000 7f64b3a13ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-28T22:00:16.890 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:16.904+0000 7f64b3a13ec0 20 rados->read ofs=0 len=0 2019-11-28T22:00:16.904 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:16.919+0000 7f64b3a13ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:00:16.905 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:16.919+0000 7f64b3a13ec0 20 rados->read ofs=0 len=0 2019-11-28T22:00:16.919 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:16.933+0000 7f64b3a13ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T22:00:16.919 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:16.933+0000 7f64b3a13ec0 20 rados->read ofs=0 len=0 2019-11-28T22:00:16.937 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:16.951+0000 7f64b3a13ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:00:16.937 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:16.951+0000 7f64b3a13ec0 20 rados->read ofs=0 len=0 2019-11-28T22:00:16.955 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:16.969+0000 7f64b3a13ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T22:00:16.955 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:16.969+0000 7f64b3a13ec0 20 rados->read ofs=0 len=0 2019-11-28T22:00:16.967 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:16.981+0000 7f64b3a13ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:00:16.967 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:16.981+0000 7f64b3a13ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-28T22:00:16.967 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:16.981+0000 7f64b3a13ec0 20 rados->read ofs=0 len=0 2019-11-28T22:00:16.978 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:16.993+0000 7f64b3a13ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:00:16.978 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:16.993+0000 7f64b3a13ec0 20 rados->read ofs=0 len=0 2019-11-28T22:00:16.987 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:17.001+0000 7f64b3a13ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:00:16.987 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:17.001+0000 7f64b3a13ec0 20 rados->read ofs=0 len=0 2019-11-28T22:00:17.003 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:17.017+0000 7f64b3a13ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T22:00:17.003 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:17.017+0000 7f64b3a13ec0 20 zonegroup default 2019-11-28T22:00:17.003 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:17.017+0000 7f64b3a13ec0 20 rados->read ofs=0 len=0 2019-11-28T22:00:17.029 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:17.028+0000 7f64b3a13ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:00:17.029 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:17.028+0000 7f64b3a13ec0 10 Cannot find current period zone using local zone 2019-11-28T22:00:17.030 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:17.028+0000 7f64b3a13ec0 20 rados->read ofs=0 len=0 2019-11-28T22:00:17.030 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:17.038+0000 7f64b3a13ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:00:17.030 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:17.039+0000 7f64b3a13ec0 20 rados->read ofs=0 len=0 2019-11-28T22:00:17.036 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:17.051+0000 7f64b3a13ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:00:17.036 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:17.051+0000 7f64b3a13ec0 20 rados->read ofs=0 len=0 2019-11-28T22:00:17.048 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:17.063+0000 7f64b3a13ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T22:00:17.048 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:17.063+0000 7f64b3a13ec0 20 zone default found 2019-11-28T22:00:17.049 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:17.063+0000 7f64b3a13ec0 20 started sync module instance, tier type = 2019-11-28T22:00:17.049 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:17.063+0000 7f64b3a13ec0 20 started zone id=bd5ae442-b074-4d35-94cc-b1d71bd6ac02 (name=default) with tier type = 2019-11-28T22:00:17.421 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:17.435+0000 7f64b3a13ec0 20 add_watcher() i=0 2019-11-28T22:00:17.421 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:17.435+0000 7f64b3a13ec0 20 add_watcher() i=1 2019-11-28T22:00:17.421 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:17.435+0000 7f64b3a13ec0 20 add_watcher() i=2 2019-11-28T22:00:17.421 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:17.435+0000 7f64b3a13ec0 20 add_watcher() i=3 2019-11-28T22:00:17.421 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:17.435+0000 7f64b3a13ec0 20 add_watcher() i=4 2019-11-28T22:00:17.422 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:17.435+0000 7f64b3a13ec0 20 add_watcher() i=5 2019-11-28T22:00:17.422 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:17.435+0000 7f64b3a13ec0 20 add_watcher() i=6 2019-11-28T22:00:17.449 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:17.464+0000 7f64b3a13ec0 20 add_watcher() i=7 2019-11-28T22:00:17.450 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:17.464+0000 7f64b3a13ec0 2 all 8 watchers are set, enabling cache 2019-11-28T22:00:17.450 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:17.464+0000 7f63f3fff700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-28T22:00:17.457 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:17.471+0000 7f64a0c40700 0 -- 172.21.15.74:0/3524186578 >> [v2:172.21.15.74:3300/0,v1:172.21.15.74:6789/0] conn(0x55917714d340 msgr2=0x559177174910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-28T22:00:17.481 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:17.496+0000 7f64a043f700 0 -- 172.21.15.74:0/1027110580 >> v1:172.21.15.74:6789/0 conn(0x5591771488e0 legacy=0x559177148cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-28T22:00:19.247 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:19.261+0000 7f63de7fc700 20 reqs_thread_entry: start 2019-11-28T22:00:19.247 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:19.261+0000 7f63d7fff700 20 reqs_thread_entry: start 2019-11-28T22:00:19.247 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:19.261+0000 7f64b3a13ec0 20 init_complete bucket index max shards: 0 2019-11-28T22:00:19.247 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:19.262+0000 7f63d67fc700 20 reqs_thread_entry: start 2019-11-28T22:00:19.248 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:19.262+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-28T22:00:19.304 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:19.319+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:19.320 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:19.335+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:19.330 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:19.344+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:19.363 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:19.378+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-28T22:00:19.422 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:19.437+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:19.443 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:19.458+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:19.453 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:19.467+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:19.498 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:19.512+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-28T22:00:19.543 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:19.558+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:19.559 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:19.574+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:19.568 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:19.582+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:19.600 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:19.614+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-28T22:00:19.641 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:19.655+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:19.656 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:19.671+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:19.665 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:19.680+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:19.700 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:19.715+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-28T22:00:19.752 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:19.767+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:19.768 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:19.783+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:19.777 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:19.792+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:19.807 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:19.822+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-28T22:00:19.849 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:19.863+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:19.864 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:19.879+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:19.873 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:19.888+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:19.903 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:19.918+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-28T22:00:19.954 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:19.968+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:19.969 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:19.984+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:19.977 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:19.992+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:20.016 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:20.031+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-28T22:00:20.090 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:20.104+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:20.118 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:20.132+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:20.128 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:20.143+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:20.165 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:20.180+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-28T22:00:20.224 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:20.238+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:20.248 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:20.257+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:20.253 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:20.268+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:20.306 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:20.321+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-28T22:00:20.357 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:20.371+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:20.373 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:20.388+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:20.388 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:20.403+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:20.438 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:20.453+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-28T22:00:20.499 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:20.514+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:20.544 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:20.558+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:20.574 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:20.589+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:20.637 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:20.652+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-28T22:00:20.718 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:20.733+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:20.735 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:20.749+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:20.743 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:20.758+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:20.778 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:20.793+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-28T22:00:20.833 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:20.848+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:20.848 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:20.862+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:20.854 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:20.869+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:20.913 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:20.928+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-28T22:00:21.011 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:21.026+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:21.033 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:21.047+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:21.040 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:21.054+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:21.097 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:21.111+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-28T22:00:21.178 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:21.192+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:21.211 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:21.226+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:21.226 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:21.241+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:21.295 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:21.309+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-28T22:00:21.354 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:21.369+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:21.375 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:21.389+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:21.382 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:21.397+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:21.445 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:21.460+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-28T22:00:21.517 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:21.532+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:21.541 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:21.556+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:21.556 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:21.571+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:21.614 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:21.629+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-28T22:00:21.669 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:21.684+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:21.687 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:21.701+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:21.697 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:21.711+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:21.736 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:21.750+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-28T22:00:21.801 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:21.815+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:21.820 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:21.835+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:21.832 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:21.847+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:21.875 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:21.889+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-28T22:00:21.950 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:21.965+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:21.982 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:21.996+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:21.992 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:22.007+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:22.144 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:22.159+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-28T22:00:22.198 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:22.212+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:22.212 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:22.227+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:22.221 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:22.236+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:22.256 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:22.271+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-28T22:00:22.322 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:22.337+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:22.341 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:22.356+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:22.353 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:22.368+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:22.400 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:22.414+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-28T22:00:22.466 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:22.480+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:22.484 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:22.499+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:22.494 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:22.509+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:22.526 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:22.541+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-28T22:00:22.609 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:22.623+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:22.637 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:22.651+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:22.666 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:22.680+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:22.722 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:22.736+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-28T22:00:22.775 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:22.790+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:22.793 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:22.808+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:22.809 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:22.824+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:22.857 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:22.872+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-28T22:00:22.900 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:22.915+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:22.916 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:22.930+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:22.923 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:22.938+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:22.961 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:22.976+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-28T22:00:23.003 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:23.018+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:23.018 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:23.033+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:23.030 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:23.044+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:23.062 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:23.077+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-28T22:00:23.107 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:23.122+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:23.123 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:23.138+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:23.132 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:23.147+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:23.160 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:23.174+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-28T22:00:23.238 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:23.252+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:23.275 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:23.290+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:23.291 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:23.305+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:23.330 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:23.345+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-28T22:00:23.381 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:23.396+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:23.401 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:23.415+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:23.408 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:23.423+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:23.460 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:23.475+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-28T22:00:23.517 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:23.531+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:23.535 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:23.550+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:23.543 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:23.558+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:23.592 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:23.607+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-28T22:00:23.676 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:23.691+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:23.712 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:23.727+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:00:23.728 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:23.742+0000 7f64b3a13ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:00:23.844 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:23.858+0000 7f64b3a13ec0 20 remove_watcher() i=0 2019-11-28T22:00:23.844 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:23.858+0000 7f64b3a13ec0 2 removed watcher, disabling cache 2019-11-28T22:00:23.916 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:23.931+0000 7f64b3a13ec0 20 remove_watcher() i=1 2019-11-28T22:00:24.009 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:24.024+0000 7f64b3a13ec0 20 remove_watcher() i=2 2019-11-28T22:00:24.050 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:24.062+0000 7f64b3a13ec0 20 remove_watcher() i=3 2019-11-28T22:00:24.090 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:24.105+0000 7f64b3a13ec0 20 remove_watcher() i=4 2019-11-28T22:00:24.132 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:24.147+0000 7f64b3a13ec0 20 remove_watcher() i=5 2019-11-28T22:00:24.181 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:24.196+0000 7f64b3a13ec0 20 remove_watcher() i=6 2019-11-28T22:00:24.222 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:00:24.237+0000 7f64b3a13ec0 20 remove_watcher() i=7 2019-11-28T22:00:24.229 INFO:teuthology.orchestra.run.smithi074:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2019-11-28T22:00:24.867 INFO:teuthology.orchestra.run.smithi074.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2019-11-28T22:00:28.066 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/io/spring/gradle/dependency-management-plugin/1.0.3.RELEASE/dependency-management-plugin-1.0.3.RELEASE.pom 2019-11-28T22:00:28.166 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/io/spring/gradle/dependency-management-plugin/1.0.3.RELEASE/dependency-management-plugin-1.0.3.RELEASE.jar 2019-11-28T22:00:29.567 INFO:teuthology.orchestra.run.smithi074.stdout:> Task :clean UP-TO-DATE 2019-11-28T22:00:29.666 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-bom/1.11.549/aws-java-sdk-bom-1.11.549.pom 2019-11-28T22:00:29.667 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pom/1.11.549/aws-java-sdk-pom-1.11.549.pom 2019-11-28T22:00:29.868 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/log4j/log4j/1.2.17/log4j-1.2.17.pom 2019-11-28T22:00:29.868 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-s3/1.11.549/aws-java-sdk-s3-1.11.549.pom 2019-11-28T22:00:29.869 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk/1.11.549/aws-java-sdk-1.11.549.pom 2019-11-28T22:00:29.869 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sqs/1.11.549/aws-java-sdk-sqs-1.11.549.pom 2019-11-28T22:00:29.869 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-core/1.11.549/aws-java-sdk-core-1.11.549.pom 2019-11-28T22:00:29.869 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/testng/testng/6.1.1/testng-6.1.1.pom 2019-11-28T22:00:29.870 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-server/2.44.0/selenium-server-2.44.0.pom 2019-11-28T22:00:29.870 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/3/oss-parent-3.pom 2019-11-28T22:00:29.967 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-parent/2.44.0/selenium-parent-2.44.0.pom 2019-11-28T22:00:29.967 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/commons-logging/commons-logging/1.1.3/commons-logging-1.1.3.pom 2019-11-28T22:00:29.968 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/dataformat/jackson-dataformat-cbor/2.6.7/jackson-dataformat-cbor-2.6.7.pom 2019-11-28T22:00:29.968 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.5/httpclient-4.5.5.pom 2019-11-28T22:00:29.968 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/software/amazon/ion/ion-java/1.0.2/ion-java-1.0.2.pom 2019-11-28T22:00:29.968 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-databind/2.6.7.2/jackson-databind-2.6.7.2.pom 2019-11-28T22:00:29.968 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/joda-time/joda-time/2.8.1/joda-time-2.8.1.pom 2019-11-28T22:00:29.968 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.5/httpcomponents-client-4.5.5.pom 2019-11-28T22:00:29.969 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/28/commons-parent-28.pom 2019-11-28T22:00:29.969 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/jackson-parent/2.6.2/jackson-parent-2.6.2.pom 2019-11-28T22:00:29.969 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/10/httpcomponents-parent-10.pom 2019-11-28T22:00:29.969 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2019-11-28T22:00:29.969 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/oss-parent/24/oss-parent-24.pom 2019-11-28T22:00:29.969 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2019-11-28T22:00:30.068 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-managedblockchain/1.11.549/aws-java-sdk-managedblockchain-1.11.549.pom 2019-11-28T22:00:30.068 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kafka/1.11.549/aws-java-sdk-kafka-1.11.549.pom 2019-11-28T22:00:30.069 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appmesh/1.11.549/aws-java-sdk-appmesh-1.11.549.pom 2019-11-28T22:00:30.069 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-textract/1.11.549/aws-java-sdk-textract-1.11.549.pom 2019-11-28T22:00:30.069 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-worklink/1.11.549/aws-java-sdk-worklink-1.11.549.pom 2019-11-28T22:00:30.069 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-apigatewayv2/1.11.549/aws-java-sdk-apigatewayv2-1.11.549.pom 2019-11-28T22:00:30.069 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-backup/1.11.549/aws-java-sdk-backup-1.11.549.pom 2019-11-28T22:00:30.069 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-licensemanager/1.11.549/aws-java-sdk-licensemanager-1.11.549.pom 2019-11-28T22:00:30.070 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-fsx/1.11.549/aws-java-sdk-fsx-1.11.549.pom 2019-11-28T22:00:30.070 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-securityhub/1.11.549/aws-java-sdk-securityhub-1.11.549.pom 2019-11-28T22:00:30.070 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-docdb/1.11.549/aws-java-sdk-docdb-1.11.549.pom 2019-11-28T22:00:30.070 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediaconnect/1.11.549/aws-java-sdk-mediaconnect-1.11.549.pom 2019-11-28T22:00:30.169 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-globalaccelerator/1.11.549/aws-java-sdk-globalaccelerator-1.11.549.pom 2019-11-28T22:00:30.169 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesisanalyticsv2/1.11.549/aws-java-sdk-kinesisanalyticsv2-1.11.549.pom 2019-11-28T22:00:30.170 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-comprehendmedical/1.11.549/aws-java-sdk-comprehendmedical-1.11.549.pom 2019-11-28T22:00:30.170 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-datasync/1.11.549/aws-java-sdk-datasync-1.11.549.pom 2019-11-28T22:00:30.170 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-transfer/1.11.549/aws-java-sdk-transfer-1.11.549.pom 2019-11-28T22:00:30.170 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-amplify/1.11.549/aws-java-sdk-amplify-1.11.549.pom 2019-11-28T22:00:30.170 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-quicksight/1.11.549/aws-java-sdk-quicksight-1.11.549.pom 2019-11-28T22:00:30.170 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-robomaker/1.11.549/aws-java-sdk-robomaker-1.11.549.pom 2019-11-28T22:00:30.171 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-route53resolver/1.11.549/aws-java-sdk-route53resolver-1.11.549.pom 2019-11-28T22:00:30.171 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rdsdata/1.11.549/aws-java-sdk-rdsdata-1.11.549.pom 2019-11-28T22:00:30.171 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ram/1.11.549/aws-java-sdk-ram-1.11.549.pom 2019-11-28T22:00:30.171 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpointsmsvoice/1.11.549/aws-java-sdk-pinpointsmsvoice-1.11.549.pom 2019-11-28T22:00:30.171 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpointemail/1.11.549/aws-java-sdk-pinpointemail-1.11.549.pom 2019-11-28T22:00:30.171 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-s3control/1.11.549/aws-java-sdk-s3control-1.11.549.pom 2019-11-28T22:00:30.171 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-chime/1.11.549/aws-java-sdk-chime-1.11.549.pom 2019-11-28T22:00:30.172 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dlm/1.11.549/aws-java-sdk-dlm-1.11.549.pom 2019-11-28T22:00:30.172 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-signer/1.11.549/aws-java-sdk-signer-1.11.549.pom 2019-11-28T22:00:30.172 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-macie/1.11.549/aws-java-sdk-macie-1.11.549.pom 2019-11-28T22:00:30.173 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediatailor/1.11.549/aws-java-sdk-mediatailor-1.11.549.pom 2019-11-28T22:00:30.173 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-neptune/1.11.549/aws-java-sdk-neptune-1.11.549.pom 2019-11-28T22:00:30.173 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot1clickprojects/1.11.549/aws-java-sdk-iot1clickprojects-1.11.549.pom 2019-11-28T22:00:30.174 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pi/1.11.549/aws-java-sdk-pi-1.11.549.pom 2019-11-28T22:00:30.174 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-eks/1.11.549/aws-java-sdk-eks-1.11.549.pom 2019-11-28T22:00:30.174 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot1clickdevices/1.11.549/aws-java-sdk-iot1clickdevices-1.11.549.pom 2019-11-28T22:00:30.174 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-acmpca/1.11.549/aws-java-sdk-acmpca-1.11.549.pom 2019-11-28T22:00:30.174 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-secretsmanager/1.11.549/aws-java-sdk-secretsmanager-1.11.549.pom 2019-11-28T22:00:30.174 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iotanalytics/1.11.549/aws-java-sdk-iotanalytics-1.11.549.pom 2019-11-28T22:00:30.175 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-connect/1.11.549/aws-java-sdk-connect-1.11.549.pom 2019-11-28T22:00:30.175 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-transcribe/1.11.549/aws-java-sdk-transcribe-1.11.549.pom 2019-11-28T22:00:30.175 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-autoscalingplans/1.11.549/aws-java-sdk-autoscalingplans-1.11.549.pom 2019-11-28T22:00:30.176 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-fms/1.11.549/aws-java-sdk-fms-1.11.549.pom 2019-11-28T22:00:30.176 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workmail/1.11.549/aws-java-sdk-workmail-1.11.549.pom 2019-11-28T22:00:30.176 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servicediscovery/1.11.549/aws-java-sdk-servicediscovery-1.11.549.pom 2019-11-28T22:00:30.271 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloud9/1.11.549/aws-java-sdk-cloud9-1.11.549.pom 2019-11-28T22:00:30.271 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-serverlessapplicationrepository/1.11.549/aws-java-sdk-serverlessapplicationrepository-1.11.549.pom 2019-11-28T22:00:30.271 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-resourcegroups/1.11.549/aws-java-sdk-resourcegroups-1.11.549.pom 2019-11-28T22:00:30.272 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-alexaforbusiness/1.11.549/aws-java-sdk-alexaforbusiness-1.11.549.pom 2019-11-28T22:00:30.272 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-comprehend/1.11.549/aws-java-sdk-comprehend-1.11.549.pom 2019-11-28T22:00:30.272 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-translate/1.11.549/aws-java-sdk-translate-1.11.549.pom 2019-11-28T22:00:30.272 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iotjobsdataplane/1.11.549/aws-java-sdk-iotjobsdataplane-1.11.549.pom 2019-11-28T22:00:30.272 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesisvideo/1.11.549/aws-java-sdk-kinesisvideo-1.11.549.pom 2019-11-28T22:00:30.272 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sagemaker/1.11.549/aws-java-sdk-sagemaker-1.11.549.pom 2019-11-28T22:00:30.273 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sagemakerruntime/1.11.549/aws-java-sdk-sagemakerruntime-1.11.549.pom 2019-11-28T22:00:30.273 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-guardduty/1.11.549/aws-java-sdk-guardduty-1.11.549.pom 2019-11-28T22:00:30.273 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appsync/1.11.549/aws-java-sdk-appsync-1.11.549.pom 2019-11-28T22:00:30.274 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediaconvert/1.11.549/aws-java-sdk-mediaconvert-1.11.549.pom 2019-11-28T22:00:30.274 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mq/1.11.549/aws-java-sdk-mq-1.11.549.pom 2019-11-28T22:00:30.274 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediastoredata/1.11.549/aws-java-sdk-mediastoredata-1.11.549.pom 2019-11-28T22:00:30.274 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediastore/1.11.549/aws-java-sdk-mediastore-1.11.549.pom 2019-11-28T22:00:30.274 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-medialive/1.11.549/aws-java-sdk-medialive-1.11.549.pom 2019-11-28T22:00:30.275 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediapackage/1.11.549/aws-java-sdk-mediapackage-1.11.549.pom 2019-11-28T22:00:30.275 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pricing/1.11.549/aws-java-sdk-pricing-1.11.549.pom 2019-11-28T22:00:30.275 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-costexplorer/1.11.549/aws-java-sdk-costexplorer-1.11.549.pom 2019-11-28T22:00:30.275 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mobile/1.11.549/aws-java-sdk-mobile-1.11.549.pom 2019-11-28T22:00:30.275 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-migrationhub/1.11.549/aws-java-sdk-migrationhub-1.11.549.pom 2019-11-28T22:00:30.275 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dax/1.11.549/aws-java-sdk-dax-1.11.549.pom 2019-11-28T22:00:30.275 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-glue/1.11.549/aws-java-sdk-glue-1.11.549.pom 2019-11-28T22:00:30.276 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudhsmv2/1.11.549/aws-java-sdk-cloudhsmv2-1.11.549.pom 2019-11-28T22:00:30.276 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplaceentitlement/1.11.549/aws-java-sdk-marketplaceentitlement-1.11.549.pom 2019-11-28T22:00:30.276 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codestar/1.11.549/aws-java-sdk-codestar-1.11.549.pom 2019-11-28T22:00:30.276 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-athena/1.11.549/aws-java-sdk-athena-1.11.549.pom 2019-11-28T22:00:30.367 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-greengrass/1.11.549/aws-java-sdk-greengrass-1.11.549.pom 2019-11-28T22:00:30.367 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-resourcegroupstaggingapi/1.11.549/aws-java-sdk-resourcegroupstaggingapi-1.11.549.pom 2019-11-28T22:00:30.367 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lexmodelbuilding/1.11.549/aws-java-sdk-lexmodelbuilding-1.11.549.pom 2019-11-28T22:00:30.368 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpoint/1.11.549/aws-java-sdk-pinpoint-1.11.549.pom 2019-11-28T22:00:30.368 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-xray/1.11.549/aws-java-sdk-xray-1.11.549.pom 2019-11-28T22:00:30.368 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-support/1.11.549/aws-java-sdk-support-1.11.549.pom 2019-11-28T22:00:30.369 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-simpledb/1.11.549/aws-java-sdk-simpledb-1.11.549.pom 2019-11-28T22:00:30.369 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-opsworkscm/1.11.549/aws-java-sdk-opsworkscm-1.11.549.pom 2019-11-28T22:00:30.369 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-simpleworkflow/1.11.549/aws-java-sdk-simpleworkflow-1.11.549.pom 2019-11-28T22:00:30.369 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servermigration/1.11.549/aws-java-sdk-servermigration-1.11.549.pom 2019-11-28T22:00:30.369 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-storagegateway/1.11.549/aws-java-sdk-storagegateway-1.11.549.pom 2019-11-28T22:00:30.369 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-importexport/1.11.549/aws-java-sdk-importexport-1.11.549.pom 2019-11-28T22:00:30.370 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sts/1.11.549/aws-java-sdk-sts-1.11.549.pom 2019-11-28T22:00:30.370 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-route53/1.11.549/aws-java-sdk-route53-1.11.549.pom 2019-11-28T22:00:30.370 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servicecatalog/1.11.549/aws-java-sdk-servicecatalog-1.11.549.pom 2019-11-28T22:00:30.370 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticbeanstalk/1.11.549/aws-java-sdk-elasticbeanstalk-1.11.549.pom 2019-11-28T22:00:30.370 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-redshift/1.11.549/aws-java-sdk-redshift-1.11.549.pom 2019-11-28T22:00:30.370 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rds/1.11.549/aws-java-sdk-rds-1.11.549.pom 2019-11-28T22:00:30.370 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-glacier/1.11.549/aws-java-sdk-glacier-1.11.549.pom 2019-11-28T22:00:30.371 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iam/1.11.549/aws-java-sdk-iam-1.11.549.pom 2019-11-28T22:00:30.371 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-datapipeline/1.11.549/aws-java-sdk-datapipeline-1.11.549.pom 2019-11-28T22:00:30.371 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticloadbalancingv2/1.11.549/aws-java-sdk-elasticloadbalancingv2-1.11.549.pom 2019-11-28T22:00:30.371 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticloadbalancing/1.11.549/aws-java-sdk-elasticloadbalancing-1.11.549.pom 2019-11-28T22:00:30.372 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elastictranscoder/1.11.549/aws-java-sdk-elastictranscoder-1.11.549.pom 2019-11-28T22:00:30.372 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-emr/1.11.549/aws-java-sdk-emr-1.11.549.pom 2019-11-28T22:00:30.372 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dynamodb/1.11.549/aws-java-sdk-dynamodb-1.11.549.pom 2019-11-28T22:00:30.372 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ec2/1.11.549/aws-java-sdk-ec2-1.11.549.pom 2019-11-28T22:00:30.372 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sns/1.11.549/aws-java-sdk-sns-1.11.549.pom 2019-11-28T22:00:30.373 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudwatch/1.11.549/aws-java-sdk-cloudwatch-1.11.549.pom 2019-11-28T22:00:30.373 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-budgets/1.11.549/aws-java-sdk-budgets-1.11.549.pom 2019-11-28T22:00:30.373 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-logs/1.11.549/aws-java-sdk-logs-1.11.549.pom 2019-11-28T22:00:30.373 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudtrail/1.11.549/aws-java-sdk-cloudtrail-1.11.549.pom 2019-11-28T22:00:30.373 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticache/1.11.549/aws-java-sdk-elasticache-1.11.549.pom 2019-11-28T22:00:30.374 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-events/1.11.549/aws-java-sdk-events-1.11.549.pom 2019-11-28T22:00:30.374 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitoidentity/1.11.549/aws-java-sdk-cognitoidentity-1.11.549.pom 2019-11-28T22:00:30.374 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitosync/1.11.549/aws-java-sdk-cognitosync-1.11.549.pom 2019-11-28T22:00:30.375 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudformation/1.11.549/aws-java-sdk-cloudformation-1.11.549.pom 2019-11-28T22:00:30.375 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-directconnect/1.11.549/aws-java-sdk-directconnect-1.11.549.pom 2019-11-28T22:00:30.375 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudfront/1.11.549/aws-java-sdk-cloudfront-1.11.549.pom 2019-11-28T22:00:30.491 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-clouddirectory/1.11.549/aws-java-sdk-clouddirectory-1.11.549.pom 2019-11-28T22:00:30.491 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-opsworks/1.11.549/aws-java-sdk-opsworks-1.11.549.pom 2019-11-28T22:00:30.491 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesis/1.11.549/aws-java-sdk-kinesis-1.11.549.pom 2019-11-28T22:00:30.492 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ses/1.11.549/aws-java-sdk-ses-1.11.549.pom 2019-11-28T22:00:30.492 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-autoscaling/1.11.549/aws-java-sdk-autoscaling-1.11.549.pom 2019-11-28T22:00:30.492 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codedeploy/1.11.549/aws-java-sdk-codedeploy-1.11.549.pom 2019-11-28T22:00:30.492 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kms/1.11.549/aws-java-sdk-kms-1.11.549.pom 2019-11-28T22:00:30.492 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-config/1.11.549/aws-java-sdk-config-1.11.549.pom 2019-11-28T22:00:30.492 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudsearch/1.11.549/aws-java-sdk-cloudsearch-1.11.549.pom 2019-11-28T22:00:30.493 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lambda/1.11.549/aws-java-sdk-lambda-1.11.549.pom 2019-11-28T22:00:30.493 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ecr/1.11.549/aws-java-sdk-ecr-1.11.549.pom 2019-11-28T22:00:30.493 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudwatchmetrics/1.11.549/aws-java-sdk-cloudwatchmetrics-1.11.549.pom 2019-11-28T22:00:30.493 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codepipeline/1.11.549/aws-java-sdk-codepipeline-1.11.549.pom 2019-11-28T22:00:30.493 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ecs/1.11.549/aws-java-sdk-ecs-1.11.549.pom 2019-11-28T22:00:30.493 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudhsm/1.11.549/aws-java-sdk-cloudhsm-1.11.549.pom 2019-11-28T22:00:30.494 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ssm/1.11.549/aws-java-sdk-ssm-1.11.549.pom 2019-11-28T22:00:30.494 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workspaces/1.11.549/aws-java-sdk-workspaces-1.11.549.pom 2019-11-28T22:00:30.494 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-machinelearning/1.11.549/aws-java-sdk-machinelearning-1.11.549.pom 2019-11-28T22:00:30.494 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-directory/1.11.549/aws-java-sdk-directory-1.11.549.pom 2019-11-28T22:00:30.494 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-efs/1.11.549/aws-java-sdk-efs-1.11.549.pom 2019-11-28T22:00:30.494 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-waf/1.11.549/aws-java-sdk-waf-1.11.549.pom 2019-11-28T22:00:30.494 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplacecommerceanalytics/1.11.549/aws-java-sdk-marketplacecommerceanalytics-1.11.549.pom 2019-11-28T22:00:30.495 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticsearch/1.11.549/aws-java-sdk-elasticsearch-1.11.549.pom 2019-11-28T22:00:30.495 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-devicefarm/1.11.549/aws-java-sdk-devicefarm-1.11.549.pom 2019-11-28T22:00:30.495 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot/1.11.549/aws-java-sdk-iot-1.11.549.pom 2019-11-28T22:00:30.495 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-inspector/1.11.549/aws-java-sdk-inspector-1.11.549.pom 2019-11-28T22:00:30.495 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codecommit/1.11.549/aws-java-sdk-codecommit-1.11.549.pom 2019-11-28T22:00:30.495 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-api-gateway/1.11.549/aws-java-sdk-api-gateway-1.11.549.pom 2019-11-28T22:00:30.495 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-acm/1.11.549/aws-java-sdk-acm-1.11.549.pom 2019-11-28T22:00:30.495 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-gamelift/1.11.549/aws-java-sdk-gamelift-1.11.549.pom 2019-11-28T22:00:30.496 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplacemeteringservice/1.11.549/aws-java-sdk-marketplacemeteringservice-1.11.549.pom 2019-11-28T22:00:30.496 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dms/1.11.549/aws-java-sdk-dms-1.11.549.pom 2019-11-28T22:00:30.496 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-discovery/1.11.549/aws-java-sdk-discovery-1.11.549.pom 2019-11-28T22:00:30.496 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-applicationautoscaling/1.11.549/aws-java-sdk-applicationautoscaling-1.11.549.pom 2019-11-28T22:00:30.496 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitoidp/1.11.549/aws-java-sdk-cognitoidp-1.11.549.pom 2019-11-28T22:00:30.496 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-snowball/1.11.549/aws-java-sdk-snowball-1.11.549.pom 2019-11-28T22:00:30.496 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rekognition/1.11.549/aws-java-sdk-rekognition-1.11.549.pom 2019-11-28T22:00:30.497 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-polly/1.11.549/aws-java-sdk-polly-1.11.549.pom 2019-11-28T22:00:30.497 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lightsail/1.11.549/aws-java-sdk-lightsail-1.11.549.pom 2019-11-28T22:00:30.497 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-stepfunctions/1.11.549/aws-java-sdk-stepfunctions-1.11.549.pom 2019-11-28T22:00:30.497 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-health/1.11.549/aws-java-sdk-health-1.11.549.pom 2019-11-28T22:00:30.497 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-costandusagereport/1.11.549/aws-java-sdk-costandusagereport-1.11.549.pom 2019-11-28T22:00:30.497 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appstream/1.11.549/aws-java-sdk-appstream-1.11.549.pom 2019-11-28T22:00:30.497 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codebuild/1.11.549/aws-java-sdk-codebuild-1.11.549.pom 2019-11-28T22:00:30.498 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-shield/1.11.549/aws-java-sdk-shield-1.11.549.pom 2019-11-28T22:00:30.498 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-batch/1.11.549/aws-java-sdk-batch-1.11.549.pom 2019-11-28T22:00:30.498 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lex/1.11.549/aws-java-sdk-lex-1.11.549.pom 2019-11-28T22:00:30.571 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-organizations/1.11.549/aws-java-sdk-organizations-1.11.549.pom 2019-11-28T22:00:30.571 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-models/1.11.549/aws-java-sdk-models-1.11.549.pom 2019-11-28T22:00:30.572 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mechanicalturkrequester/1.11.549/aws-java-sdk-mechanicalturkrequester-1.11.549.pom 2019-11-28T22:00:30.572 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-apigatewaymanagementapi/1.11.549/aws-java-sdk-apigatewaymanagementapi-1.11.549.pom 2019-11-28T22:00:30.576 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-swf-libraries/1.11.22/aws-java-sdk-swf-libraries-1.11.22.pom 2019-11-28T22:00:30.576 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workdocs/1.11.549/aws-java-sdk-workdocs-1.11.549.pom 2019-11-28T22:00:30.576 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pom/1.11.22/aws-java-sdk-pom-1.11.22.pom 2019-11-28T22:00:30.576 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/jmespath-java/1.11.549/jmespath-java-1.11.549.pom 2019-11-28T22:00:30.576 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/mx4j/mx4j-tools/3.0.1/mx4j-tools-3.0.1.pom 2019-11-28T22:00:30.577 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/bouncycastle/bcprov-jdk15on/1.48/bcprov-jdk15on-1.48.pom 2019-11-28T22:00:30.577 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/bouncycastle/bcpkix-jdk15on/1.48/bcpkix-jdk15on-1.48.pom 2019-11-28T22:00:30.577 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/mortbay/jetty/servlet-api-2.5/6.1.9/servlet-api-2.5-6.1.9.pom 2019-11-28T22:00:30.577 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/jetty-rc-repacked/5/jetty-rc-repacked-5.pom 2019-11-28T22:00:30.577 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/net/jcip/jcip-annotations/1.0/jcip-annotations-1.0.pom 2019-11-28T22:00:30.577 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-java/2.44.0/selenium-java-2.44.0.pom 2019-11-28T22:00:30.577 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/jetty-repacked/7.6.1/jetty-repacked-7.6.1.pom 2019-11-28T22:00:30.577 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.9/commons-codec-1.9.pom 2019-11-28T22:00:30.578 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/mortbay/jetty/project/6.1.9/project-6.1.9.pom 2019-11-28T22:00:30.578 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/yaml/snakeyaml/1.8/snakeyaml-1.8.pom 2019-11-28T22:00:30.578 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/32/commons-parent-32.pom 2019-11-28T22:00:30.667 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/junit/junit/3.8.1/junit-3.8.1.pom 2019-11-28T22:00:30.668 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/beanshell/bsh/2.0b4/bsh-2.0b4.pom 2019-11-28T22:00:30.668 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/beust/jcommander/1.12/jcommander-1.12.pom 2019-11-28T22:00:30.669 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/beanshell/beanshell/2.0b4/beanshell-2.0b4.pom 2019-11-28T22:00:30.670 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/commons-logging/commons-logging/1.2/commons-logging-1.2.pom 2019-11-28T22:00:30.670 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/34/commons-parent-34.pom 2019-11-28T22:00:30.670 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.10/commons-codec-1.10.pom 2019-11-28T22:00:30.767 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/35/commons-parent-35.pom 2019-11-28T22:00:30.767 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2019-11-28T22:00:30.767 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.9/httpcore-4.4.9.pom 2019-11-28T22:00:30.767 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.9/httpcomponents-core-4.4.9.pom 2019-11-28T22:00:30.767 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/9/httpcomponents-parent-9.pom 2019-11-28T22:00:30.768 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-core/2.6.7/jackson-core-2.6.7.pom 2019-11-28T22:00:30.768 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-annotations/2.6.0/jackson-annotations-2.6.0.pom 2019-11-28T22:00:30.867 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/jackson-parent/2.6.1/jackson-parent-2.6.1.pom 2019-11-28T22:00:30.867 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/oss-parent/23/oss-parent-23.pom 2019-11-28T22:00:30.867 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-handler/4.1.17.Final/netty-handler-4.1.17.Final.pom 2019-11-28T22:00:30.867 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-codec-http/4.1.17.Final/netty-codec-http-4.1.17.Final.pom 2019-11-28T22:00:30.869 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-parent/4.1.17.Final/netty-parent-4.1.17.Final.pom 2019-11-28T22:00:30.870 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2019-11-28T22:00:30.870 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-safari-driver/2.44.0/selenium-safari-driver-2.44.0.pom 2019-11-28T22:00:30.870 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-support/2.44.0/selenium-support-2.44.0.pom 2019-11-28T22:00:30.870 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-ie-driver/2.44.0/selenium-ie-driver-2.44.0.pom 2019-11-28T22:00:30.871 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/webbitserver/webbit/0.4.14/webbit-0.4.14.pom 2019-11-28T22:00:30.871 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-htmlunit-driver/2.44.0/selenium-htmlunit-driver-2.44.0.pom 2019-11-28T22:00:30.871 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-firefox-driver/2.44.0/selenium-firefox-driver-2.44.0.pom 2019-11-28T22:00:30.872 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-chrome-driver/2.44.0/selenium-chrome-driver-2.44.0.pom 2019-11-28T22:00:30.967 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/6/oss-parent-6.pom 2019-11-28T22:00:30.967 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-codec/4.1.17.Final/netty-codec-4.1.17.Final.pom 2019-11-28T22:00:30.967 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-buffer/4.1.17.Final/netty-buffer-4.1.17.Final.pom 2019-11-28T22:00:30.969 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-transport/4.1.17.Final/netty-transport-4.1.17.Final.pom 2019-11-28T22:00:30.969 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-remote-driver/2.44.0/selenium-remote-driver-2.44.0.pom 2019-11-28T22:00:30.969 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/htmlunit/htmlunit/2.15/htmlunit-2.15.pom 2019-11-28T22:00:30.970 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-exec/1.1/commons-exec-1.1.pom 2019-11-28T22:00:30.970 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/commons-io/commons-io/2.4/commons-io-2.4.pom 2019-11-28T22:00:31.067 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/17/commons-parent-17.pom 2019-11-28T22:00:31.067 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/25/commons-parent-25.pom 2019-11-28T22:00:31.067 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/7/apache-7.pom 2019-11-28T22:00:31.068 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/9/apache-9.pom 2019-11-28T22:00:31.068 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/net/java/dev/jna/jna/3.4.0/jna-3.4.0.pom 2019-11-28T22:00:31.069 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/net/java/dev/jna/platform/3.4.0/platform-3.4.0.pom 2019-11-28T22:00:31.069 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty/3.5.2.Final/netty-3.5.2.Final.pom 2019-11-28T22:00:31.069 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2019-11-28T22:00:31.069 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-common/4.1.17.Final/netty-common-4.1.17.Final.pom 2019-11-28T22:00:31.167 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-resolver/4.1.17.Final/netty-resolver-4.1.17.Final.pom 2019-11-28T22:00:31.167 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/google/guava/guava/18.0/guava-18.0.pom 2019-11-28T22:00:31.167 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/cglib/cglib-nodep/2.1_3/cglib-nodep-2.1_3.pom 2019-11-28T22:00:31.167 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-api/2.44.0/selenium-api-2.44.0.pom 2019-11-28T22:00:31.171 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/google/code/gson/gson/2.3/gson-2.3.pom 2019-11-28T22:00:31.171 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/18.0/guava-parent-18.0.pom 2019-11-28T22:00:31.171 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/htmlunit/htmlunit-core-js/2.15/htmlunit-core-js-2.15.pom 2019-11-28T22:00:31.171 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpmime/4.3.3/httpmime-4.3.3.pom 2019-11-28T22:00:31.171 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/cssparser/cssparser/0.9.14/cssparser-0.9.14.pom 2019-11-28T22:00:31.171 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/xalan/xalan/2.7.1/xalan-2.7.1.pom 2019-11-28T22:00:31.172 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.3.2/commons-lang3-3.3.2.pom 2019-11-28T22:00:31.172 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.pom 2019-11-28T22:00:31.172 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/nekohtml/nekohtml/1.9.21/nekohtml-1.9.21.pom 2019-11-28T22:00:31.172 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/xerces/xercesImpl/2.11.0/xercesImpl-2.11.0.pom 2019-11-28T22:00:31.172 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/4/apache-4.pom 2019-11-28T22:00:31.173 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-websocket/8.1.15.v20140411/jetty-websocket-8.1.15.v20140411.pom 2019-11-28T22:00:31.173 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/9/commons-parent-9.pom 2019-11-28T22:00:31.173 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.3.3/httpcomponents-client-4.3.3.pom 2019-11-28T22:00:31.173 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/33/commons-parent-33.pom 2019-11-28T22:00:31.173 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/project/7/project-7.pom 2019-11-28T22:00:31.173 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-project/8.1.15.v20140411/jetty-project-8.1.15.v20140411.pom 2019-11-28T22:00:31.174 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-parent/20/jetty-parent-20.pom 2019-11-28T22:00:31.266 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/xalan/serializer/2.7.1/serializer-2.7.1.pom 2019-11-28T22:00:31.267 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/xml-apis/xml-apis/1.4.01/xml-apis-1.4.01.pom 2019-11-28T22:00:31.267 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/w3c/css/sac/1.3/sac-1.3.pom 2019-11-28T22:00:31.267 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-io/8.1.15.v20140411/jetty-io-8.1.15.v20140411.pom 2019-11-28T22:00:31.267 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-http/8.1.15.v20140411/jetty-http-8.1.15.v20140411.pom 2019-11-28T22:00:31.267 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-util/8.1.15.v20140411/jetty-util-8.1.15.v20140411.pom 2019-11-28T22:00:32.069 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-s3control/1.11.549/aws-java-sdk-s3control-1.11.549.jar 2019-11-28T22:00:32.070 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudwatchmetrics/1.11.549/aws-java-sdk-cloudwatchmetrics-1.11.549.jar 2019-11-28T22:00:32.070 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk/1.11.549/aws-java-sdk-1.11.549.jar 2019-11-28T22:00:32.070 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-glacier/1.11.549/aws-java-sdk-glacier-1.11.549.jar 2019-11-28T22:00:32.070 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dynamodb/1.11.549/aws-java-sdk-dynamodb-1.11.549.jar 2019-11-28T22:00:32.070 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sns/1.11.549/aws-java-sdk-sns-1.11.549.jar 2019-11-28T22:00:32.070 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-s3/1.11.549/aws-java-sdk-s3-1.11.549.jar 2019-11-28T22:00:32.071 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sqs/1.11.549/aws-java-sdk-sqs-1.11.549.jar 2019-11-28T22:00:32.071 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-managedblockchain/1.11.549/aws-java-sdk-managedblockchain-1.11.549.jar 2019-11-28T22:00:32.071 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-textract/1.11.549/aws-java-sdk-textract-1.11.549.jar 2019-11-28T22:00:32.071 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-worklink/1.11.549/aws-java-sdk-worklink-1.11.549.jar 2019-11-28T22:00:32.071 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-backup/1.11.549/aws-java-sdk-backup-1.11.549.jar 2019-11-28T22:00:32.071 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-docdb/1.11.549/aws-java-sdk-docdb-1.11.549.jar 2019-11-28T22:00:32.072 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-apigatewayv2/1.11.549/aws-java-sdk-apigatewayv2-1.11.549.jar 2019-11-28T22:00:32.072 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-apigatewaymanagementapi/1.11.549/aws-java-sdk-apigatewaymanagementapi-1.11.549.jar 2019-11-28T22:00:32.073 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kafka/1.11.549/aws-java-sdk-kafka-1.11.549.jar 2019-11-28T22:00:32.073 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appmesh/1.11.549/aws-java-sdk-appmesh-1.11.549.jar 2019-11-28T22:00:32.073 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-licensemanager/1.11.549/aws-java-sdk-licensemanager-1.11.549.jar 2019-11-28T22:00:32.167 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-securityhub/1.11.549/aws-java-sdk-securityhub-1.11.549.jar 2019-11-28T22:00:32.167 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-fsx/1.11.549/aws-java-sdk-fsx-1.11.549.jar 2019-11-28T22:00:32.168 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediaconnect/1.11.549/aws-java-sdk-mediaconnect-1.11.549.jar 2019-11-28T22:00:32.168 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesisanalyticsv2/1.11.549/aws-java-sdk-kinesisanalyticsv2-1.11.549.jar 2019-11-28T22:00:32.168 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-comprehendmedical/1.11.549/aws-java-sdk-comprehendmedical-1.11.549.jar 2019-11-28T22:00:32.168 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-globalaccelerator/1.11.549/aws-java-sdk-globalaccelerator-1.11.549.jar 2019-11-28T22:00:32.168 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-transfer/1.11.549/aws-java-sdk-transfer-1.11.549.jar 2019-11-28T22:00:32.168 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-datasync/1.11.549/aws-java-sdk-datasync-1.11.549.jar 2019-11-28T22:00:32.169 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-robomaker/1.11.549/aws-java-sdk-robomaker-1.11.549.jar 2019-11-28T22:00:32.169 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rdsdata/1.11.549/aws-java-sdk-rdsdata-1.11.549.jar 2019-11-28T22:00:32.169 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-quicksight/1.11.549/aws-java-sdk-quicksight-1.11.549.jar 2019-11-28T22:00:32.169 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-amplify/1.11.549/aws-java-sdk-amplify-1.11.549.jar 2019-11-28T22:00:32.169 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-route53resolver/1.11.549/aws-java-sdk-route53resolver-1.11.549.jar 2019-11-28T22:00:32.169 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpointsmsvoice/1.11.549/aws-java-sdk-pinpointsmsvoice-1.11.549.jar 2019-11-28T22:00:32.169 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ram/1.11.549/aws-java-sdk-ram-1.11.549.jar 2019-11-28T22:00:32.170 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpointemail/1.11.549/aws-java-sdk-pinpointemail-1.11.549.jar 2019-11-28T22:00:32.170 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-signer/1.11.549/aws-java-sdk-signer-1.11.549.jar 2019-11-28T22:00:32.170 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-macie/1.11.549/aws-java-sdk-macie-1.11.549.jar 2019-11-28T22:00:32.170 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediatailor/1.11.549/aws-java-sdk-mediatailor-1.11.549.jar 2019-11-28T22:00:32.267 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-eks/1.11.549/aws-java-sdk-eks-1.11.549.jar 2019-11-28T22:00:32.267 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dlm/1.11.549/aws-java-sdk-dlm-1.11.549.jar 2019-11-28T22:00:32.267 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-neptune/1.11.549/aws-java-sdk-neptune-1.11.549.jar 2019-11-28T22:00:32.267 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-chime/1.11.549/aws-java-sdk-chime-1.11.549.jar 2019-11-28T22:00:32.268 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pi/1.11.549/aws-java-sdk-pi-1.11.549.jar 2019-11-28T22:00:32.268 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot1clickdevices/1.11.549/aws-java-sdk-iot1clickdevices-1.11.549.jar 2019-11-28T22:00:32.268 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot1clickprojects/1.11.549/aws-java-sdk-iot1clickprojects-1.11.549.jar 2019-11-28T22:00:32.268 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-secretsmanager/1.11.549/aws-java-sdk-secretsmanager-1.11.549.jar 2019-11-28T22:00:32.268 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iotanalytics/1.11.549/aws-java-sdk-iotanalytics-1.11.549.jar 2019-11-28T22:00:32.268 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-fms/1.11.549/aws-java-sdk-fms-1.11.549.jar 2019-11-28T22:00:32.269 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-acmpca/1.11.549/aws-java-sdk-acmpca-1.11.549.jar 2019-11-28T22:00:32.269 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-transcribe/1.11.549/aws-java-sdk-transcribe-1.11.549.jar 2019-11-28T22:00:32.269 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-connect/1.11.549/aws-java-sdk-connect-1.11.549.jar 2019-11-28T22:00:32.269 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-autoscalingplans/1.11.549/aws-java-sdk-autoscalingplans-1.11.549.jar 2019-11-28T22:00:32.269 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workmail/1.11.549/aws-java-sdk-workmail-1.11.549.jar 2019-11-28T22:00:32.269 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servicediscovery/1.11.549/aws-java-sdk-servicediscovery-1.11.549.jar 2019-11-28T22:00:32.269 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloud9/1.11.549/aws-java-sdk-cloud9-1.11.549.jar 2019-11-28T22:00:32.270 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-alexaforbusiness/1.11.549/aws-java-sdk-alexaforbusiness-1.11.549.jar 2019-11-28T22:00:32.270 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-comprehend/1.11.549/aws-java-sdk-comprehend-1.11.549.jar 2019-11-28T22:00:32.270 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-translate/1.11.549/aws-java-sdk-translate-1.11.549.jar 2019-11-28T22:00:32.270 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-serverlessapplicationrepository/1.11.549/aws-java-sdk-serverlessapplicationrepository-1.11.549.jar 2019-11-28T22:00:32.271 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-resourcegroups/1.11.549/aws-java-sdk-resourcegroups-1.11.549.jar 2019-11-28T22:00:32.271 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sagemakerruntime/1.11.549/aws-java-sdk-sagemakerruntime-1.11.549.jar 2019-11-28T22:00:32.271 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iotjobsdataplane/1.11.549/aws-java-sdk-iotjobsdataplane-1.11.549.jar 2019-11-28T22:00:32.271 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesisvideo/1.11.549/aws-java-sdk-kinesisvideo-1.11.549.jar 2019-11-28T22:00:32.271 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sagemaker/1.11.549/aws-java-sdk-sagemaker-1.11.549.jar 2019-11-28T22:00:32.271 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appsync/1.11.549/aws-java-sdk-appsync-1.11.549.jar 2019-11-28T22:00:32.271 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-guardduty/1.11.549/aws-java-sdk-guardduty-1.11.549.jar 2019-11-28T22:00:32.272 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mq/1.11.549/aws-java-sdk-mq-1.11.549.jar 2019-11-28T22:00:32.367 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediastore/1.11.549/aws-java-sdk-mediastore-1.11.549.jar 2019-11-28T22:00:32.368 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediaconvert/1.11.549/aws-java-sdk-mediaconvert-1.11.549.jar 2019-11-28T22:00:32.368 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediastoredata/1.11.549/aws-java-sdk-mediastoredata-1.11.549.jar 2019-11-28T22:00:32.368 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-medialive/1.11.549/aws-java-sdk-medialive-1.11.549.jar 2019-11-28T22:00:32.368 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediapackage/1.11.549/aws-java-sdk-mediapackage-1.11.549.jar 2019-11-28T22:00:32.368 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-costexplorer/1.11.549/aws-java-sdk-costexplorer-1.11.549.jar 2019-11-28T22:00:32.368 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mobile/1.11.549/aws-java-sdk-mobile-1.11.549.jar 2019-11-28T22:00:32.369 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pricing/1.11.549/aws-java-sdk-pricing-1.11.549.jar 2019-11-28T22:00:32.370 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudhsmv2/1.11.549/aws-java-sdk-cloudhsmv2-1.11.549.jar 2019-11-28T22:00:32.370 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-glue/1.11.549/aws-java-sdk-glue-1.11.549.jar 2019-11-28T22:00:32.371 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-migrationhub/1.11.549/aws-java-sdk-migrationhub-1.11.549.jar 2019-11-28T22:00:32.371 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dax/1.11.549/aws-java-sdk-dax-1.11.549.jar 2019-11-28T22:00:32.371 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-greengrass/1.11.549/aws-java-sdk-greengrass-1.11.549.jar 2019-11-28T22:00:32.371 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-athena/1.11.549/aws-java-sdk-athena-1.11.549.jar 2019-11-28T22:00:32.371 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplaceentitlement/1.11.549/aws-java-sdk-marketplaceentitlement-1.11.549.jar 2019-11-28T22:00:32.467 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lexmodelbuilding/1.11.549/aws-java-sdk-lexmodelbuilding-1.11.549.jar 2019-11-28T22:00:32.467 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codestar/1.11.549/aws-java-sdk-codestar-1.11.549.jar 2019-11-28T22:00:32.468 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-resourcegroupstaggingapi/1.11.549/aws-java-sdk-resourcegroupstaggingapi-1.11.549.jar 2019-11-28T22:00:32.468 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-opsworkscm/1.11.549/aws-java-sdk-opsworkscm-1.11.549.jar 2019-11-28T22:00:32.468 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-simpledb/1.11.549/aws-java-sdk-simpledb-1.11.549.jar 2019-11-28T22:00:32.468 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-xray/1.11.549/aws-java-sdk-xray-1.11.549.jar 2019-11-28T22:00:32.469 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpoint/1.11.549/aws-java-sdk-pinpoint-1.11.549.jar 2019-11-28T22:00:32.469 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servicecatalog/1.11.549/aws-java-sdk-servicecatalog-1.11.549.jar 2019-11-28T22:00:32.469 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-support/1.11.549/aws-java-sdk-support-1.11.549.jar 2019-11-28T22:00:32.470 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servermigration/1.11.549/aws-java-sdk-servermigration-1.11.549.jar 2019-11-28T22:00:32.470 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-simpleworkflow/1.11.549/aws-java-sdk-simpleworkflow-1.11.549.jar 2019-11-28T22:00:32.470 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-swf-libraries/1.11.22/aws-java-sdk-swf-libraries-1.11.22.jar 2019-11-28T22:00:32.470 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-storagegateway/1.11.549/aws-java-sdk-storagegateway-1.11.549.jar 2019-11-28T22:00:32.567 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-route53/1.11.549/aws-java-sdk-route53-1.11.549.jar 2019-11-28T22:00:32.567 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-importexport/1.11.549/aws-java-sdk-importexport-1.11.549.jar 2019-11-28T22:00:32.567 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sts/1.11.549/aws-java-sdk-sts-1.11.549.jar 2019-11-28T22:00:32.568 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticbeanstalk/1.11.549/aws-java-sdk-elasticbeanstalk-1.11.549.jar 2019-11-28T22:00:32.568 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-datapipeline/1.11.549/aws-java-sdk-datapipeline-1.11.549.jar 2019-11-28T22:00:32.568 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iam/1.11.549/aws-java-sdk-iam-1.11.549.jar 2019-11-28T22:00:32.568 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rds/1.11.549/aws-java-sdk-rds-1.11.549.jar 2019-11-28T22:00:32.568 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-redshift/1.11.549/aws-java-sdk-redshift-1.11.549.jar 2019-11-28T22:00:32.568 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticloadbalancing/1.11.549/aws-java-sdk-elasticloadbalancing-1.11.549.jar 2019-11-28T22:00:32.568 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticloadbalancingv2/1.11.549/aws-java-sdk-elasticloadbalancingv2-1.11.549.jar 2019-11-28T22:00:32.569 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-emr/1.11.549/aws-java-sdk-emr-1.11.549.jar 2019-11-28T22:00:32.569 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticache/1.11.549/aws-java-sdk-elasticache-1.11.549.jar 2019-11-28T22:00:32.569 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elastictranscoder/1.11.549/aws-java-sdk-elastictranscoder-1.11.549.jar 2019-11-28T22:00:32.569 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-budgets/1.11.549/aws-java-sdk-budgets-1.11.549.jar 2019-11-28T22:00:32.569 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ec2/1.11.549/aws-java-sdk-ec2-1.11.549.jar 2019-11-28T22:00:32.667 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudtrail/1.11.549/aws-java-sdk-cloudtrail-1.11.549.jar 2019-11-28T22:00:32.667 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudwatch/1.11.549/aws-java-sdk-cloudwatch-1.11.549.jar 2019-11-28T22:00:32.667 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-events/1.11.549/aws-java-sdk-events-1.11.549.jar 2019-11-28T22:00:32.668 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitoidentity/1.11.549/aws-java-sdk-cognitoidentity-1.11.549.jar 2019-11-28T22:00:32.668 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-logs/1.11.549/aws-java-sdk-logs-1.11.549.jar 2019-11-28T22:00:32.668 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-directconnect/1.11.549/aws-java-sdk-directconnect-1.11.549.jar 2019-11-28T22:00:32.669 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudfront/1.11.549/aws-java-sdk-cloudfront-1.11.549.jar 2019-11-28T22:00:32.669 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesis/1.11.549/aws-java-sdk-kinesis-1.11.549.jar 2019-11-28T22:00:32.669 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudformation/1.11.549/aws-java-sdk-cloudformation-1.11.549.jar 2019-11-28T22:00:32.669 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-clouddirectory/1.11.549/aws-java-sdk-clouddirectory-1.11.549.jar 2019-11-28T22:00:32.669 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitosync/1.11.549/aws-java-sdk-cognitosync-1.11.549.jar 2019-11-28T22:00:32.669 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-opsworks/1.11.549/aws-java-sdk-opsworks-1.11.549.jar 2019-11-28T22:00:32.767 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ses/1.11.549/aws-java-sdk-ses-1.11.549.jar 2019-11-28T22:00:32.767 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-autoscaling/1.11.549/aws-java-sdk-autoscaling-1.11.549.jar 2019-11-28T22:00:32.767 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudsearch/1.11.549/aws-java-sdk-cloudsearch-1.11.549.jar 2019-11-28T22:00:32.767 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codedeploy/1.11.549/aws-java-sdk-codedeploy-1.11.549.jar 2019-11-28T22:00:32.767 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codepipeline/1.11.549/aws-java-sdk-codepipeline-1.11.549.jar 2019-11-28T22:00:32.767 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-config/1.11.549/aws-java-sdk-config-1.11.549.jar 2019-11-28T22:00:32.768 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kms/1.11.549/aws-java-sdk-kms-1.11.549.jar 2019-11-28T22:00:32.769 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lambda/1.11.549/aws-java-sdk-lambda-1.11.549.jar 2019-11-28T22:00:32.769 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ecs/1.11.549/aws-java-sdk-ecs-1.11.549.jar 2019-11-28T22:00:32.769 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ecr/1.11.549/aws-java-sdk-ecr-1.11.549.jar 2019-11-28T22:00:32.769 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ssm/1.11.549/aws-java-sdk-ssm-1.11.549.jar 2019-11-28T22:00:32.769 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudhsm/1.11.549/aws-java-sdk-cloudhsm-1.11.549.jar 2019-11-28T22:00:32.769 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workspaces/1.11.549/aws-java-sdk-workspaces-1.11.549.jar 2019-11-28T22:00:32.769 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-directory/1.11.549/aws-java-sdk-directory-1.11.549.jar 2019-11-28T22:00:32.770 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-machinelearning/1.11.549/aws-java-sdk-machinelearning-1.11.549.jar 2019-11-28T22:00:32.877 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-devicefarm/1.11.549/aws-java-sdk-devicefarm-1.11.549.jar 2019-11-28T22:00:32.878 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-efs/1.11.549/aws-java-sdk-efs-1.11.549.jar 2019-11-28T22:00:32.878 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplacecommerceanalytics/1.11.549/aws-java-sdk-marketplacecommerceanalytics-1.11.549.jar 2019-11-28T22:00:32.879 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticsearch/1.11.549/aws-java-sdk-elasticsearch-1.11.549.jar 2019-11-28T22:00:32.879 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-waf/1.11.549/aws-java-sdk-waf-1.11.549.jar 2019-11-28T22:00:32.880 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-inspector/1.11.549/aws-java-sdk-inspector-1.11.549.jar 2019-11-28T22:00:32.880 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot/1.11.549/aws-java-sdk-iot-1.11.549.jar 2019-11-28T22:00:32.881 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codecommit/1.11.549/aws-java-sdk-codecommit-1.11.549.jar 2019-11-28T22:00:32.881 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-acm/1.11.549/aws-java-sdk-acm-1.11.549.jar 2019-11-28T22:00:32.881 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-gamelift/1.11.549/aws-java-sdk-gamelift-1.11.549.jar 2019-11-28T22:00:32.967 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-api-gateway/1.11.549/aws-java-sdk-api-gateway-1.11.549.jar 2019-11-28T22:00:32.968 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplacemeteringservice/1.11.549/aws-java-sdk-marketplacemeteringservice-1.11.549.jar 2019-11-28T22:00:32.968 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dms/1.11.549/aws-java-sdk-dms-1.11.549.jar 2019-11-28T22:00:32.968 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-discovery/1.11.549/aws-java-sdk-discovery-1.11.549.jar 2019-11-28T22:00:32.969 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-applicationautoscaling/1.11.549/aws-java-sdk-applicationautoscaling-1.11.549.jar 2019-11-28T22:00:32.969 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitoidp/1.11.549/aws-java-sdk-cognitoidp-1.11.549.jar 2019-11-28T22:00:32.969 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-snowball/1.11.549/aws-java-sdk-snowball-1.11.549.jar 2019-11-28T22:00:32.969 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rekognition/1.11.549/aws-java-sdk-rekognition-1.11.549.jar 2019-11-28T22:00:32.970 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-polly/1.11.549/aws-java-sdk-polly-1.11.549.jar 2019-11-28T22:00:32.970 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lightsail/1.11.549/aws-java-sdk-lightsail-1.11.549.jar 2019-11-28T22:00:32.971 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-stepfunctions/1.11.549/aws-java-sdk-stepfunctions-1.11.549.jar 2019-11-28T22:00:32.971 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-shield/1.11.549/aws-java-sdk-shield-1.11.549.jar 2019-11-28T22:00:32.971 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appstream/1.11.549/aws-java-sdk-appstream-1.11.549.jar 2019-11-28T22:00:32.971 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-health/1.11.549/aws-java-sdk-health-1.11.549.jar 2019-11-28T22:00:32.971 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-batch/1.11.549/aws-java-sdk-batch-1.11.549.jar 2019-11-28T22:00:32.972 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-costandusagereport/1.11.549/aws-java-sdk-costandusagereport-1.11.549.jar 2019-11-28T22:00:32.972 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codebuild/1.11.549/aws-java-sdk-codebuild-1.11.549.jar 2019-11-28T22:00:33.067 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lex/1.11.549/aws-java-sdk-lex-1.11.549.jar 2019-11-28T22:00:33.067 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mechanicalturkrequester/1.11.549/aws-java-sdk-mechanicalturkrequester-1.11.549.jar 2019-11-28T22:00:33.067 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workdocs/1.11.549/aws-java-sdk-workdocs-1.11.549.jar 2019-11-28T22:00:33.067 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/testng/testng/6.1.1/testng-6.1.1.jar 2019-11-28T22:00:33.067 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-core/1.11.549/aws-java-sdk-core-1.11.549.jar 2019-11-28T22:00:33.067 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-organizations/1.11.549/aws-java-sdk-organizations-1.11.549.jar 2019-11-28T22:00:33.068 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-server/2.44.0/selenium-server-2.44.0.jar 2019-11-28T22:00:33.068 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/log4j/log4j/1.2.17/log4j-1.2.17.jar 2019-11-28T22:00:33.068 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-java/2.44.0/selenium-java-2.44.0.jar 2019-11-28T22:00:33.068 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-htmlunit-driver/2.44.0/selenium-htmlunit-driver-2.44.0.jar 2019-11-28T22:00:33.068 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-ie-driver/2.44.0/selenium-ie-driver-2.44.0.jar 2019-11-28T22:00:33.068 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-chrome-driver/2.44.0/selenium-chrome-driver-2.44.0.jar 2019-11-28T22:00:33.068 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-firefox-driver/2.44.0/selenium-firefox-driver-2.44.0.jar 2019-11-28T22:00:33.069 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-safari-driver/2.44.0/selenium-safari-driver-2.44.0.jar 2019-11-28T22:00:33.069 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-support/2.44.0/selenium-support-2.44.0.jar 2019-11-28T22:00:33.069 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpmime/4.3.3/httpmime-4.3.3.jar 2019-11-28T22:00:33.070 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-remote-driver/2.44.0/selenium-remote-driver-2.44.0.jar 2019-11-28T22:00:33.070 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.5/httpclient-4.5.5.jar 2019-11-28T22:00:33.070 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/htmlunit/htmlunit/2.15/htmlunit-2.15.jar 2019-11-28T22:00:33.070 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/commons-logging/commons-logging/1.2/commons-logging-1.2.jar 2019-11-28T22:00:33.070 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/software/amazon/ion/ion-java/1.0.2/ion-java-1.0.2.jar 2019-11-28T22:00:33.070 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/jmespath-java/1.11.549/jmespath-java-1.11.549.jar 2019-11-28T22:00:33.071 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-databind/2.6.7.2/jackson-databind-2.6.7.2.jar 2019-11-28T22:00:33.071 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/dataformat/jackson-dataformat-cbor/2.6.7/jackson-dataformat-cbor-2.6.7.jar 2019-11-28T22:00:33.071 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/joda-time/joda-time/2.8.1/joda-time-2.8.1.jar 2019-11-28T22:00:33.167 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/bouncycastle/bcpkix-jdk15on/1.48/bcpkix-jdk15on-1.48.jar 2019-11-28T22:00:33.168 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/mx4j/mx4j-tools/3.0.1/mx4j-tools-3.0.1.jar 2019-11-28T22:00:33.168 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/bouncycastle/bcprov-jdk15on/1.48/bcprov-jdk15on-1.48.jar 2019-11-28T22:00:33.168 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/mortbay/jetty/servlet-api-2.5/6.1.9/servlet-api-2.5-6.1.9.jar 2019-11-28T22:00:33.169 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-models/1.11.549/aws-java-sdk-models-1.11.549.jar 2019-11-28T22:00:33.169 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/net/jcip/jcip-annotations/1.0/jcip-annotations-1.0.jar 2019-11-28T22:00:33.169 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.10/commons-codec-1.10.jar 2019-11-28T22:00:33.169 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/jetty-rc-repacked/5/jetty-rc-repacked-5.jar 2019-11-28T22:00:33.169 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/yaml/snakeyaml/1.8/snakeyaml-1.8.jar 2019-11-28T22:00:33.169 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/jetty-repacked/7.6.1/jetty-repacked-7.6.1.jar 2019-11-28T22:00:33.169 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/junit/junit/3.8.1/junit-3.8.1.jar 2019-11-28T22:00:33.170 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/beanshell/bsh/2.0b4/bsh-2.0b4.jar 2019-11-28T22:00:33.170 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/beust/jcommander/1.12/jcommander-1.12.jar 2019-11-28T22:00:33.170 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.9/httpcore-4.4.9.jar 2019-11-28T22:00:33.170 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-annotations/2.6.0/jackson-annotations-2.6.0.jar 2019-11-28T22:00:33.268 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-codec-http/4.1.17.Final/netty-codec-http-4.1.17.Final.jar 2019-11-28T22:00:33.269 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-codec/4.1.17.Final/netty-codec-4.1.17.Final.jar 2019-11-28T22:00:33.269 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/webbitserver/webbit/0.4.14/webbit-0.4.14.jar 2019-11-28T22:00:33.269 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-core/2.6.7/jackson-core-2.6.7.jar 2019-11-28T22:00:33.269 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-handler/4.1.17.Final/netty-handler-4.1.17.Final.jar 2019-11-28T22:00:33.269 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-transport/4.1.17.Final/netty-transport-4.1.17.Final.jar 2019-11-28T22:00:33.269 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-buffer/4.1.17.Final/netty-buffer-4.1.17.Final.jar 2019-11-28T22:00:33.270 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/commons-io/commons-io/2.4/commons-io-2.4.jar 2019-11-28T22:00:33.270 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty/3.5.2.Final/netty-3.5.2.Final.jar 2019-11-28T22:00:33.270 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-common/4.1.17.Final/netty-common-4.1.17.Final.jar 2019-11-28T22:00:33.270 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-exec/1.1/commons-exec-1.1.jar 2019-11-28T22:00:33.270 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-resolver/4.1.17.Final/netty-resolver-4.1.17.Final.jar 2019-11-28T22:00:33.270 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/net/java/dev/jna/jna/3.4.0/jna-3.4.0.jar 2019-11-28T22:00:33.270 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/net/java/dev/jna/platform/3.4.0/platform-3.4.0.jar 2019-11-28T22:00:33.271 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/cglib/cglib-nodep/2.1_3/cglib-nodep-2.1_3.jar 2019-11-28T22:00:33.271 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-api/2.44.0/selenium-api-2.44.0.jar 2019-11-28T22:00:33.271 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/google/code/gson/gson/2.3/gson-2.3.jar 2019-11-28T22:00:33.271 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/com/google/guava/guava/18.0/guava-18.0.jar 2019-11-28T22:00:33.271 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/xalan/xalan/2.7.1/xalan-2.7.1.jar 2019-11-28T22:00:33.271 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar 2019-11-28T22:00:33.272 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.3.2/commons-lang3-3.3.2.jar 2019-11-28T22:00:33.368 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/xerces/xercesImpl/2.11.0/xercesImpl-2.11.0.jar 2019-11-28T22:00:33.368 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/htmlunit/htmlunit-core-js/2.15/htmlunit-core-js-2.15.jar 2019-11-28T22:00:33.368 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/nekohtml/nekohtml/1.9.21/nekohtml-1.9.21.jar 2019-11-28T22:00:33.369 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/cssparser/cssparser/0.9.14/cssparser-0.9.14.jar 2019-11-28T22:00:33.369 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-websocket/8.1.15.v20140411/jetty-websocket-8.1.15.v20140411.jar 2019-11-28T22:00:33.369 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/xalan/serializer/2.7.1/serializer-2.7.1.jar 2019-11-28T22:00:33.369 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/xml-apis/xml-apis/1.4.01/xml-apis-1.4.01.jar 2019-11-28T22:00:33.369 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/w3c/css/sac/1.3/sac-1.3.jar 2019-11-28T22:00:33.370 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-io/8.1.15.v20140411/jetty-io-8.1.15.v20140411.jar 2019-11-28T22:00:33.466 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-http/8.1.15.v20140411/jetty-http-8.1.15.v20140411.jar 2019-11-28T22:00:33.466 INFO:teuthology.orchestra.run.smithi074.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-util/8.1.15.v20140411/jetty-util-8.1.15.v20140411.jar 2019-11-28T22:00:42.066 INFO:teuthology.orchestra.run.smithi074.stdout:> Task :compileJava 2019-11-28T22:00:42.066 INFO:teuthology.orchestra.run.smithi074.stdout:> Task :processResources 2019-11-28T22:00:42.166 INFO:teuthology.orchestra.run.smithi074.stdout:> Task :classes 2019-11-28T22:00:42.666 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:00:42.667 INFO:teuthology.orchestra.run.smithi074.stdout:> Task :compileTestJava 2019-11-28T22:00:42.667 INFO:teuthology.orchestra.run.smithi074.stdout:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2019-11-28T22:00:42.667 INFO:teuthology.orchestra.run.smithi074.stdout:Note: Recompile with -Xlint:deprecation for details. 2019-11-28T22:00:42.667 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:00:42.667 INFO:teuthology.orchestra.run.smithi074.stdout:> Task :processTestResources NO-SOURCE 2019-11-28T22:00:42.667 INFO:teuthology.orchestra.run.smithi074.stdout:> Task :testClasses 2019-11-28T22:00:50.066 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:00:50.066 INFO:teuthology.orchestra.run.smithi074.stdout:> Task :test 2019-11-28T22:00:50.066 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:00:50.066 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2019-11-28T22:01:24.865 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:01:24.865 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2019-11-28T22:01:30.665 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:01:30.665 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2019-11-28T22:01:33.665 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:01:33.665 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2019-11-28T22:01:39.264 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:01:39.265 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2019-11-28T22:01:57.564 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:01:57.565 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2019-11-28T22:02:06.664 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:02:06.664 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2019-11-28T22:02:06.964 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:02:06.964 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2019-11-28T22:02:07.665 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:02:07.666 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2019-11-28T22:02:10.464 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:02:10.872 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2019-11-28T22:02:15.364 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:02:15.365 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2019-11-28T22:02:40.174 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:16:22.411 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:02:40.212 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:16:22.449 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:02:40.215 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:16:22.453 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:02:40.228 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:16:22.475 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:02:40.233 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:16:22.481 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:02:40.234 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:16:22.473 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:02:40.411 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:16:22.659 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:02:40.415 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:16:22.654 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:02:40.417 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:16:22.654 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:02:53.664 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:02:53.664 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2019-11-28T22:03:08.164 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:03:08.165 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2019-11-28T22:03:46.110 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:17:28.344 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:03:46.113 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:17:28.347 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:03:46.168 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:17:28.412 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:03:46.170 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:17:28.415 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:03:46.174 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:17:28.409 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:03:46.175 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:17:28.411 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:03:46.207 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:17:28.441 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:03:46.224 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:17:28.459 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:03:46.247 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:17:28.491 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:06:06.874 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:06:06.888 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2019-11-28T22:06:22.274 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:06:22.274 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2019-11-28T22:06:25.274 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:06:25.274 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2019-11-28T22:06:30.274 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:06:30.274 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2019-11-28T22:06:34.175 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:06:34.175 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2019-11-28T22:06:44.775 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:06:44.776 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2019-11-28T22:07:02.275 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:07:02.276 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2019-11-28T22:07:08.575 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:07:08.576 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2019-11-28T22:07:09.176 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:07:09.176 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2019-11-28T22:07:10.276 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:07:10.276 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2019-11-28T22:07:29.527 INFO:tasks.rgw.client.0.smithi074.stdout:2019-11-28T22:07:29.491+0000 40a60700 -1 handle_data failed with exit code -5 2019-11-28T22:07:30.276 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:07:30.276 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2019-11-28T22:07:35.476 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:07:35.477 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2019-11-28T22:07:51.726 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:21:33.950 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:07:51.759 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:21:33.985 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:07:51.769 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:21:34.003 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:07:51.771 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:21:33.995 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:07:51.771 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:21:34.005 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:07:51.772 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:21:33.996 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:07:51.909 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:21:34.135 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:07:51.921 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:21:34.146 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:07:51.922 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:21:34.157 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:08:09.277 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:08:09.277 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2019-11-28T22:08:19.377 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:08:25.054 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2019-11-28T22:08:36.977 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:08:36.978 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2019-11-28T22:08:42.878 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:08:42.878 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2019-11-28T22:12:07.311 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:25:49.531 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:12:07.346 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:25:49.547 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:12:07.347 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:25:49.561 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:12:07.356 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:25:49.578 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:12:07.361 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:25:49.592 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:12:07.369 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:25:49.600 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:12:07.440 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:25:49.661 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:12:07.472 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:25:49.692 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:12:07.589 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:25:49.819 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:16:17.082 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:16:17.089 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2019-11-28T22:16:24.382 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:16:24.382 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2019-11-28T22:17:11.682 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:17:11.682 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2019-11-28T22:17:18.782 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:17:18.782 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2019-11-28T22:17:58.682 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:17:58.723 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2019-11-28T22:18:06.682 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:18:06.682 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2019-11-28T22:18:15.241 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:31:57.459 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:18:15.250 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:31:57.468 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:18:15.254 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:31:57.482 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:18:15.255 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:31:57.475 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:18:15.260 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:31:57.488 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:18:15.261 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:31:57.481 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:18:15.382 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:18:15.382 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2019-11-28T22:18:15.474 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:31:57.703 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:18:15.481 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:31:57.700 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:18:15.521 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:31:57.741 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:18:28.982 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:18:28.982 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2019-11-28T22:18:31.082 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:18:31.083 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2019-11-28T22:18:35.282 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:18:35.282 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2019-11-28T22:18:38.182 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:18:38.183 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2019-11-28T22:18:44.982 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:18:44.982 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2019-11-28T22:18:47.082 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:18:47.083 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2019-11-28T22:18:54.382 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:18:54.383 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2019-11-28T22:18:58.383 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:18:58.383 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2019-11-28T22:19:04.082 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:19:04.083 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2019-11-28T22:19:06.482 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:19:06.483 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2019-11-28T22:19:13.182 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:19:13.183 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2019-11-28T22:19:15.882 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:19:15.883 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2019-11-28T22:19:20.082 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:19:20.083 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2019-11-28T22:19:21.782 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:19:21.783 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2019-11-28T22:19:25.482 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:19:25.483 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2019-11-28T22:19:58.183 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:19:58.183 INFO:teuthology.orchestra.run.smithi074.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2019-11-28T22:20:04.869 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:20:04.869 INFO:teuthology.orchestra.run.smithi074.stdout:---------------------------------------------------------------------- 2019-11-28T22:20:04.869 INFO:teuthology.orchestra.run.smithi074.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2019-11-28T22:20:04.870 INFO:teuthology.orchestra.run.smithi074.stdout:---------------------------------------------------------------------- 2019-11-28T22:20:04.870 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:20:04.870 INFO:teuthology.orchestra.run.smithi074.stdout:BUILD SUCCESSFUL in 19m 40s 2019-11-28T22:20:04.870 INFO:teuthology.orchestra.run.smithi074.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2019-11-28T22:20:05.186 INFO:teuthology.orchestra.run.smithi074:> radosgw-admin gc process --include-all 2019-11-28T22:20:05.322 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.320+0000 7f24584b9ec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:05.350 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.349+0000 7f24584b9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:20:05.350 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.349+0000 7f24584b9ec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:05.358 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.357+0000 7f24584b9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:20:05.358 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.357+0000 7f24584b9ec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:05.366 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.364+0000 7f24584b9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:20:05.366 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.364+0000 7f24584b9ec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:05.379 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.378+0000 7f24584b9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:20:05.589 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.587+0000 7f24584b9ec0 20 RGWRados::pool_iterate: got zonegroup_info.cb1773b4-411c-4317-a760-df89ca0f54fc 2019-11-28T22:20:05.589 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.587+0000 7f24584b9ec0 20 RGWRados::pool_iterate: got zone_info.bd5ae442-b074-4d35-94cc-b1d71bd6ac02 2019-11-28T22:20:05.589 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.587+0000 7f24584b9ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-28T22:20:05.590 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.587+0000 7f24584b9ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-28T22:20:05.590 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.587+0000 7f24584b9ec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:05.598 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.596+0000 7f24584b9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:20:05.598 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.596+0000 7f24584b9ec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:05.608 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.606+0000 7f24584b9ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T22:20:05.608 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.606+0000 7f24584b9ec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:05.618 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.616+0000 7f24584b9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:20:05.618 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.616+0000 7f24584b9ec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:05.628 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.626+0000 7f24584b9ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T22:20:05.628 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.626+0000 7f24584b9ec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:05.634 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.633+0000 7f24584b9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:20:05.634 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.633+0000 7f24584b9ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-28T22:20:05.635 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.633+0000 7f24584b9ec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:05.640 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.638+0000 7f24584b9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:20:05.640 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.639+0000 7f24584b9ec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:05.651 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.649+0000 7f24584b9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:20:05.651 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.649+0000 7f24584b9ec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:05.659 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.658+0000 7f24584b9ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T22:20:05.660 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.658+0000 7f24584b9ec0 20 zonegroup default 2019-11-28T22:20:05.660 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.658+0000 7f24584b9ec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:05.665 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.664+0000 7f24584b9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:20:05.666 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.664+0000 7f24584b9ec0 10 Cannot find current period zone using local zone 2019-11-28T22:20:05.666 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.664+0000 7f24584b9ec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:05.675 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.673+0000 7f24584b9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:20:05.675 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.673+0000 7f24584b9ec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:05.686 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.685+0000 7f24584b9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:20:05.686 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.685+0000 7f24584b9ec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:05.697 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.695+0000 7f24584b9ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T22:20:05.697 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.695+0000 7f24584b9ec0 20 zone default found 2019-11-28T22:20:05.697 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.695+0000 7f24584b9ec0 20 started sync module instance, tier type = 2019-11-28T22:20:05.697 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:05.695+0000 7f24584b9ec0 20 started zone id=bd5ae442-b074-4d35-94cc-b1d71bd6ac02 (name=default) with tier type = 2019-11-28T22:20:06.050 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:06.048+0000 7f24584b9ec0 20 add_watcher() i=0 2019-11-28T22:20:06.050 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:06.048+0000 7f24584b9ec0 20 add_watcher() i=1 2019-11-28T22:20:06.050 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:06.048+0000 7f24584b9ec0 20 add_watcher() i=2 2019-11-28T22:20:06.050 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:06.048+0000 7f24584b9ec0 20 add_watcher() i=3 2019-11-28T22:20:06.051 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:06.048+0000 7f24584b9ec0 20 add_watcher() i=4 2019-11-28T22:20:06.051 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:06.048+0000 7f24584b9ec0 20 add_watcher() i=5 2019-11-28T22:20:06.058 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:06.057+0000 7f24584b9ec0 20 add_watcher() i=6 2019-11-28T22:20:06.077 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:06.075+0000 7f24584b9ec0 20 add_watcher() i=7 2019-11-28T22:20:06.077 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:06.076+0000 7f24584b9ec0 2 all 8 watchers are set, enabling cache 2019-11-28T22:20:06.077 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:06.076+0000 7f2415fdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-28T22:20:06.081 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:06.080+0000 7f2445ee7700 0 -- 172.21.15.74:0/3756835822 >> v2:172.21.15.141:3300/0 conn(0x56247acfbd00 msgr2=0x56247ad10050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-28T22:20:06.117 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:06.116+0000 7f2444ee5700 0 -- 172.21.15.74:0/3540961380 >> [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] conn(0x56247ad44f50 msgr2=0x56247ad47370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-28T22:20:07.851 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:07.849+0000 7f2387fff700 20 reqs_thread_entry: start 2019-11-28T22:20:07.851 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:07.849+0000 7f2385ffb700 20 reqs_thread_entry: start 2019-11-28T22:20:07.851 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:07.850+0000 7f24584b9ec0 20 init_complete bucket index max shards: 0 2019-11-28T22:20:07.852 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:07.850+0000 7f2373fff700 20 reqs_thread_entry: start 2019-11-28T22:20:07.852 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:07.850+0000 7f24584b9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-28T22:20:07.913 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:07.912+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:07.931 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:07.929+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:07.949 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:07.948+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-28T22:20:07.950 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:07.948+0000 7f24584b9ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.386', time=2019-11-29T00:01:59.574046+0000, chain.objs.size()=9 2019-11-28T22:20:07.950 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:07.948+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.15__multipart_key1.2~SF6CAFukNHpPYFMKBJD6QmedCOAMwF9.1 2019-11-28T22:20:07.950 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:07.948+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.15__shadow_key1.2~SF6CAFukNHpPYFMKBJD6QmedCOAMwF9.1_1 2019-11-28T22:20:07.950 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:07.948+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.15__multipart_key1.2~SF6CAFukNHpPYFMKBJD6QmedCOAMwF9.2 2019-11-28T22:20:07.950 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:07.948+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.15__shadow_key1.2~SF6CAFukNHpPYFMKBJD6QmedCOAMwF9.2_1 2019-11-28T22:20:07.951 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:07.948+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.15__multipart_key1.2~SF6CAFukNHpPYFMKBJD6QmedCOAMwF9.3 2019-11-28T22:20:07.951 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:07.948+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.15__shadow_key1.2~SF6CAFukNHpPYFMKBJD6QmedCOAMwF9.3_1 2019-11-28T22:20:07.951 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:07.948+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.15__multipart_key1.2~SF6CAFukNHpPYFMKBJD6QmedCOAMwF9.4 2019-11-28T22:20:07.951 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:07.948+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.15__shadow_key1.2~SF6CAFukNHpPYFMKBJD6QmedCOAMwF9.4_1 2019-11-28T22:20:07.951 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:07.948+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.15__multipart_key1.2~SF6CAFukNHpPYFMKBJD6QmedCOAMwF9.5 2019-11-28T22:20:08.287 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:08.285+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:20:08.437 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:08.435+0000 7f24584b9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-28T22:20:08.485 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:08.483+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:08.500 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:08.499+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:08.509 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:08.507+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:08.550 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:08.548+0000 7f24584b9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-28T22:20:08.594 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:08.593+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:08.609 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:08.607+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:08.621 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:08.619+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-28T22:20:08.621 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:08.619+0000 7f24584b9ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.460', time=2019-11-29T00:05:45.494212+0000, chain.objs.size()=7 2019-11-28T22:20:08.621 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:08.619+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__multipart_key1.2~csKLs5PYgBkKXsFQ-vp4AZCpZ5tZ6Ht.1 2019-11-28T22:20:08.622 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:08.619+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__shadow_key1.2~csKLs5PYgBkKXsFQ-vp4AZCpZ5tZ6Ht.1_1 2019-11-28T22:20:08.622 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:08.619+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__shadow_key1.2~csKLs5PYgBkKXsFQ-vp4AZCpZ5tZ6Ht.1_2 2019-11-28T22:20:08.622 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:08.619+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__multipart_key1.2~csKLs5PYgBkKXsFQ-vp4AZCpZ5tZ6Ht.2 2019-11-28T22:20:08.622 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:08.619+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__shadow_key1.2~csKLs5PYgBkKXsFQ-vp4AZCpZ5tZ6Ht.2_1 2019-11-28T22:20:08.622 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:08.619+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__shadow_key1.2~csKLs5PYgBkKXsFQ-vp4AZCpZ5tZ6Ht.2_2 2019-11-28T22:20:08.622 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:08.619+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__multipart_key1.2~csKLs5PYgBkKXsFQ-vp4AZCpZ5tZ6Ht.3 2019-11-28T22:20:08.876 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:08.874+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:20:09.013 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:09.011+0000 7f24584b9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-28T22:20:09.149 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:09.094+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:09.149 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:09.126+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:09.159 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:09.157+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-28T22:20:09.160 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:09.157+0000 7f24584b9ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.628', time=2019-11-29T00:15:14.641333+0000, chain.objs.size()=16 2019-11-28T22:20:09.160 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:09.157+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~BVK_O0P6eBcR55iUpZrCuNp5E-z-IE5.1 2019-11-28T22:20:09.160 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:09.157+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~BVK_O0P6eBcR55iUpZrCuNp5E-z-IE5.1_1 2019-11-28T22:20:09.160 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:09.157+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~BVK_O0P6eBcR55iUpZrCuNp5E-z-IE5.1_2 2019-11-28T22:20:09.160 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:09.157+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~BVK_O0P6eBcR55iUpZrCuNp5E-z-IE5.2 2019-11-28T22:20:09.160 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:09.157+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~BVK_O0P6eBcR55iUpZrCuNp5E-z-IE5.2_1 2019-11-28T22:20:09.161 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:09.157+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~BVK_O0P6eBcR55iUpZrCuNp5E-z-IE5.2_2 2019-11-28T22:20:09.161 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:09.157+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~BVK_O0P6eBcR55iUpZrCuNp5E-z-IE5.3 2019-11-28T22:20:09.161 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:09.157+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~BVK_O0P6eBcR55iUpZrCuNp5E-z-IE5.3_1 2019-11-28T22:20:09.161 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:09.157+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~BVK_O0P6eBcR55iUpZrCuNp5E-z-IE5.3_2 2019-11-28T22:20:09.161 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:09.157+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~BVK_O0P6eBcR55iUpZrCuNp5E-z-IE5.4 2019-11-28T22:20:09.161 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:09.157+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~BVK_O0P6eBcR55iUpZrCuNp5E-z-IE5.4_1 2019-11-28T22:20:09.162 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:09.157+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~BVK_O0P6eBcR55iUpZrCuNp5E-z-IE5.4_2 2019-11-28T22:20:09.482 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:09.480+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~BVK_O0P6eBcR55iUpZrCuNp5E-z-IE5.5 2019-11-28T22:20:09.482 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:09.480+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~BVK_O0P6eBcR55iUpZrCuNp5E-z-IE5.5_1 2019-11-28T22:20:09.568 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:09.567+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~BVK_O0P6eBcR55iUpZrCuNp5E-z-IE5.5_2 2019-11-28T22:20:09.569 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:09.567+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~BVK_O0P6eBcR55iUpZrCuNp5E-z-IE5.6 2019-11-28T22:20:09.718 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:09.717+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:20:09.839 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:09.838+0000 7f24584b9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-28T22:20:09.881 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:09.879+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:09.896 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:09.894+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:09.904 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:09.903+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:09.941 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:09.939+0000 7f24584b9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-28T22:20:09.990 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:09.989+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:10.011 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.010+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:10.034 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.032+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-28T22:20:10.035 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.032+0000 7f24584b9ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~eFnFAOmWtajEsKWJTrmTXjAL7la-fhy', time=2019-11-29T00:01:24.357719+0000, chain.objs.size()=9 2019-11-28T22:20:10.035 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.032+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.13__multipart_key1.2~eFnFAOmWtajEsKWJTrmTXjAL7la-fhy.1 2019-11-28T22:20:10.035 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.032+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.13__shadow_key1.2~eFnFAOmWtajEsKWJTrmTXjAL7la-fhy.1_1 2019-11-28T22:20:10.035 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.032+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.13__multipart_key1.2~eFnFAOmWtajEsKWJTrmTXjAL7la-fhy.2 2019-11-28T22:20:10.035 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.032+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.13__shadow_key1.2~eFnFAOmWtajEsKWJTrmTXjAL7la-fhy.2_1 2019-11-28T22:20:10.035 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.032+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.13__multipart_key1.2~eFnFAOmWtajEsKWJTrmTXjAL7la-fhy.3 2019-11-28T22:20:10.036 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.032+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.13__shadow_key1.2~eFnFAOmWtajEsKWJTrmTXjAL7la-fhy.3_1 2019-11-28T22:20:10.036 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.032+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.13__multipart_key1.2~eFnFAOmWtajEsKWJTrmTXjAL7la-fhy.4 2019-11-28T22:20:10.036 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.032+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.13__shadow_key1.2~eFnFAOmWtajEsKWJTrmTXjAL7la-fhy.4_1 2019-11-28T22:20:10.036 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.032+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.13__multipart_key1.2~eFnFAOmWtajEsKWJTrmTXjAL7la-fhy.5 2019-11-28T22:20:10.339 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.338+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:20:10.430 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.429+0000 7f24584b9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-28T22:20:10.475 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.473+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:10.492 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.491+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:10.502 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.501+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:10.534 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.533+0000 7f24584b9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-28T22:20:10.596 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.595+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:10.615 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.614+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:10.628 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.626+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:10.662 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.660+0000 7f24584b9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-28T22:20:10.703 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.702+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:10.718 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.717+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:10.726 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.725+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:10.759 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.758+0000 7f24584b9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-28T22:20:10.809 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.808+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:10.831 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.829+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:10.857 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.856+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-28T22:20:10.858 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.856+0000 7f24584b9ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.528', time=2019-11-29T00:07:32.037708+0000, chain.objs.size()=9 2019-11-28T22:20:10.858 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.856+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.25__multipart_key1.2~Upjqyv49txrRsRErrBkJDVB5uAlfbkI.1 2019-11-28T22:20:10.858 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.856+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.25__shadow_key1.2~Upjqyv49txrRsRErrBkJDVB5uAlfbkI.1_1 2019-11-28T22:20:10.858 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.856+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.25__multipart_key1.2~Upjqyv49txrRsRErrBkJDVB5uAlfbkI.2 2019-11-28T22:20:10.858 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.856+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.25__shadow_key1.2~Upjqyv49txrRsRErrBkJDVB5uAlfbkI.2_1 2019-11-28T22:20:10.858 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.856+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.25__multipart_key1.2~Upjqyv49txrRsRErrBkJDVB5uAlfbkI.3 2019-11-28T22:20:10.859 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.856+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.25__shadow_key1.2~Upjqyv49txrRsRErrBkJDVB5uAlfbkI.3_1 2019-11-28T22:20:10.859 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.856+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.25__multipart_key1.2~Upjqyv49txrRsRErrBkJDVB5uAlfbkI.4 2019-11-28T22:20:10.859 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.856+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.25__shadow_key1.2~Upjqyv49txrRsRErrBkJDVB5uAlfbkI.4_1 2019-11-28T22:20:10.859 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.856+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.25__multipart_key1.2~Upjqyv49txrRsRErrBkJDVB5uAlfbkI.5 2019-11-28T22:20:10.859 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.856+0000 7f24584b9ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.636', time=2019-11-29T00:16:15.568049+0000, chain.objs.size()=16 2019-11-28T22:20:10.859 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.856+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~m8StHU7rnxhgjQcOtL43O0brLXSFaoI.1 2019-11-28T22:20:10.860 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.856+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~m8StHU7rnxhgjQcOtL43O0brLXSFaoI.1_1 2019-11-28T22:20:10.860 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:10.856+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~m8StHU7rnxhgjQcOtL43O0brLXSFaoI.1_2 2019-11-28T22:20:11.122 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:11.121+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~m8StHU7rnxhgjQcOtL43O0brLXSFaoI.2 2019-11-28T22:20:11.122 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:11.121+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~m8StHU7rnxhgjQcOtL43O0brLXSFaoI.2_1 2019-11-28T22:20:11.123 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:11.121+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~m8StHU7rnxhgjQcOtL43O0brLXSFaoI.2_2 2019-11-28T22:20:11.148 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:11.146+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~m8StHU7rnxhgjQcOtL43O0brLXSFaoI.3 2019-11-28T22:20:11.148 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:11.146+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~m8StHU7rnxhgjQcOtL43O0brLXSFaoI.3_1 2019-11-28T22:20:11.161 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:11.159+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~m8StHU7rnxhgjQcOtL43O0brLXSFaoI.3_2 2019-11-28T22:20:11.365 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:11.364+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~m8StHU7rnxhgjQcOtL43O0brLXSFaoI.4 2019-11-28T22:20:11.366 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:11.364+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~m8StHU7rnxhgjQcOtL43O0brLXSFaoI.4_1 2019-11-28T22:20:11.366 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:11.364+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~m8StHU7rnxhgjQcOtL43O0brLXSFaoI.4_2 2019-11-28T22:20:11.366 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:11.364+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~m8StHU7rnxhgjQcOtL43O0brLXSFaoI.5 2019-11-28T22:20:11.366 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:11.364+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~m8StHU7rnxhgjQcOtL43O0brLXSFaoI.5_1 2019-11-28T22:20:11.598 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:11.597+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~m8StHU7rnxhgjQcOtL43O0brLXSFaoI.5_2 2019-11-28T22:20:11.598 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:11.597+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~m8StHU7rnxhgjQcOtL43O0brLXSFaoI.6 2019-11-28T22:20:11.898 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:11.897+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:20:12.031 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:12.029+0000 7f24584b9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-28T22:20:12.093 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:12.092+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:12.120 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:12.119+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:12.167 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:12.165+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-28T22:20:12.167 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:12.165+0000 7f24584b9ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.595', time=2019-11-29T00:11:13.144010+0000, chain.objs.size()=21 2019-11-28T22:20:12.167 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:12.165+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~wF-dmE9pqWyW9zPskFg7p7YOmk-liX4.1 2019-11-28T22:20:12.168 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:12.165+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~wF-dmE9pqWyW9zPskFg7p7YOmk-liX4.1_1 2019-11-28T22:20:12.168 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:12.165+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~wF-dmE9pqWyW9zPskFg7p7YOmk-liX4.2 2019-11-28T22:20:12.168 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:12.165+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~wF-dmE9pqWyW9zPskFg7p7YOmk-liX4.2_1 2019-11-28T22:20:12.168 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:12.165+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~wF-dmE9pqWyW9zPskFg7p7YOmk-liX4.3 2019-11-28T22:20:12.168 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:12.165+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~wF-dmE9pqWyW9zPskFg7p7YOmk-liX4.3_1 2019-11-28T22:20:12.168 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:12.165+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~wF-dmE9pqWyW9zPskFg7p7YOmk-liX4.4 2019-11-28T22:20:12.168 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:12.165+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~wF-dmE9pqWyW9zPskFg7p7YOmk-liX4.4_1 2019-11-28T22:20:12.169 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:12.165+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~wF-dmE9pqWyW9zPskFg7p7YOmk-liX4.5 2019-11-28T22:20:12.169 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:12.165+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~wF-dmE9pqWyW9zPskFg7p7YOmk-liX4.5_1 2019-11-28T22:20:12.169 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:12.165+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~wF-dmE9pqWyW9zPskFg7p7YOmk-liX4.6 2019-11-28T22:20:12.169 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:12.165+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~wF-dmE9pqWyW9zPskFg7p7YOmk-liX4.6_1 2019-11-28T22:20:12.452 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:12.450+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~wF-dmE9pqWyW9zPskFg7p7YOmk-liX4.7 2019-11-28T22:20:12.452 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:12.450+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~wF-dmE9pqWyW9zPskFg7p7YOmk-liX4.7_1 2019-11-28T22:20:12.466 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:12.465+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~wF-dmE9pqWyW9zPskFg7p7YOmk-liX4.8 2019-11-28T22:20:12.467 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:12.465+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~wF-dmE9pqWyW9zPskFg7p7YOmk-liX4.8_1 2019-11-28T22:20:12.527 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:12.525+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~wF-dmE9pqWyW9zPskFg7p7YOmk-liX4.9 2019-11-28T22:20:12.527 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:12.525+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~wF-dmE9pqWyW9zPskFg7p7YOmk-liX4.9_1 2019-11-28T22:20:12.527 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:12.525+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~wF-dmE9pqWyW9zPskFg7p7YOmk-liX4.10 2019-11-28T22:20:12.528 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:12.525+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~wF-dmE9pqWyW9zPskFg7p7YOmk-liX4.10_1 2019-11-28T22:20:12.528 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:12.525+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~wF-dmE9pqWyW9zPskFg7p7YOmk-liX4.11 2019-11-28T22:20:12.528 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:12.525+0000 7f24584b9ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.644', time=2019-11-29T00:16:19.978021+0000, chain.objs.size()=16 2019-11-28T22:20:12.528 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:12.525+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~_u3-W44QMcBmMwjWBHgEa8XZu-tYhxw.1 2019-11-28T22:20:12.528 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:12.525+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~_u3-W44QMcBmMwjWBHgEa8XZu-tYhxw.1_1 2019-11-28T22:20:12.749 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:12.747+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~_u3-W44QMcBmMwjWBHgEa8XZu-tYhxw.1_2 2019-11-28T22:20:12.775 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:12.774+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~_u3-W44QMcBmMwjWBHgEa8XZu-tYhxw.2 2019-11-28T22:20:12.775 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:12.774+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~_u3-W44QMcBmMwjWBHgEa8XZu-tYhxw.2_1 2019-11-28T22:20:12.775 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:12.774+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~_u3-W44QMcBmMwjWBHgEa8XZu-tYhxw.2_2 2019-11-28T22:20:12.776 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:12.774+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~_u3-W44QMcBmMwjWBHgEa8XZu-tYhxw.3 2019-11-28T22:20:12.856 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:12.854+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~_u3-W44QMcBmMwjWBHgEa8XZu-tYhxw.3_1 2019-11-28T22:20:12.862 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:12.854+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~_u3-W44QMcBmMwjWBHgEa8XZu-tYhxw.3_2 2019-11-28T22:20:12.862 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:12.854+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~_u3-W44QMcBmMwjWBHgEa8XZu-tYhxw.4 2019-11-28T22:20:12.862 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:12.854+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~_u3-W44QMcBmMwjWBHgEa8XZu-tYhxw.4_1 2019-11-28T22:20:13.057 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:13.055+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~_u3-W44QMcBmMwjWBHgEa8XZu-tYhxw.4_2 2019-11-28T22:20:13.057 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:13.055+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~_u3-W44QMcBmMwjWBHgEa8XZu-tYhxw.5 2019-11-28T22:20:13.057 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:13.055+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~_u3-W44QMcBmMwjWBHgEa8XZu-tYhxw.5_1 2019-11-28T22:20:13.105 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:13.104+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~_u3-W44QMcBmMwjWBHgEa8XZu-tYhxw.5_2 2019-11-28T22:20:13.105 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:13.104+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~_u3-W44QMcBmMwjWBHgEa8XZu-tYhxw.6 2019-11-28T22:20:13.492 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:13.491+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:20:13.590 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:13.588+0000 7f24584b9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-28T22:20:13.639 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:13.638+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:13.657 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:13.655+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:13.667 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:13.665+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:13.705 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:13.704+0000 7f24584b9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-28T22:20:13.766 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:13.765+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:13.792 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:13.790+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:13.801 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:13.799+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:13.847 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:13.845+0000 7f24584b9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-28T22:20:13.909 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:13.907+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:13.933 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:13.931+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:13.963 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:13.960+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-28T22:20:13.963 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:13.960+0000 7f24584b9ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.620', time=2019-11-29T00:14:12.739031+0000, chain.objs.size()=19 2019-11-28T22:20:13.963 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:13.960+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~MTLhZWaqrU_xcB4pvei_81Io3twG03N.1 2019-11-28T22:20:13.963 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:13.960+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~MTLhZWaqrU_xcB4pvei_81Io3twG03N.1_1 2019-11-28T22:20:13.963 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:13.960+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~MTLhZWaqrU_xcB4pvei_81Io3twG03N.2 2019-11-28T22:20:13.964 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:13.960+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~MTLhZWaqrU_xcB4pvei_81Io3twG03N.2_1 2019-11-28T22:20:13.964 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:13.961+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~MTLhZWaqrU_xcB4pvei_81Io3twG03N.3 2019-11-28T22:20:13.964 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:13.961+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~MTLhZWaqrU_xcB4pvei_81Io3twG03N.3_1 2019-11-28T22:20:13.964 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:13.961+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~MTLhZWaqrU_xcB4pvei_81Io3twG03N.4 2019-11-28T22:20:13.964 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:13.961+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~MTLhZWaqrU_xcB4pvei_81Io3twG03N.4_1 2019-11-28T22:20:13.964 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:13.961+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~MTLhZWaqrU_xcB4pvei_81Io3twG03N.5 2019-11-28T22:20:13.964 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:13.961+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~MTLhZWaqrU_xcB4pvei_81Io3twG03N.5_1 2019-11-28T22:20:13.964 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:13.961+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~MTLhZWaqrU_xcB4pvei_81Io3twG03N.6 2019-11-28T22:20:13.965 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:13.961+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~MTLhZWaqrU_xcB4pvei_81Io3twG03N.6_1 2019-11-28T22:20:14.371 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:14.369+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~MTLhZWaqrU_xcB4pvei_81Io3twG03N.7 2019-11-28T22:20:14.371 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:14.369+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~MTLhZWaqrU_xcB4pvei_81Io3twG03N.7_1 2019-11-28T22:20:14.371 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:14.369+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~MTLhZWaqrU_xcB4pvei_81Io3twG03N.8 2019-11-28T22:20:14.371 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:14.369+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~MTLhZWaqrU_xcB4pvei_81Io3twG03N.8_1 2019-11-28T22:20:14.371 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:14.369+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~MTLhZWaqrU_xcB4pvei_81Io3twG03N.9 2019-11-28T22:20:14.371 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:14.369+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~MTLhZWaqrU_xcB4pvei_81Io3twG03N.9_1 2019-11-28T22:20:14.372 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:14.369+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~MTLhZWaqrU_xcB4pvei_81Io3twG03N.10 2019-11-28T22:20:14.718 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:14.716+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:20:14.820 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:14.819+0000 7f24584b9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-28T22:20:14.877 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:14.875+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:14.909 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:14.908+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:14.925 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:14.924+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:14.982 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:14.981+0000 7f24584b9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-28T22:20:15.065 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:15.064+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:15.108 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:15.106+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:15.132 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:15.130+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:15.205 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:15.203+0000 7f24584b9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-28T22:20:15.277 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:15.276+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:15.300 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:15.299+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:15.322 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:15.320+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-28T22:20:15.322 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:15.320+0000 7f24584b9ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.438', time=2019-11-29T00:04:32.655632+0000, chain.objs.size()=9 2019-11-28T22:20:15.322 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:15.320+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__multipart_key1.2~V6-3YtpiAnPbs0sZEj76IX7S_mFF66S.1 2019-11-28T22:20:15.323 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:15.320+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__shadow_key1.2~V6-3YtpiAnPbs0sZEj76IX7S_mFF66S.1_1 2019-11-28T22:20:15.323 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:15.320+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__multipart_key1.2~V6-3YtpiAnPbs0sZEj76IX7S_mFF66S.2 2019-11-28T22:20:15.323 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:15.320+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__shadow_key1.2~V6-3YtpiAnPbs0sZEj76IX7S_mFF66S.2_1 2019-11-28T22:20:15.323 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:15.320+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__multipart_key1.2~V6-3YtpiAnPbs0sZEj76IX7S_mFF66S.3 2019-11-28T22:20:15.323 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:15.320+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__shadow_key1.2~V6-3YtpiAnPbs0sZEj76IX7S_mFF66S.3_1 2019-11-28T22:20:15.323 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:15.320+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__multipart_key1.2~V6-3YtpiAnPbs0sZEj76IX7S_mFF66S.4 2019-11-28T22:20:15.323 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:15.320+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__shadow_key1.2~V6-3YtpiAnPbs0sZEj76IX7S_mFF66S.4_1 2019-11-28T22:20:15.324 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:15.320+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__multipart_key1.2~V6-3YtpiAnPbs0sZEj76IX7S_mFF66S.5 2019-11-28T22:20:15.684 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:15.683+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:20:15.752 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:15.751+0000 7f24584b9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-28T22:20:15.797 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:15.795+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:15.812 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:15.811+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:15.833 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:15.831+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-28T22:20:15.833 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:15.831+0000 7f24584b9ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.446', time=2019-11-29T00:04:59.633162+0000, chain.objs.size()=9 2019-11-28T22:20:15.833 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:15.831+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__multipart_key1.2~VXaSnHKe7Ikt0LOODXzz3CKpqD4Tdqv.1 2019-11-28T22:20:15.834 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:15.831+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__shadow_key1.2~VXaSnHKe7Ikt0LOODXzz3CKpqD4Tdqv.1_1 2019-11-28T22:20:15.834 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:15.831+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__multipart_key1.2~VXaSnHKe7Ikt0LOODXzz3CKpqD4Tdqv.2 2019-11-28T22:20:15.834 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:15.831+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__shadow_key1.2~VXaSnHKe7Ikt0LOODXzz3CKpqD4Tdqv.2_1 2019-11-28T22:20:15.834 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:15.831+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__multipart_key1.2~VXaSnHKe7Ikt0LOODXzz3CKpqD4Tdqv.3 2019-11-28T22:20:15.834 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:15.831+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__shadow_key1.2~VXaSnHKe7Ikt0LOODXzz3CKpqD4Tdqv.3_1 2019-11-28T22:20:15.834 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:15.831+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__multipart_key1.2~VXaSnHKe7Ikt0LOODXzz3CKpqD4Tdqv.4 2019-11-28T22:20:15.834 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:15.831+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__shadow_key1.2~VXaSnHKe7Ikt0LOODXzz3CKpqD4Tdqv.4_1 2019-11-28T22:20:15.835 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:15.831+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__multipart_key1.2~VXaSnHKe7Ikt0LOODXzz3CKpqD4Tdqv.5 2019-11-28T22:20:16.074 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:16.073+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:20:16.224 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:16.222+0000 7f24584b9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-28T22:20:16.266 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:16.265+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:16.281 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:16.280+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:16.311 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:16.309+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-28T22:20:16.312 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:16.309+0000 7f24584b9ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.509', time=2019-11-29T00:07:03.895988+0000, chain.objs.size()=9 2019-11-28T22:20:16.312 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:16.309+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.24__multipart_key1.2~QcTOnZJI0YQjMkMxcoOfwB8jxpTGi_0.1 2019-11-28T22:20:16.312 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:16.309+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.24__shadow_key1.2~QcTOnZJI0YQjMkMxcoOfwB8jxpTGi_0.1_1 2019-11-28T22:20:16.312 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:16.309+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.24__multipart_key1.2~QcTOnZJI0YQjMkMxcoOfwB8jxpTGi_0.2 2019-11-28T22:20:16.312 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:16.309+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.24__shadow_key1.2~QcTOnZJI0YQjMkMxcoOfwB8jxpTGi_0.2_1 2019-11-28T22:20:16.312 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:16.309+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.24__multipart_key1.2~QcTOnZJI0YQjMkMxcoOfwB8jxpTGi_0.3 2019-11-28T22:20:16.313 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:16.309+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.24__shadow_key1.2~QcTOnZJI0YQjMkMxcoOfwB8jxpTGi_0.3_1 2019-11-28T22:20:16.313 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:16.309+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.24__multipart_key1.2~QcTOnZJI0YQjMkMxcoOfwB8jxpTGi_0.4 2019-11-28T22:20:16.313 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:16.309+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.24__shadow_key1.2~QcTOnZJI0YQjMkMxcoOfwB8jxpTGi_0.4_1 2019-11-28T22:20:16.313 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:16.309+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.24__multipart_key1.2~QcTOnZJI0YQjMkMxcoOfwB8jxpTGi_0.5 2019-11-28T22:20:16.313 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:16.309+0000 7f24584b9ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.674', time=2019-11-29T00:18:00.647431+0000, chain.objs.size()=9 2019-11-28T22:20:16.313 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:16.309+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.30__multipart_key1.2~G3_IofVfwgWvB4_sa75Jw068X2ZmP9R.1 2019-11-28T22:20:16.313 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:16.309+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.30__shadow_key1.2~G3_IofVfwgWvB4_sa75Jw068X2ZmP9R.1_1 2019-11-28T22:20:16.314 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:16.309+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.30__multipart_key1.2~G3_IofVfwgWvB4_sa75Jw068X2ZmP9R.2 2019-11-28T22:20:16.527 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:16.526+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.30__shadow_key1.2~G3_IofVfwgWvB4_sa75Jw068X2ZmP9R.2_1 2019-11-28T22:20:16.600 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:16.598+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.30__multipart_key1.2~G3_IofVfwgWvB4_sa75Jw068X2ZmP9R.3 2019-11-28T22:20:16.600 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:16.598+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.30__shadow_key1.2~G3_IofVfwgWvB4_sa75Jw068X2ZmP9R.3_1 2019-11-28T22:20:16.600 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:16.598+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.30__multipart_key1.2~G3_IofVfwgWvB4_sa75Jw068X2ZmP9R.4 2019-11-28T22:20:16.647 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:16.645+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.30__shadow_key1.2~G3_IofVfwgWvB4_sa75Jw068X2ZmP9R.4_1 2019-11-28T22:20:16.647 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:16.645+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.30__multipart_key1.2~G3_IofVfwgWvB4_sa75Jw068X2ZmP9R.5 2019-11-28T22:20:16.843 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:16.842+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:20:16.926 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:16.924+0000 7f24584b9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-28T22:20:16.966 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:16.964+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:16.981 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:16.979+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:16.989 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:16.987+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:17.026 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:17.025+0000 7f24584b9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-28T22:20:17.098 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:17.096+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:17.127 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:17.125+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:17.141 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:17.139+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:17.194 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:17.193+0000 7f24584b9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-28T22:20:17.267 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:17.266+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:17.286 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:17.284+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:17.295 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:17.294+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:17.337 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:17.335+0000 7f24584b9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-28T22:20:17.385 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:17.384+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:17.401 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:17.399+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:17.409 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:17.407+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:17.455 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:17.453+0000 7f24584b9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-28T22:20:17.539 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:17.538+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:17.572 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:17.570+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:17.596 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:17.594+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-28T22:20:17.596 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:17.594+0000 7f24584b9ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.454', time=2019-11-29T00:05:23.963849+0000, chain.objs.size()=9 2019-11-28T22:20:17.596 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:17.594+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__multipart_key1.2~OTPIYoW9SSNpqgM9RNuXhs3xXbbr55y.1 2019-11-28T22:20:17.596 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:17.594+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__shadow_key1.2~OTPIYoW9SSNpqgM9RNuXhs3xXbbr55y.1_1 2019-11-28T22:20:17.596 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:17.594+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__multipart_key1.2~OTPIYoW9SSNpqgM9RNuXhs3xXbbr55y.2 2019-11-28T22:20:17.597 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:17.594+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__shadow_key1.2~OTPIYoW9SSNpqgM9RNuXhs3xXbbr55y.2_1 2019-11-28T22:20:17.597 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:17.594+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__multipart_key1.2~OTPIYoW9SSNpqgM9RNuXhs3xXbbr55y.3 2019-11-28T22:20:17.597 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:17.594+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__shadow_key1.2~OTPIYoW9SSNpqgM9RNuXhs3xXbbr55y.3_1 2019-11-28T22:20:17.597 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:17.594+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__multipart_key1.2~OTPIYoW9SSNpqgM9RNuXhs3xXbbr55y.4 2019-11-28T22:20:17.597 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:17.594+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__shadow_key1.2~OTPIYoW9SSNpqgM9RNuXhs3xXbbr55y.4_1 2019-11-28T22:20:17.597 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:17.594+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__multipart_key1.2~OTPIYoW9SSNpqgM9RNuXhs3xXbbr55y.5 2019-11-28T22:20:17.862 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:17.860+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:20:17.953 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:17.951+0000 7f24584b9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-28T22:20:17.988 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:17.987+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:18.003 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.001+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:18.035 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.033+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2019-11-28T22:20:18.035 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.033+0000 7f24584b9ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.466', time=2019-11-29T00:06:05.719102+0000, chain.objs.size()=7 2019-11-28T22:20:18.035 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.033+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__multipart_key1.2~booPMiW-Giesf13caOevAHDCOsnLMrQ.1 2019-11-28T22:20:18.036 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.033+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__shadow_key1.2~booPMiW-Giesf13caOevAHDCOsnLMrQ.1_1 2019-11-28T22:20:18.036 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.033+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__shadow_key1.2~booPMiW-Giesf13caOevAHDCOsnLMrQ.1_2 2019-11-28T22:20:18.036 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.033+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__multipart_key1.2~booPMiW-Giesf13caOevAHDCOsnLMrQ.2 2019-11-28T22:20:18.036 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.033+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__shadow_key1.2~booPMiW-Giesf13caOevAHDCOsnLMrQ.2_1 2019-11-28T22:20:18.036 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.033+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__shadow_key1.2~booPMiW-Giesf13caOevAHDCOsnLMrQ.2_2 2019-11-28T22:20:18.036 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.033+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__multipart_key1.2~booPMiW-Giesf13caOevAHDCOsnLMrQ.3 2019-11-28T22:20:18.037 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.033+0000 7f24584b9ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~YclCe3mrSHeYyaQUWE9ZqYzLDjxJjbj', time=2019-11-29T00:08:39.433784+0000, chain.objs.size()=5 2019-11-28T22:20:18.037 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.033+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.27__multipart_key1.2~YclCe3mrSHeYyaQUWE9ZqYzLDjxJjbj.7 2019-11-28T22:20:18.037 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.033+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.27__shadow_key1.2~YclCe3mrSHeYyaQUWE9ZqYzLDjxJjbj.7_1 2019-11-28T22:20:18.037 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.033+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.27__multipart_key1.2~YclCe3mrSHeYyaQUWE9ZqYzLDjxJjbj.10 2019-11-28T22:20:18.037 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.033+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.27__shadow_key1.2~YclCe3mrSHeYyaQUWE9ZqYzLDjxJjbj.10_1 2019-11-28T22:20:18.037 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.033+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.27__multipart_key1.2~YclCe3mrSHeYyaQUWE9ZqYzLDjxJjbj.13 2019-11-28T22:20:18.315 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.313+0000 7f24584b9ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~KF_G1gOQ1gQUIKAsVBNx5ND6XUGDITI', time=2019-11-29T00:18:24.845041+0000, chain.objs.size()=41 2019-11-28T22:20:18.315 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.313+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.2~KF_G1gOQ1gQUIKAsVBNx5ND6XUGDITI.1 2019-11-28T22:20:18.315 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.313+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.2~KF_G1gOQ1gQUIKAsVBNx5ND6XUGDITI.2 2019-11-28T22:20:18.315 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.313+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.2~KF_G1gOQ1gQUIKAsVBNx5ND6XUGDITI.3 2019-11-28T22:20:18.315 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.313+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.2~KF_G1gOQ1gQUIKAsVBNx5ND6XUGDITI.4 2019-11-28T22:20:18.424 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.423+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.2~KF_G1gOQ1gQUIKAsVBNx5ND6XUGDITI.5 2019-11-28T22:20:18.424 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.423+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.2~KF_G1gOQ1gQUIKAsVBNx5ND6XUGDITI.6 2019-11-28T22:20:18.425 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.423+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.2~KF_G1gOQ1gQUIKAsVBNx5ND6XUGDITI.7 2019-11-28T22:20:18.425 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.423+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.2~KF_G1gOQ1gQUIKAsVBNx5ND6XUGDITI.8 2019-11-28T22:20:18.425 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.423+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.2~KF_G1gOQ1gQUIKAsVBNx5ND6XUGDITI.9 2019-11-28T22:20:18.425 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.423+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.2~KF_G1gOQ1gQUIKAsVBNx5ND6XUGDITI.10 2019-11-28T22:20:18.425 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.423+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.2~KF_G1gOQ1gQUIKAsVBNx5ND6XUGDITI.11 2019-11-28T22:20:18.615 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.614+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.2~KF_G1gOQ1gQUIKAsVBNx5ND6XUGDITI.12 2019-11-28T22:20:18.669 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.667+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.2~KF_G1gOQ1gQUIKAsVBNx5ND6XUGDITI.13 2019-11-28T22:20:18.669 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.667+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.2~KF_G1gOQ1gQUIKAsVBNx5ND6XUGDITI.14 2019-11-28T22:20:18.669 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.667+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.2~KF_G1gOQ1gQUIKAsVBNx5ND6XUGDITI.15 2019-11-28T22:20:18.670 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.667+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.2~KF_G1gOQ1gQUIKAsVBNx5ND6XUGDITI.16 2019-11-28T22:20:18.670 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.667+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.2~KF_G1gOQ1gQUIKAsVBNx5ND6XUGDITI.17 2019-11-28T22:20:18.670 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.667+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.GktTc8F-n_JNmKSmLR6UEzOu2z9c5Xt.18 2019-11-28T22:20:18.670 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.667+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.ICg_6qel6Co9FpOwMP6ZMraMv9eNtzl.19 2019-11-28T22:20:18.716 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.715+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.DX2LP811sXQIBTk8yIIgfvoKDuINhwa.20 2019-11-28T22:20:18.717 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.715+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.2~KF_G1gOQ1gQUIKAsVBNx5ND6XUGDITI.21 2019-11-28T22:20:18.871 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.869+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.2~KF_G1gOQ1gQUIKAsVBNx5ND6XUGDITI.22 2019-11-28T22:20:18.871 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.869+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.2~KF_G1gOQ1gQUIKAsVBNx5ND6XUGDITI.23 2019-11-28T22:20:18.871 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.869+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.2~KF_G1gOQ1gQUIKAsVBNx5ND6XUGDITI.24 2019-11-28T22:20:18.871 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.869+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.2~KF_G1gOQ1gQUIKAsVBNx5ND6XUGDITI.25 2019-11-28T22:20:18.871 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.869+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.2~KF_G1gOQ1gQUIKAsVBNx5ND6XUGDITI.26 2019-11-28T22:20:18.872 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.869+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.2~KF_G1gOQ1gQUIKAsVBNx5ND6XUGDITI.27 2019-11-28T22:20:18.872 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.869+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.2~KF_G1gOQ1gQUIKAsVBNx5ND6XUGDITI.28 2019-11-28T22:20:18.872 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.869+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.2~KF_G1gOQ1gQUIKAsVBNx5ND6XUGDITI.29 2019-11-28T22:20:18.962 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.960+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.2~KF_G1gOQ1gQUIKAsVBNx5ND6XUGDITI.30 2019-11-28T22:20:18.996 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.994+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.2~KF_G1gOQ1gQUIKAsVBNx5ND6XUGDITI.31 2019-11-28T22:20:18.996 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.994+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.2~KF_G1gOQ1gQUIKAsVBNx5ND6XUGDITI.32 2019-11-28T22:20:18.996 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:18.994+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.2~KF_G1gOQ1gQUIKAsVBNx5ND6XUGDITI.33 2019-11-28T22:20:19.031 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:19.029+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.2~KF_G1gOQ1gQUIKAsVBNx5ND6XUGDITI.34 2019-11-28T22:20:19.049 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:19.048+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.2~KF_G1gOQ1gQUIKAsVBNx5ND6XUGDITI.35 2019-11-28T22:20:19.067 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:19.065+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.2~KF_G1gOQ1gQUIKAsVBNx5ND6XUGDITI.36 2019-11-28T22:20:19.133 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:19.131+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.2~KF_G1gOQ1gQUIKAsVBNx5ND6XUGDITI.37 2019-11-28T22:20:19.133 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:19.131+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.2~KF_G1gOQ1gQUIKAsVBNx5ND6XUGDITI.38 2019-11-28T22:20:19.133 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:19.131+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.2~KF_G1gOQ1gQUIKAsVBNx5ND6XUGDITI.39 2019-11-28T22:20:19.172 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:19.170+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.2~KF_G1gOQ1gQUIKAsVBNx5ND6XUGDITI.41 2019-11-28T22:20:19.206 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:19.204+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.31__multipart_key1.2~KF_G1gOQ1gQUIKAsVBNx5ND6XUGDITI.42 2019-11-28T22:20:19.378 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:19.377+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:20:19.510 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:19.509+0000 7f24584b9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-28T22:20:19.567 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:19.565+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:19.585 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:19.583+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:19.600 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:19.598+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-28T22:20:19.600 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:19.598+0000 7f24584b9ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.417', time=2019-11-29T00:02:56.575366+0000, chain.objs.size()=9 2019-11-28T22:20:19.600 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:19.598+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.17__multipart_key1.2~usUaVmkNXlp8--0SsMFtfh0AYJvMlEc.1 2019-11-28T22:20:19.601 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:19.598+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.17__shadow_key1.2~usUaVmkNXlp8--0SsMFtfh0AYJvMlEc.1_1 2019-11-28T22:20:19.601 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:19.598+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.17__multipart_key1.2~usUaVmkNXlp8--0SsMFtfh0AYJvMlEc.2 2019-11-28T22:20:19.601 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:19.598+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.17__shadow_key1.2~usUaVmkNXlp8--0SsMFtfh0AYJvMlEc.2_1 2019-11-28T22:20:19.601 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:19.598+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.17__multipart_key1.2~usUaVmkNXlp8--0SsMFtfh0AYJvMlEc.3 2019-11-28T22:20:19.601 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:19.598+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.17__shadow_key1.2~usUaVmkNXlp8--0SsMFtfh0AYJvMlEc.3_1 2019-11-28T22:20:19.601 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:19.598+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.17__multipart_key1.2~usUaVmkNXlp8--0SsMFtfh0AYJvMlEc.4 2019-11-28T22:20:19.601 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:19.598+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.17__shadow_key1.2~usUaVmkNXlp8--0SsMFtfh0AYJvMlEc.4_1 2019-11-28T22:20:19.602 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:19.598+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.17__multipart_key1.2~usUaVmkNXlp8--0SsMFtfh0AYJvMlEc.5 2019-11-28T22:20:19.796 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:19.794+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:20:19.874 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:19.873+0000 7f24584b9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-28T22:20:19.944 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:19.942+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:19.969 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:19.968+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:19.987 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:19.985+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-28T22:20:19.987 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:19.985+0000 7f24584b9ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.430', time=2019-11-29T00:06:09.751934+0000, chain.objs.size()=5 2019-11-28T22:20:19.988 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:19.985+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.19__shadow_.8rqEip-cjkkPf6mAsJUKCYzXCDdzNA4_1 2019-11-28T22:20:19.988 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:19.985+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.19__shadow_.8rqEip-cjkkPf6mAsJUKCYzXCDdzNA4_2 2019-11-28T22:20:19.988 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:19.985+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.19__shadow_.8rqEip-cjkkPf6mAsJUKCYzXCDdzNA4_3 2019-11-28T22:20:19.988 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:19.985+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.19__shadow_.8rqEip-cjkkPf6mAsJUKCYzXCDdzNA4_4 2019-11-28T22:20:19.988 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:19.985+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.19__shadow_.8rqEip-cjkkPf6mAsJUKCYzXCDdzNA4_5 2019-11-28T22:20:20.184 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:20.182+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:20:20.270 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:20.269+0000 7f24584b9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-28T22:20:20.310 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:20.308+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:20.323 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:20.322+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:20.337 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:20.335+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-28T22:20:20.337 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:20.335+0000 7f24584b9ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.659', time=2019-11-29T00:17:13.365380+0000, chain.objs.size()=9 2019-11-28T22:20:20.338 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:20.335+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.29__multipart_key1.2~Fl3WlgI-Fj2aVON9IpcOfn1mb2jPXQa.1 2019-11-28T22:20:20.338 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:20.335+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.29__shadow_key1.2~Fl3WlgI-Fj2aVON9IpcOfn1mb2jPXQa.1_1 2019-11-28T22:20:20.338 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:20.335+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.29__multipart_key1.2~Fl3WlgI-Fj2aVON9IpcOfn1mb2jPXQa.2 2019-11-28T22:20:20.338 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:20.335+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.29__shadow_key1.2~Fl3WlgI-Fj2aVON9IpcOfn1mb2jPXQa.2_1 2019-11-28T22:20:20.338 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:20.335+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.29__multipart_key1.2~Fl3WlgI-Fj2aVON9IpcOfn1mb2jPXQa.3 2019-11-28T22:20:20.338 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:20.335+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.29__shadow_key1.2~Fl3WlgI-Fj2aVON9IpcOfn1mb2jPXQa.3_1 2019-11-28T22:20:20.339 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:20.335+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.29__multipart_key1.2~Fl3WlgI-Fj2aVON9IpcOfn1mb2jPXQa.4 2019-11-28T22:20:20.339 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:20.335+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.29__shadow_key1.2~Fl3WlgI-Fj2aVON9IpcOfn1mb2jPXQa.4_1 2019-11-28T22:20:20.339 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:20.336+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.29__multipart_key1.2~Fl3WlgI-Fj2aVON9IpcOfn1mb2jPXQa.5 2019-11-28T22:20:20.609 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:20.608+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:20:20.704 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:20.702+0000 7f24584b9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-28T22:20:20.746 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:20.744+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:20.769 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:20.760+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:20.792 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:20.790+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2019-11-28T22:20:20.793 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:20.790+0000 7f24584b9ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.559', time=2019-11-29T00:08:10.964564+0000, chain.objs.size()=9 2019-11-28T22:20:20.793 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:20.790+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.26__multipart_file.mpg.2~_BUc1zZcLanWto1Sph8vd6fau-IjXbD.1 2019-11-28T22:20:20.793 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:20.790+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.26__shadow_file.mpg.2~_BUc1zZcLanWto1Sph8vd6fau-IjXbD.1_1 2019-11-28T22:20:20.793 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:20.790+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.26__multipart_file.mpg.2~_BUc1zZcLanWto1Sph8vd6fau-IjXbD.2 2019-11-28T22:20:20.794 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:20.790+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.26__shadow_file.mpg.2~_BUc1zZcLanWto1Sph8vd6fau-IjXbD.2_1 2019-11-28T22:20:20.794 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:20.790+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.26__multipart_file.mpg.2~_BUc1zZcLanWto1Sph8vd6fau-IjXbD.3 2019-11-28T22:20:20.794 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:20.790+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.26__shadow_file.mpg.2~_BUc1zZcLanWto1Sph8vd6fau-IjXbD.3_1 2019-11-28T22:20:20.794 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:20.790+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.26__multipart_file.mpg.2~_BUc1zZcLanWto1Sph8vd6fau-IjXbD.4 2019-11-28T22:20:20.794 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:20.790+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.26__shadow_file.mpg.2~_BUc1zZcLanWto1Sph8vd6fau-IjXbD.4_1 2019-11-28T22:20:20.794 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:20.790+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.26__multipart_file.mpg.2~_BUc1zZcLanWto1Sph8vd6fau-IjXbD.5 2019-11-28T22:20:20.794 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:20.790+0000 7f24584b9ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.560', time=2019-11-29T00:08:12.957215+0000, chain.objs.size()=9 2019-11-28T22:20:20.795 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:20.790+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.26__multipart_file2.mpg.2~GFd90JfWYz7s69X8jBpMXmIDdvkqCXN.1 2019-11-28T22:20:20.795 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:20.790+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.26__shadow_file2.mpg.2~GFd90JfWYz7s69X8jBpMXmIDdvkqCXN.1_1 2019-11-28T22:20:20.795 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:20.790+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.26__multipart_file2.mpg.2~GFd90JfWYz7s69X8jBpMXmIDdvkqCXN.2 2019-11-28T22:20:20.975 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:20.974+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.26__shadow_file2.mpg.2~GFd90JfWYz7s69X8jBpMXmIDdvkqCXN.2_1 2019-11-28T22:20:21.067 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:21.064+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.26__multipart_file2.mpg.2~GFd90JfWYz7s69X8jBpMXmIDdvkqCXN.3 2019-11-28T22:20:21.079 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:21.077+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.26__shadow_file2.mpg.2~GFd90JfWYz7s69X8jBpMXmIDdvkqCXN.3_1 2019-11-28T22:20:21.079 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:21.077+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.26__multipart_file2.mpg.2~GFd90JfWYz7s69X8jBpMXmIDdvkqCXN.4 2019-11-28T22:20:21.079 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:21.077+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.26__shadow_file2.mpg.2~GFd90JfWYz7s69X8jBpMXmIDdvkqCXN.4_1 2019-11-28T22:20:21.079 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:21.077+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.26__multipart_file2.mpg.2~GFd90JfWYz7s69X8jBpMXmIDdvkqCXN.5 2019-11-28T22:20:21.080 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:21.077+0000 7f24584b9ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.608', time=2019-11-29T00:13:10.427595+0000, chain.objs.size()=21 2019-11-28T22:20:21.080 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:21.077+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~ON-v2TIgRYe8Ntcrhgb59zNMqxIh7_H.1 2019-11-28T22:20:21.080 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:21.077+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~ON-v2TIgRYe8Ntcrhgb59zNMqxIh7_H.1_1 2019-11-28T22:20:21.080 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:21.077+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~ON-v2TIgRYe8Ntcrhgb59zNMqxIh7_H.2 2019-11-28T22:20:21.080 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:21.077+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~ON-v2TIgRYe8Ntcrhgb59zNMqxIh7_H.2_1 2019-11-28T22:20:21.080 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:21.077+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~ON-v2TIgRYe8Ntcrhgb59zNMqxIh7_H.3 2019-11-28T22:20:21.226 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:21.224+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~ON-v2TIgRYe8Ntcrhgb59zNMqxIh7_H.3_1 2019-11-28T22:20:21.424 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:21.422+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~ON-v2TIgRYe8Ntcrhgb59zNMqxIh7_H.4 2019-11-28T22:20:21.504 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:21.503+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~ON-v2TIgRYe8Ntcrhgb59zNMqxIh7_H.4_1 2019-11-28T22:20:21.504 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:21.503+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~ON-v2TIgRYe8Ntcrhgb59zNMqxIh7_H.5 2019-11-28T22:20:21.619 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:21.617+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~ON-v2TIgRYe8Ntcrhgb59zNMqxIh7_H.5_1 2019-11-28T22:20:21.619 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:21.617+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~ON-v2TIgRYe8Ntcrhgb59zNMqxIh7_H.6 2019-11-28T22:20:21.620 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:21.617+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~ON-v2TIgRYe8Ntcrhgb59zNMqxIh7_H.6_1 2019-11-28T22:20:21.620 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:21.617+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~ON-v2TIgRYe8Ntcrhgb59zNMqxIh7_H.7 2019-11-28T22:20:21.620 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:21.617+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~ON-v2TIgRYe8Ntcrhgb59zNMqxIh7_H.7_1 2019-11-28T22:20:21.620 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:21.617+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~ON-v2TIgRYe8Ntcrhgb59zNMqxIh7_H.8 2019-11-28T22:20:21.620 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:21.617+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~ON-v2TIgRYe8Ntcrhgb59zNMqxIh7_H.8_1 2019-11-28T22:20:21.620 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:21.617+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~ON-v2TIgRYe8Ntcrhgb59zNMqxIh7_H.9 2019-11-28T22:20:21.620 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:21.617+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~ON-v2TIgRYe8Ntcrhgb59zNMqxIh7_H.9_1 2019-11-28T22:20:21.621 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:21.617+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~ON-v2TIgRYe8Ntcrhgb59zNMqxIh7_H.10 2019-11-28T22:20:21.646 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:21.644+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__shadow_key1.2~ON-v2TIgRYe8Ntcrhgb59zNMqxIh7_H.10_1 2019-11-28T22:20:21.835 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:21.834+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.28__multipart_key1.2~ON-v2TIgRYe8Ntcrhgb59zNMqxIh7_H.11 2019-11-28T22:20:22.100 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:22.099+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:20:22.186 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:22.184+0000 7f24584b9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-28T22:20:22.225 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:22.224+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:22.241 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:22.240+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:22.257 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:22.254+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-28T22:20:22.257 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:22.254+0000 7f24584b9ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.838', time=2019-11-29T00:19:59.631896+0000, chain.objs.size()=21 2019-11-28T22:20:22.257 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:22.254+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.39__multipart_key1.2~gyLAb4lxBqlFo1kkc132hbYzZe_saXx.1 2019-11-28T22:20:22.257 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:22.254+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.39__shadow_key1.2~gyLAb4lxBqlFo1kkc132hbYzZe_saXx.1_1 2019-11-28T22:20:22.257 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:22.254+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.39__multipart_key1.2~gyLAb4lxBqlFo1kkc132hbYzZe_saXx.2 2019-11-28T22:20:22.258 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:22.254+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.39__shadow_key1.2~gyLAb4lxBqlFo1kkc132hbYzZe_saXx.2_1 2019-11-28T22:20:22.258 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:22.254+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.39__multipart_key1.2~gyLAb4lxBqlFo1kkc132hbYzZe_saXx.3 2019-11-28T22:20:22.258 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:22.254+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.39__shadow_key1.2~gyLAb4lxBqlFo1kkc132hbYzZe_saXx.3_1 2019-11-28T22:20:22.258 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:22.254+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.39__multipart_key1.2~gyLAb4lxBqlFo1kkc132hbYzZe_saXx.4 2019-11-28T22:20:22.258 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:22.254+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.39__shadow_key1.2~gyLAb4lxBqlFo1kkc132hbYzZe_saXx.4_1 2019-11-28T22:20:22.258 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:22.254+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.39__multipart_key1.2~gyLAb4lxBqlFo1kkc132hbYzZe_saXx.5 2019-11-28T22:20:22.258 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:22.254+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.39__shadow_key1.2~gyLAb4lxBqlFo1kkc132hbYzZe_saXx.5_1 2019-11-28T22:20:22.259 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:22.254+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.39__multipart_key1.2~gyLAb4lxBqlFo1kkc132hbYzZe_saXx.6 2019-11-28T22:20:22.259 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:22.255+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.39__shadow_key1.2~gyLAb4lxBqlFo1kkc132hbYzZe_saXx.6_1 2019-11-28T22:20:22.403 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:22.401+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.39__multipart_key1.2~gyLAb4lxBqlFo1kkc132hbYzZe_saXx.7 2019-11-28T22:20:22.446 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:22.445+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.39__shadow_key1.2~gyLAb4lxBqlFo1kkc132hbYzZe_saXx.7_1 2019-11-28T22:20:22.447 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:22.445+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.39__multipart_key1.2~gyLAb4lxBqlFo1kkc132hbYzZe_saXx.8 2019-11-28T22:20:22.466 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:22.464+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.39__shadow_key1.2~gyLAb4lxBqlFo1kkc132hbYzZe_saXx.8_1 2019-11-28T22:20:22.466 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:22.464+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.39__multipart_key1.2~gyLAb4lxBqlFo1kkc132hbYzZe_saXx.9 2019-11-28T22:20:22.466 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:22.464+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.39__shadow_key1.2~gyLAb4lxBqlFo1kkc132hbYzZe_saXx.9_1 2019-11-28T22:20:22.466 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:22.464+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.39__multipart_key1.2~gyLAb4lxBqlFo1kkc132hbYzZe_saXx.10 2019-11-28T22:20:22.466 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:22.464+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.39__shadow_key1.2~gyLAb4lxBqlFo1kkc132hbYzZe_saXx.10_1 2019-11-28T22:20:22.483 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:22.481+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.39__multipart_key1.2~gyLAb4lxBqlFo1kkc132hbYzZe_saXx.11 2019-11-28T22:20:22.889 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:22.888+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:20:23.031 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:23.029+0000 7f24584b9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-28T22:20:23.087 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:23.085+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:23.114 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:23.113+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:23.133 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:23.131+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-28T22:20:23.133 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:23.131+0000 7f24584b9ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.415', time=2019-11-29T00:03:02.798014+0000, chain.objs.size()=9 2019-11-28T22:20:23.134 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:23.131+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.17__multipart_key1.2~usUaVmkNXlp8--0SsMFtfh0AYJvMlEc.1 2019-11-28T22:20:23.134 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:23.131+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.17__shadow_key1.2~usUaVmkNXlp8--0SsMFtfh0AYJvMlEc.1_1 2019-11-28T22:20:23.134 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:23.131+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.17__multipart_key1.2~usUaVmkNXlp8--0SsMFtfh0AYJvMlEc.2 2019-11-28T22:20:23.134 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:23.131+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.17__shadow_key1.2~usUaVmkNXlp8--0SsMFtfh0AYJvMlEc.2_1 2019-11-28T22:20:23.134 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:23.131+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.17__multipart_key1.2~usUaVmkNXlp8--0SsMFtfh0AYJvMlEc.3 2019-11-28T22:20:23.134 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:23.131+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.17__shadow_key1.2~usUaVmkNXlp8--0SsMFtfh0AYJvMlEc.3_1 2019-11-28T22:20:23.134 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:23.131+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.17__multipart_key1.2~usUaVmkNXlp8--0SsMFtfh0AYJvMlEc.4 2019-11-28T22:20:23.135 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:23.131+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.17__shadow_key1.2~usUaVmkNXlp8--0SsMFtfh0AYJvMlEc.4_1 2019-11-28T22:20:23.135 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:23.131+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.17__multipart_key1.2~usUaVmkNXlp8--0SsMFtfh0AYJvMlEc.5 2019-11-28T22:20:23.135 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:23.131+0000 7f24584b9ec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.472', time=2019-11-29T00:06:16.163423+0000, chain.objs.size()=7 2019-11-28T22:20:23.135 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:23.131+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__multipart_key1.2~B5pdEblKtI0mVxSL242mBsB6Rp7IsuX.1 2019-11-28T22:20:23.136 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:23.131+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__shadow_key1.2~B5pdEblKtI0mVxSL242mBsB6Rp7IsuX.1_1 2019-11-28T22:20:23.136 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:23.131+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__shadow_key1.2~B5pdEblKtI0mVxSL242mBsB6Rp7IsuX.1_2 2019-11-28T22:20:23.289 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:23.287+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__multipart_key1.2~B5pdEblKtI0mVxSL242mBsB6Rp7IsuX.2 2019-11-28T22:20:23.411 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:23.409+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__shadow_key1.2~B5pdEblKtI0mVxSL242mBsB6Rp7IsuX.2_1 2019-11-28T22:20:23.411 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:23.409+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__shadow_key1.2~B5pdEblKtI0mVxSL242mBsB6Rp7IsuX.2_2 2019-11-28T22:20:23.411 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:23.409+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.20__multipart_key1.2~B5pdEblKtI0mVxSL242mBsB6Rp7IsuX.3 2019-11-28T22:20:23.633 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:23.631+0000 7f24584b9ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:20:23.713 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:23.711+0000 7f24584b9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-28T22:20:23.754 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:23.753+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:23.769 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:23.768+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:23.777 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:23.775+0000 7f24584b9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:23.837 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:23.836+0000 7f24584b9ec0 20 remove_watcher() i=0 2019-11-28T22:20:23.838 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:23.836+0000 7f24584b9ec0 2 removed watcher, disabling cache 2019-11-28T22:20:23.890 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:23.888+0000 7f24584b9ec0 20 remove_watcher() i=1 2019-11-28T22:20:23.927 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:23.925+0000 7f24584b9ec0 20 remove_watcher() i=2 2019-11-28T22:20:23.973 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:23.971+0000 7f24584b9ec0 20 remove_watcher() i=3 2019-11-28T22:20:24.011 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.009+0000 7f24584b9ec0 20 remove_watcher() i=4 2019-11-28T22:20:24.053 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.052+0000 7f24584b9ec0 20 remove_watcher() i=5 2019-11-28T22:20:24.086 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.084+0000 7f24584b9ec0 20 remove_watcher() i=6 2019-11-28T22:20:24.115 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.114+0000 7f24584b9ec0 20 remove_watcher() i=7 2019-11-28T22:20:24.122 INFO:teuthology.orchestra.run.smithi074:> radosgw-admin gc process --include-all 2019-11-28T22:20:24.237 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.236+0000 7f5d9093cec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:24.261 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.260+0000 7f5d9093cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:20:24.262 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.260+0000 7f5d9093cec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:24.270 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.269+0000 7f5d9093cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:20:24.270 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.269+0000 7f5d9093cec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:24.280 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.279+0000 7f5d9093cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:20:24.280 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.279+0000 7f5d9093cec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:24.299 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.298+0000 7f5d9093cec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:20:24.514 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.512+0000 7f5d9093cec0 20 RGWRados::pool_iterate: got zonegroup_info.cb1773b4-411c-4317-a760-df89ca0f54fc 2019-11-28T22:20:24.514 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.512+0000 7f5d9093cec0 20 RGWRados::pool_iterate: got zone_info.bd5ae442-b074-4d35-94cc-b1d71bd6ac02 2019-11-28T22:20:24.515 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.512+0000 7f5d9093cec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-28T22:20:24.515 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.512+0000 7f5d9093cec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-28T22:20:24.515 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.512+0000 7f5d9093cec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:24.525 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.523+0000 7f5d9093cec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:20:24.525 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.523+0000 7f5d9093cec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:24.535 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.533+0000 7f5d9093cec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T22:20:24.535 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.533+0000 7f5d9093cec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:24.544 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.542+0000 7f5d9093cec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:20:24.544 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.542+0000 7f5d9093cec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:24.556 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.555+0000 7f5d9093cec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T22:20:24.557 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.555+0000 7f5d9093cec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:24.563 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.562+0000 7f5d9093cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:20:24.563 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.562+0000 7f5d9093cec0 10 cannot find current period zonegroup using local zonegroup 2019-11-28T22:20:24.563 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.562+0000 7f5d9093cec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:24.570 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.569+0000 7f5d9093cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:20:24.570 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.569+0000 7f5d9093cec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:24.578 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.577+0000 7f5d9093cec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:20:24.578 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.577+0000 7f5d9093cec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:24.587 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.585+0000 7f5d9093cec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T22:20:24.587 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.585+0000 7f5d9093cec0 20 zonegroup default 2019-11-28T22:20:24.587 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.585+0000 7f5d9093cec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:24.593 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.591+0000 7f5d9093cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:20:24.593 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.591+0000 7f5d9093cec0 10 Cannot find current period zone using local zone 2019-11-28T22:20:24.593 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.591+0000 7f5d9093cec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:24.600 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.598+0000 7f5d9093cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:20:24.600 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.598+0000 7f5d9093cec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:24.608 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.606+0000 7f5d9093cec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:20:24.608 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.606+0000 7f5d9093cec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:24.616 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.614+0000 7f5d9093cec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T22:20:24.616 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.614+0000 7f5d9093cec0 20 zone default found 2019-11-28T22:20:24.616 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.614+0000 7f5d9093cec0 20 started sync module instance, tier type = 2019-11-28T22:20:24.616 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.614+0000 7f5d9093cec0 20 started zone id=bd5ae442-b074-4d35-94cc-b1d71bd6ac02 (name=default) with tier type = 2019-11-28T22:20:24.901 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.899+0000 7f5d7db69700 0 -- 172.21.15.74:0/2710619025 >> [v2:172.21.15.74:6818/10091,v1:172.21.15.74:6819/10091] conn(0x7f5d78003b20 msgr2=0x7f5d78001270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-28T22:20:24.908 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.906+0000 7f5d9093cec0 20 add_watcher() i=0 2019-11-28T22:20:24.908 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.906+0000 7f5d9093cec0 20 add_watcher() i=1 2019-11-28T22:20:24.908 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.906+0000 7f5d9093cec0 20 add_watcher() i=2 2019-11-28T22:20:24.909 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.906+0000 7f5d9093cec0 20 add_watcher() i=3 2019-11-28T22:20:24.909 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.906+0000 7f5d9093cec0 20 add_watcher() i=4 2019-11-28T22:20:24.909 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.906+0000 7f5d9093cec0 20 add_watcher() i=5 2019-11-28T22:20:24.909 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.906+0000 7f5d9093cec0 20 add_watcher() i=6 2019-11-28T22:20:24.943 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.942+0000 7f5d9093cec0 20 add_watcher() i=7 2019-11-28T22:20:24.943 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.942+0000 7f5d9093cec0 2 all 8 watchers are set, enabling cache 2019-11-28T22:20:24.943 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.942+0000 7f5d4e7dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-28T22:20:24.959 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:24.958+0000 7f5d7e36a700 0 -- 172.21.15.74:0/3147081334 >> v2:172.21.15.141:3300/0 conn(0x5615020e6fb0 msgr2=0x5615020e6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-28T22:20:26.349 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:26.347+0000 7f5cc4ff9700 20 reqs_thread_entry: start 2019-11-28T22:20:26.349 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:26.348+0000 7f5cbe7fc700 20 reqs_thread_entry: start 2019-11-28T22:20:26.350 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:26.348+0000 7f5d9093cec0 20 init_complete bucket index max shards: 0 2019-11-28T22:20:26.350 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:26.349+0000 7f5cbcff9700 20 reqs_thread_entry: start 2019-11-28T22:20:26.350 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:26.349+0000 7f5d9093cec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-28T22:20:26.431 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:26.430+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:26.467 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:26.465+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:26.485 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:26.483+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:26.541 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:26.539+0000 7f5d9093cec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-28T22:20:26.605 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:26.604+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:26.632 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:26.631+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:26.651 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:26.649+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:26.703 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:26.702+0000 7f5d9093cec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-28T22:20:26.749 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:26.748+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:26.764 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:26.763+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:26.772 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:26.772+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:26.810 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:26.810+0000 7f5d9093cec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-28T22:20:26.863 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:26.863+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:26.887 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:26.886+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:26.899 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:26.899+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:26.938 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:26.938+0000 7f5d9093cec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-28T22:20:26.985 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:26.984+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:27.003 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:27.002+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:27.011 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:27.010+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:27.059 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:27.059+0000 7f5d9093cec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-28T22:20:27.135 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:27.134+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:27.163 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:27.163+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:27.179 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:27.178+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:27.227 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:27.227+0000 7f5d9093cec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-28T22:20:27.282 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:27.282+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:27.310 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:27.309+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:27.322 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:27.321+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:27.360 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:27.360+0000 7f5d9093cec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-28T22:20:27.429 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:27.429+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:27.458 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:27.458+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:27.474 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:27.474+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:27.517 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:27.515+0000 7f5d9093cec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-28T22:20:27.590 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:27.590+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:27.613 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:27.613+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:27.624 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:27.623+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:27.676 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:27.676+0000 7f5d9093cec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-28T22:20:27.747 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:27.746+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:27.777 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:27.776+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:27.793 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:27.793+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:27.853 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:27.852+0000 7f5d9093cec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-28T22:20:27.924 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:27.924+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:27.952 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:27.952+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:27.966 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:27.966+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:28.007 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:28.007+0000 7f5d9093cec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-28T22:20:28.066 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:28.066+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:28.089 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:28.089+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:28.098 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:28.098+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:28.141 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:28.140+0000 7f5d9093cec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-28T22:20:28.190 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:28.189+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:28.213 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:28.212+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:28.225 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:28.224+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:28.261 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:28.261+0000 7f5d9093cec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-28T22:20:28.303 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:28.303+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:28.318 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:28.317+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:28.325 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:28.324+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:28.369 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:28.369+0000 7f5d9093cec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-28T22:20:28.415 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:28.414+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:28.430 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:28.429+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:28.451 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:28.450+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:28.512 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:28.511+0000 7f5d9093cec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-28T22:20:28.576 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:28.575+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:28.604 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:28.604+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:28.617 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:28.616+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:28.651 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:28.650+0000 7f5d9093cec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-28T22:20:28.689 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:28.688+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:28.706 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:28.706+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:28.717 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:28.717+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:28.754 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:28.754+0000 7f5d9093cec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-28T22:20:28.808 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:28.808+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:28.841 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:28.840+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:28.849 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:28.849+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:28.890 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:28.889+0000 7f5d9093cec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-28T22:20:28.953 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:28.953+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:28.969 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:28.968+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:28.977 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:28.977+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:29.016 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:29.015+0000 7f5d9093cec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-28T22:20:29.062 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:29.062+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:29.084 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:29.084+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:29.098 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:29.097+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:29.143 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:29.143+0000 7f5d9093cec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-28T22:20:29.196 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:29.195+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:29.213 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:29.213+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:29.223 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:29.222+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:29.267 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:29.266+0000 7f5d9093cec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-28T22:20:29.330 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:29.330+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:29.349 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:29.348+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:29.359 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:29.358+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:29.396 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:29.396+0000 7f5d9093cec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-28T22:20:29.451 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:29.451+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:29.474 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:29.474+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:29.483 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:29.483+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:29.534 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:29.533+0000 7f5d9093cec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-28T22:20:29.578 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:29.578+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:29.593 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:29.593+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:29.602 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:29.602+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:29.658 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:29.657+0000 7f5d9093cec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-28T22:20:29.729 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:29.728+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:29.752 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:29.751+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:29.765 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:29.765+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:29.803 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:29.803+0000 7f5d9093cec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-28T22:20:29.873 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:29.872+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:29.893 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:29.893+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:29.903 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:29.902+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:29.977 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:29.976+0000 7f5d9093cec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-28T22:20:30.051 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:30.050+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:30.081 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:30.081+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:30.091 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:30.091+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:30.132 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:30.131+0000 7f5d9093cec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-28T22:20:30.200 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:30.199+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:30.225 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:30.224+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:30.244 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:30.243+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:30.284 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:30.284+0000 7f5d9093cec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-28T22:20:30.344 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:30.344+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:30.361 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:30.360+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:30.369 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:30.369+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:30.430 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:30.429+0000 7f5d9093cec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-28T22:20:30.490 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:30.489+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:30.512 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:30.511+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:30.523 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:30.522+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:30.575 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:30.574+0000 7f5d9093cec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-28T22:20:30.673 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:30.672+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:30.702 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:30.701+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:30.717 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:30.717+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:30.769 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:30.769+0000 7f5d9093cec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-28T22:20:30.838 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:30.837+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:30.859 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:30.859+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:30.872 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:30.871+0000 7f5d9093cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:30.954 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:30.953+0000 7f5d9093cec0 20 remove_watcher() i=0 2019-11-28T22:20:30.954 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:30.953+0000 7f5d9093cec0 2 removed watcher, disabling cache 2019-11-28T22:20:31.039 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.038+0000 7f5d9093cec0 20 remove_watcher() i=1 2019-11-28T22:20:31.093 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.092+0000 7f5d9093cec0 20 remove_watcher() i=2 2019-11-28T22:20:31.161 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.160+0000 7f5d9093cec0 20 remove_watcher() i=3 2019-11-28T22:20:31.221 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.220+0000 7f5d9093cec0 20 remove_watcher() i=4 2019-11-28T22:20:31.279 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.279+0000 7f5d9093cec0 20 remove_watcher() i=5 2019-11-28T22:20:31.332 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.331+0000 7f5d9093cec0 20 remove_watcher() i=6 2019-11-28T22:20:31.392 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.392+0000 7f5d9093cec0 20 remove_watcher() i=7 2019-11-28T22:20:31.399 INFO:teuthology.orchestra.run.smithi074:> radosgw-admin gc process --include-all 2019-11-28T22:20:31.509 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.508+0000 7ff59300fec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:31.535 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.534+0000 7ff59300fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:20:31.535 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.534+0000 7ff59300fec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:31.545 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.544+0000 7ff59300fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:20:31.545 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.544+0000 7ff59300fec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:31.554 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.553+0000 7ff59300fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:20:31.554 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.553+0000 7ff59300fec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:31.573 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.573+0000 7ff59300fec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:20:31.785 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.784+0000 7ff59300fec0 20 RGWRados::pool_iterate: got zonegroup_info.cb1773b4-411c-4317-a760-df89ca0f54fc 2019-11-28T22:20:31.785 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.784+0000 7ff59300fec0 20 RGWRados::pool_iterate: got zone_info.bd5ae442-b074-4d35-94cc-b1d71bd6ac02 2019-11-28T22:20:31.786 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.784+0000 7ff59300fec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-28T22:20:31.786 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.784+0000 7ff59300fec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-28T22:20:31.786 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.784+0000 7ff59300fec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:31.803 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.802+0000 7ff59300fec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:20:31.803 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.802+0000 7ff59300fec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:31.820 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.820+0000 7ff59300fec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T22:20:31.821 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.820+0000 7ff59300fec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:31.835 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.835+0000 7ff59300fec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:20:31.835 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.835+0000 7ff59300fec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:31.855 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.854+0000 7ff59300fec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T22:20:31.855 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.854+0000 7ff59300fec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:31.868 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.868+0000 7ff59300fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:20:31.868 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.868+0000 7ff59300fec0 10 cannot find current period zonegroup using local zonegroup 2019-11-28T22:20:31.869 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.868+0000 7ff59300fec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:31.881 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.881+0000 7ff59300fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:20:31.881 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.881+0000 7ff59300fec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:31.895 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.895+0000 7ff59300fec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:20:31.895 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.895+0000 7ff59300fec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:31.909 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.909+0000 7ff59300fec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T22:20:31.909 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.909+0000 7ff59300fec0 20 zonegroup default 2019-11-28T22:20:31.909 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.909+0000 7ff59300fec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:31.921 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.920+0000 7ff59300fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:20:31.921 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.920+0000 7ff59300fec0 10 Cannot find current period zone using local zone 2019-11-28T22:20:31.921 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.920+0000 7ff59300fec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:31.934 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.933+0000 7ff59300fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:20:31.934 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.933+0000 7ff59300fec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:31.947 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.946+0000 7ff59300fec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:20:31.947 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.946+0000 7ff59300fec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:31.960 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.959+0000 7ff59300fec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T22:20:31.960 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.959+0000 7ff59300fec0 20 zone default found 2019-11-28T22:20:31.960 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.959+0000 7ff59300fec0 20 started sync module instance, tier type = 2019-11-28T22:20:31.961 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:31.959+0000 7ff59300fec0 20 started zone id=bd5ae442-b074-4d35-94cc-b1d71bd6ac02 (name=default) with tier type = 2019-11-28T22:20:32.359 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:32.359+0000 7ff59300fec0 20 add_watcher() i=0 2019-11-28T22:20:32.360 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:32.359+0000 7ff59300fec0 20 add_watcher() i=1 2019-11-28T22:20:32.360 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:32.359+0000 7ff59300fec0 20 add_watcher() i=2 2019-11-28T22:20:32.360 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:32.359+0000 7ff59300fec0 20 add_watcher() i=3 2019-11-28T22:20:32.360 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:32.359+0000 7ff59300fec0 20 add_watcher() i=4 2019-11-28T22:20:32.360 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:32.359+0000 7ff59300fec0 20 add_watcher() i=5 2019-11-28T22:20:32.360 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:32.359+0000 7ff59300fec0 20 add_watcher() i=6 2019-11-28T22:20:32.392 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:32.391+0000 7ff59300fec0 20 add_watcher() i=7 2019-11-28T22:20:32.392 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:32.391+0000 7ff59300fec0 2 all 8 watchers are set, enabling cache 2019-11-28T22:20:32.392 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:32.391+0000 7ff550fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-28T22:20:32.397 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:32.397+0000 7ff58023c700 0 -- 172.21.15.74:0/950429091 >> v2:172.21.15.141:3300/0 conn(0x55f610753600 msgr2=0x55f610753a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-28T22:20:32.600 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:32.600+0000 7ff58023c700 0 --2- 172.21.15.74:0/950429091 >> v2:172.21.15.141:3300/0 conn(0x55f610753600 0x55f610753a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-28T22:20:32.691 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:32.690+0000 7ff58023c700 0 -- 172.21.15.74:0/37316645 >> [v2:172.21.15.74:3300/0,v1:172.21.15.74:6789/0] conn(0x55f61075f460 msgr2=0x55f61077fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-28T22:20:34.216 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:34.216+0000 7ff4c2ffd700 20 reqs_thread_entry: start 2019-11-28T22:20:34.217 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:34.216+0000 7ff4c0ff9700 20 reqs_thread_entry: start 2019-11-28T22:20:34.217 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:34.216+0000 7ff59300fec0 20 init_complete bucket index max shards: 0 2019-11-28T22:20:34.217 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:34.217+0000 7ff4b6ffd700 20 reqs_thread_entry: start 2019-11-28T22:20:34.217 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:34.217+0000 7ff59300fec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-28T22:20:34.275 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:34.274+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:34.300 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:34.300+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:34.312 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:34.311+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:34.360 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:34.360+0000 7ff59300fec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-28T22:20:34.430 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:34.430+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:34.447 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:34.447+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:34.457 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:34.457+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:34.542 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:34.541+0000 7ff59300fec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-28T22:20:34.631 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:34.631+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:34.665 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:34.664+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:34.682 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:34.682+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:34.717 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:34.715+0000 7ff59300fec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-28T22:20:34.764 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:34.764+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:34.796 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:34.796+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:34.817 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:34.817+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:34.874 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:34.873+0000 7ff59300fec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-28T22:20:34.945 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:34.944+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:34.969 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:34.969+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:34.980 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:34.980+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:35.030 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:35.029+0000 7ff59300fec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-28T22:20:35.100 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:35.100+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:35.122 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:35.122+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:35.139 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:35.139+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:35.186 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:35.186+0000 7ff59300fec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-28T22:20:35.271 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:35.270+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:35.301 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:35.301+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:35.318 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:35.318+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:35.368 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:35.367+0000 7ff59300fec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-28T22:20:35.437 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:35.436+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:35.461 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:35.461+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:35.474 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:35.473+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:35.521 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:35.520+0000 7ff59300fec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-28T22:20:35.574 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:35.573+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:35.598 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:35.597+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:35.610 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:35.610+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:35.652 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:35.651+0000 7ff59300fec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-28T22:20:35.732 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:35.731+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:35.752 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:35.752+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:35.762 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:35.761+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:35.805 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:35.805+0000 7ff59300fec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-28T22:20:35.857 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:35.857+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:35.876 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:35.874+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:35.885 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:35.883+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:35.929 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:35.928+0000 7ff59300fec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-28T22:20:35.981 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:35.980+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:36.012 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:36.011+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:36.023 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:36.023+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:36.064 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:36.063+0000 7ff59300fec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-28T22:20:36.119 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:36.119+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:36.138 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:36.137+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:36.146 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:36.145+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:36.199 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:36.199+0000 7ff59300fec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-28T22:20:36.266 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:36.265+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:36.293 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:36.292+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:36.305 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:36.304+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:36.370 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:36.370+0000 7ff59300fec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-28T22:20:36.414 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:36.414+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:36.430 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:36.429+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:36.439 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:36.438+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:36.471 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:36.471+0000 7ff59300fec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-28T22:20:36.562 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:36.562+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:36.587 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:36.587+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:36.605 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:36.604+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:36.663 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:36.663+0000 7ff59300fec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-28T22:20:36.717 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:36.716+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:36.734 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:36.732+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:36.742 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:36.741+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:36.785 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:36.784+0000 7ff59300fec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-28T22:20:36.824 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:36.823+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:36.844 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:36.844+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:36.854 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:36.853+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:36.891 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:36.890+0000 7ff59300fec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-28T22:20:36.949 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:36.949+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:36.980 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:36.980+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:36.991 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:36.990+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:37.028 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:37.027+0000 7ff59300fec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-28T22:20:37.074 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:37.073+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:37.104 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:37.103+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:37.118 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:37.118+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:37.156 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:37.156+0000 7ff59300fec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-28T22:20:37.215 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:37.215+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:37.245 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:37.245+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:37.258 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:37.258+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:37.318 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:37.318+0000 7ff59300fec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-28T22:20:37.363 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:37.363+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:37.389 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:37.388+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:37.402 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:37.402+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:37.494 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:37.494+0000 7ff59300fec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-28T22:20:37.566 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:37.565+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:37.580 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:37.580+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:37.588 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:37.588+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:37.627 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:37.626+0000 7ff59300fec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-28T22:20:37.695 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:37.694+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:37.720 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:37.720+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:37.732 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:37.730+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:37.771 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:37.770+0000 7ff59300fec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-28T22:20:37.819 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:37.819+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:37.839 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:37.839+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:37.848 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:37.848+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:37.883 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:37.882+0000 7ff59300fec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-28T22:20:37.965 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:37.964+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:37.984 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:37.983+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:37.993 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:37.992+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:38.045 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:38.043+0000 7ff59300fec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-28T22:20:38.112 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:38.112+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:38.131 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:38.131+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:38.142 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:38.141+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:38.198 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:38.198+0000 7ff59300fec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-28T22:20:38.267 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:38.266+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:38.294 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:38.294+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:38.317 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:38.317+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:38.377 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:38.376+0000 7ff59300fec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-28T22:20:38.490 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:38.490+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:38.516 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:38.516+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:38.539 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:38.538+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:38.576 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:38.576+0000 7ff59300fec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-28T22:20:38.628 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:38.628+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:38.658 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:38.658+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:38.682 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:38.682+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:38.732 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:38.731+0000 7ff59300fec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-28T22:20:38.783 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:38.782+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:38.798 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:38.797+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:38.807 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:38.807+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:38.844 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:38.843+0000 7ff59300fec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-28T22:20:38.896 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:38.895+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:38.914 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:38.913+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:38.923 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:38.922+0000 7ff59300fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:38.997 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:38.997+0000 7ff59300fec0 20 remove_watcher() i=0 2019-11-28T22:20:38.997 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:38.997+0000 7ff59300fec0 2 removed watcher, disabling cache 2019-11-28T22:20:39.041 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.040+0000 7ff59300fec0 20 remove_watcher() i=1 2019-11-28T22:20:39.092 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.091+0000 7ff59300fec0 20 remove_watcher() i=2 2019-11-28T22:20:39.140 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.139+0000 7ff59300fec0 20 remove_watcher() i=3 2019-11-28T22:20:39.182 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.182+0000 7ff59300fec0 20 remove_watcher() i=4 2019-11-28T22:20:39.221 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.221+0000 7ff59300fec0 20 remove_watcher() i=5 2019-11-28T22:20:39.252 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.252+0000 7ff59300fec0 20 remove_watcher() i=6 2019-11-28T22:20:39.280 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.279+0000 7ff59300fec0 20 remove_watcher() i=7 2019-11-28T22:20:39.288 INFO:teuthology.orchestra.run.smithi074:> radosgw-admin gc process --include-all 2019-11-28T22:20:39.399 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.399+0000 7fd20faa6ec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:39.428 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.427+0000 7fd20faa6ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:20:39.428 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.427+0000 7fd20faa6ec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:39.439 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.438+0000 7fd20faa6ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:20:39.439 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.438+0000 7fd20faa6ec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:39.451 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.449+0000 7fd20faa6ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:20:39.451 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.449+0000 7fd20faa6ec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:39.471 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.470+0000 7fd20faa6ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:20:39.895 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.890+0000 7fd20faa6ec0 20 RGWRados::pool_iterate: got zonegroup_info.cb1773b4-411c-4317-a760-df89ca0f54fc 2019-11-28T22:20:39.895 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.890+0000 7fd20faa6ec0 20 RGWRados::pool_iterate: got zone_info.bd5ae442-b074-4d35-94cc-b1d71bd6ac02 2019-11-28T22:20:39.895 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.890+0000 7fd20faa6ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-28T22:20:39.895 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.890+0000 7fd20faa6ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-28T22:20:39.896 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.890+0000 7fd20faa6ec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:39.904 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.902+0000 7fd20faa6ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:20:39.904 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.902+0000 7fd20faa6ec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:39.916 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.914+0000 7fd20faa6ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T22:20:39.916 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.914+0000 7fd20faa6ec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:39.927 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.924+0000 7fd20faa6ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:20:39.927 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.925+0000 7fd20faa6ec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:39.941 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.939+0000 7fd20faa6ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T22:20:39.941 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.939+0000 7fd20faa6ec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:39.950 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.948+0000 7fd20faa6ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:20:39.950 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.948+0000 7fd20faa6ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-28T22:20:39.950 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.948+0000 7fd20faa6ec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:39.958 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.957+0000 7fd20faa6ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:20:39.958 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.957+0000 7fd20faa6ec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:39.966 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.965+0000 7fd20faa6ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:20:39.966 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.965+0000 7fd20faa6ec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:39.977 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.976+0000 7fd20faa6ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T22:20:39.978 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.976+0000 7fd20faa6ec0 20 zonegroup default 2019-11-28T22:20:39.978 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.976+0000 7fd20faa6ec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:39.987 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.985+0000 7fd20faa6ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:20:39.987 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.985+0000 7fd20faa6ec0 10 Cannot find current period zone using local zone 2019-11-28T22:20:39.987 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.985+0000 7fd20faa6ec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:39.996 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.994+0000 7fd20faa6ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:20:39.996 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:39.994+0000 7fd20faa6ec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:40.005 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:40.003+0000 7fd20faa6ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:20:40.005 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:40.003+0000 7fd20faa6ec0 20 rados->read ofs=0 len=0 2019-11-28T22:20:40.016 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:40.014+0000 7fd20faa6ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T22:20:40.016 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:40.014+0000 7fd20faa6ec0 20 zone default found 2019-11-28T22:20:40.016 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:40.014+0000 7fd20faa6ec0 20 started sync module instance, tier type = 2019-11-28T22:20:40.016 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:40.014+0000 7fd20faa6ec0 20 started zone id=bd5ae442-b074-4d35-94cc-b1d71bd6ac02 (name=default) with tier type = 2019-11-28T22:20:40.449 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:40.447+0000 7fd20faa6ec0 20 add_watcher() i=0 2019-11-28T22:20:40.449 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:40.447+0000 7fd20faa6ec0 20 add_watcher() i=1 2019-11-28T22:20:40.450 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:40.447+0000 7fd20faa6ec0 20 add_watcher() i=2 2019-11-28T22:20:40.450 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:40.447+0000 7fd20faa6ec0 20 add_watcher() i=3 2019-11-28T22:20:40.450 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:40.447+0000 7fd20faa6ec0 20 add_watcher() i=4 2019-11-28T22:20:40.450 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:40.447+0000 7fd20faa6ec0 20 add_watcher() i=5 2019-11-28T22:20:40.452 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:40.450+0000 7fd20faa6ec0 20 add_watcher() i=6 2019-11-28T22:20:40.488 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:40.486+0000 7fd20faa6ec0 20 add_watcher() i=7 2019-11-28T22:20:40.488 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:40.486+0000 7fd20faa6ec0 2 all 8 watchers are set, enabling cache 2019-11-28T22:20:40.488 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:40.486+0000 7fd1ccfe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-28T22:20:40.493 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:40.492+0000 7fd1fd4d4700 0 -- 172.21.15.74:0/2550797472 >> [v2:172.21.15.74:3301/0,v1:172.21.15.74:6790/0] conn(0x55ebc8e1e720 msgr2=0x55ebc8e45470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-28T22:20:40.695 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:40.694+0000 7fd1fd4d4700 0 --2- 172.21.15.74:0/2550797472 >> [v2:172.21.15.74:3301/0,v1:172.21.15.74:6790/0] conn(0x55ebc8e1e720 0x55ebc8e45470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-28T22:20:40.737 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:40.736+0000 7fd1fccd3700 0 -- 172.21.15.74:0/753243668 >> [v2:172.21.15.74:3301/0,v1:172.21.15.74:6790/0] conn(0x55ebc8e59d40 msgr2=0x55ebc8e5a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-28T22:20:42.666 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:42.663+0000 7fd13effd700 20 reqs_thread_entry: start 2019-11-28T22:20:42.666 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:42.664+0000 7fd13cff9700 20 reqs_thread_entry: start 2019-11-28T22:20:42.666 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:42.664+0000 7fd20faa6ec0 20 init_complete bucket index max shards: 0 2019-11-28T22:20:42.666 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:42.664+0000 7fd132ffd700 20 reqs_thread_entry: start 2019-11-28T22:20:42.666 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:42.664+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-28T22:20:42.753 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:42.751+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:42.772 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:42.770+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:42.784 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:42.782+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:42.828 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:42.826+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-28T22:20:42.902 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:42.900+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:42.932 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:42.930+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:42.952 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:42.951+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:43.009 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:43.007+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-28T22:20:43.074 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:43.072+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:43.095 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:43.093+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:43.106 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:43.104+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:43.144 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:43.143+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-28T22:20:43.206 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:43.204+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:43.226 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:43.224+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:43.238 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:43.237+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:43.284 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:43.283+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-28T22:20:43.350 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:43.349+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:43.365 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:43.364+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:43.381 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:43.380+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:43.549 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:43.547+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-28T22:20:43.613 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:43.612+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:43.636 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:43.635+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:43.649 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:43.648+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:43.690 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:43.688+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-28T22:20:43.743 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:43.742+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:43.760 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:43.758+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:43.769 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:43.767+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:43.802 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:43.801+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-28T22:20:43.842 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:43.840+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:43.859 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:43.858+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:43.870 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:43.869+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:43.901 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:43.900+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-28T22:20:43.958 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:43.956+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:43.974 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:43.973+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:43.982 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:43.981+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:44.023 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:44.021+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-28T22:20:44.079 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:44.078+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:44.096 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:44.094+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:44.105 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:44.103+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:44.147 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:44.145+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-28T22:20:44.218 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:44.216+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:44.237 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:44.235+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:44.247 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:44.246+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:44.286 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:44.284+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-28T22:20:44.349 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:44.348+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:44.367 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:44.365+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:44.377 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:44.375+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:44.423 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:44.421+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-28T22:20:44.488 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:44.487+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:44.510 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:44.508+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:44.522 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:44.520+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:44.567 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:44.565+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-28T22:20:44.613 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:44.611+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:44.631 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:44.630+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:44.642 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:44.640+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:44.678 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:44.677+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-28T22:20:44.716 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:44.715+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:44.734 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:44.732+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:44.742 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:44.740+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:44.797 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:44.795+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-28T22:20:44.843 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:44.841+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:44.858 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:44.856+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:44.867 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:44.865+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:44.918 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:44.916+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-28T22:20:44.990 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:44.988+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:45.018 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:45.017+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:45.030 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:45.029+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:45.065 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:45.063+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-28T22:20:45.119 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:45.117+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:45.133 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:45.131+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:45.142 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:45.141+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:45.185 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:45.183+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-28T22:20:45.259 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:45.258+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:45.282 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:45.280+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:45.297 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:45.296+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:45.343 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:45.342+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-28T22:20:45.417 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:45.415+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:45.448 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:45.446+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:45.463 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:45.461+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:45.510 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:45.509+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-28T22:20:45.574 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:45.573+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:45.594 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:45.592+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:45.606 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:45.604+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:45.650 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:45.648+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-28T22:20:45.725 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:45.723+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:45.753 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:45.751+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:45.767 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:45.766+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:45.810 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:45.808+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-28T22:20:45.853 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:45.851+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:45.870 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:45.868+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:45.878 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:45.876+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:45.927 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:45.925+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-28T22:20:46.024 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:46.022+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:46.055 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:46.054+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:46.066 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:46.065+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:46.113 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:46.111+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-28T22:20:46.185 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:46.183+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:46.213 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:46.211+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:46.227 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:46.225+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:46.268 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:46.266+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-28T22:20:46.349 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:46.347+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:46.379 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:46.377+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:46.391 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:46.390+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:46.444 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:46.442+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-28T22:20:46.504 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:46.502+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:46.531 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:46.529+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:46.546 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:46.544+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:46.589 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:46.588+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-28T22:20:46.648 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:46.646+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:46.667 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:46.665+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:46.678 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:46.677+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:46.713 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:46.712+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-28T22:20:46.775 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:46.773+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:46.808 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:46.806+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:46.817 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:46.815+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:46.853 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:46.851+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-28T22:20:46.901 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:46.900+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:46.920 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:46.919+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:46.929 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:46.928+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:46.960 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:46.959+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-28T22:20:47.008 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:47.006+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:47.040 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:47.038+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:47.061 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:47.059+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:47.103 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:47.101+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-28T22:20:47.151 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:47.150+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:47.168 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:47.166+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:20:47.176 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:47.174+0000 7fd20faa6ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:20:47.255 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:47.253+0000 7fd20faa6ec0 20 remove_watcher() i=0 2019-11-28T22:20:47.255 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:47.253+0000 7fd20faa6ec0 2 removed watcher, disabling cache 2019-11-28T22:20:47.305 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:47.304+0000 7fd20faa6ec0 20 remove_watcher() i=1 2019-11-28T22:20:47.370 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:47.369+0000 7fd20faa6ec0 20 remove_watcher() i=2 2019-11-28T22:20:47.428 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:47.427+0000 7fd20faa6ec0 20 remove_watcher() i=3 2019-11-28T22:20:47.485 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:47.483+0000 7fd20faa6ec0 20 remove_watcher() i=4 2019-11-28T22:20:47.527 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:47.525+0000 7fd20faa6ec0 20 remove_watcher() i=5 2019-11-28T22:20:47.584 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:47.582+0000 7fd20faa6ec0 20 remove_watcher() i=6 2019-11-28T22:20:47.636 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:20:47.635+0000 7fd20faa6ec0 20 remove_watcher() i=7 2019-11-28T22:20:47.647 INFO:teuthology.orchestra.run.smithi074:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2019-11-28T22:20:48.354 INFO:teuthology.orchestra.run.smithi074.stdout:> Task :clean 2019-11-28T22:20:48.951 INFO:teuthology.orchestra.run.smithi074.stdout:> Task :compileJava 2019-11-28T22:20:48.951 INFO:teuthology.orchestra.run.smithi074.stdout:> Task :processResources 2019-11-28T22:20:48.951 INFO:teuthology.orchestra.run.smithi074.stdout:> Task :classes 2019-11-28T22:20:49.252 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:20:49.253 INFO:teuthology.orchestra.run.smithi074.stdout:> Task :compileTestJava 2019-11-28T22:20:49.253 INFO:teuthology.orchestra.run.smithi074.stdout:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2019-11-28T22:20:49.253 INFO:teuthology.orchestra.run.smithi074.stdout:Note: Recompile with -Xlint:deprecation for details. 2019-11-28T22:20:49.253 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:20:49.253 INFO:teuthology.orchestra.run.smithi074.stdout:> Task :processTestResources NO-SOURCE 2019-11-28T22:20:49.253 INFO:teuthology.orchestra.run.smithi074.stdout:> Task :testClasses 2019-11-28T22:20:51.251 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:20:51.252 INFO:teuthology.orchestra.run.smithi074.stdout:> Task :test 2019-11-28T22:20:51.252 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:20:51.252 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2019-11-28T22:20:53.051 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:20:53.051 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2019-11-28T22:20:56.951 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:20:56.952 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2019-11-28T22:20:58.751 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:20:58.751 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2019-11-28T22:21:03.651 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:21:03.651 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2019-11-28T22:21:05.851 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:21:05.851 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2019-11-28T22:21:11.551 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:21:11.551 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2019-11-28T22:21:18.651 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:21:18.651 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2019-11-28T22:21:19.351 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:21:19.351 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2019-11-28T22:21:23.851 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:21:23.851 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2019-11-28T22:21:28.851 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:21:28.851 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2019-11-28T22:21:29.151 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:21:29.151 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2019-11-28T22:21:30.151 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:21:30.151 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2019-11-28T22:21:35.851 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:21:35.851 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2019-11-28T22:21:46.851 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:21:46.851 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2019-11-28T22:21:49.851 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:21:49.851 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2019-11-28T22:21:54.751 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:21:54.751 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2019-11-28T22:21:54.951 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:21:54.951 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2019-11-28T22:21:55.988 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:21:55.988 INFO:teuthology.orchestra.run.smithi074.stdout:-------------------------------------------------------------------- 2019-11-28T22:21:55.988 INFO:teuthology.orchestra.run.smithi074.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2019-11-28T22:21:55.988 INFO:teuthology.orchestra.run.smithi074.stdout:-------------------------------------------------------------------- 2019-11-28T22:21:55.989 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:21:55.989 INFO:teuthology.orchestra.run.smithi074.stdout:BUILD SUCCESSFUL in 1m 8s 2019-11-28T22:21:55.989 INFO:teuthology.orchestra.run.smithi074.stdout:5 actionable tasks: 5 executed 2019-11-28T22:21:55.992 INFO:teuthology.orchestra.run.smithi074:> radosgw-admin gc process --include-all 2019-11-28T22:21:56.117 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.116+0000 7f1eabac5ec0 20 rados->read ofs=0 len=0 2019-11-28T22:21:56.149 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.148+0000 7f1eabac5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:21:56.149 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.148+0000 7f1eabac5ec0 20 rados->read ofs=0 len=0 2019-11-28T22:21:56.160 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.159+0000 7f1eabac5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:21:56.160 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.159+0000 7f1eabac5ec0 20 rados->read ofs=0 len=0 2019-11-28T22:21:56.172 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.172+0000 7f1eabac5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:21:56.172 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.172+0000 7f1eabac5ec0 20 rados->read ofs=0 len=0 2019-11-28T22:21:56.196 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.195+0000 7f1eabac5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:21:56.440 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.439+0000 7f1eabac5ec0 20 RGWRados::pool_iterate: got zonegroup_info.cb1773b4-411c-4317-a760-df89ca0f54fc 2019-11-28T22:21:56.440 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.439+0000 7f1eabac5ec0 20 RGWRados::pool_iterate: got zone_info.bd5ae442-b074-4d35-94cc-b1d71bd6ac02 2019-11-28T22:21:56.440 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.439+0000 7f1eabac5ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-28T22:21:56.440 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.439+0000 7f1eabac5ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-28T22:21:56.440 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.439+0000 7f1eabac5ec0 20 rados->read ofs=0 len=0 2019-11-28T22:21:56.456 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.455+0000 7f1eabac5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:21:56.457 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.455+0000 7f1eabac5ec0 20 rados->read ofs=0 len=0 2019-11-28T22:21:56.468 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.468+0000 7f1eabac5ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T22:21:56.469 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.468+0000 7f1eabac5ec0 20 rados->read ofs=0 len=0 2019-11-28T22:21:56.481 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.480+0000 7f1eabac5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:21:56.481 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.480+0000 7f1eabac5ec0 20 rados->read ofs=0 len=0 2019-11-28T22:21:56.496 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.495+0000 7f1eabac5ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T22:21:56.496 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.495+0000 7f1eabac5ec0 20 rados->read ofs=0 len=0 2019-11-28T22:21:56.510 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.509+0000 7f1eabac5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:21:56.510 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.509+0000 7f1eabac5ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-28T22:21:56.510 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.509+0000 7f1eabac5ec0 20 rados->read ofs=0 len=0 2019-11-28T22:21:56.519 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.519+0000 7f1eabac5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:21:56.519 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.519+0000 7f1eabac5ec0 20 rados->read ofs=0 len=0 2019-11-28T22:21:56.536 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.536+0000 7f1eabac5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:21:56.536 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.536+0000 7f1eabac5ec0 20 rados->read ofs=0 len=0 2019-11-28T22:21:56.549 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.548+0000 7f1eabac5ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T22:21:56.549 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.548+0000 7f1eabac5ec0 20 zonegroup default 2019-11-28T22:21:56.549 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.548+0000 7f1eabac5ec0 20 rados->read ofs=0 len=0 2019-11-28T22:21:56.562 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.562+0000 7f1eabac5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:21:56.562 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.562+0000 7f1eabac5ec0 10 Cannot find current period zone using local zone 2019-11-28T22:21:56.562 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.562+0000 7f1eabac5ec0 20 rados->read ofs=0 len=0 2019-11-28T22:21:56.569 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.568+0000 7f1eabac5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:21:56.569 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.568+0000 7f1eabac5ec0 20 rados->read ofs=0 len=0 2019-11-28T22:21:56.579 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.578+0000 7f1eabac5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:21:56.579 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.578+0000 7f1eabac5ec0 20 rados->read ofs=0 len=0 2019-11-28T22:21:56.589 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.587+0000 7f1eabac5ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T22:21:56.589 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.587+0000 7f1eabac5ec0 20 zone default found 2019-11-28T22:21:56.589 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.587+0000 7f1eabac5ec0 20 started sync module instance, tier type = 2019-11-28T22:21:56.589 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.587+0000 7f1eabac5ec0 20 started zone id=bd5ae442-b074-4d35-94cc-b1d71bd6ac02 (name=default) with tier type = 2019-11-28T22:21:56.937 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.934+0000 7f1eabac5ec0 20 add_watcher() i=0 2019-11-28T22:21:56.937 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.934+0000 7f1eabac5ec0 20 add_watcher() i=1 2019-11-28T22:21:56.937 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.934+0000 7f1eabac5ec0 20 add_watcher() i=2 2019-11-28T22:21:56.937 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.934+0000 7f1eabac5ec0 20 add_watcher() i=3 2019-11-28T22:21:56.937 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.934+0000 7f1eabac5ec0 20 add_watcher() i=4 2019-11-28T22:21:56.938 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.934+0000 7f1eabac5ec0 20 add_watcher() i=5 2019-11-28T22:21:56.938 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.934+0000 7f1eabac5ec0 20 add_watcher() i=6 2019-11-28T22:21:56.984 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.983+0000 7f1eabac5ec0 20 add_watcher() i=7 2019-11-28T22:21:56.984 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.983+0000 7f1eabac5ec0 2 all 8 watchers are set, enabling cache 2019-11-28T22:21:56.985 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.984+0000 7f1e697e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-28T22:21:56.990 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:56.990+0000 7f1e984f1700 0 -- 172.21.15.74:0/1414252989 >> [v2:172.21.15.74:3301/0,v1:172.21.15.74:6790/0] conn(0x55ae138ddf40 msgr2=0x55ae1391e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-28T22:21:57.192 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:57.192+0000 7f1e984f1700 0 --2- 172.21.15.74:0/1414252989 >> [v2:172.21.15.74:3301/0,v1:172.21.15.74:6790/0] conn(0x55ae138ddf40 0x55ae1391e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-28T22:21:57.235 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:57.234+0000 7f1e994f3700 0 -- 172.21.15.74:0/1804228307 >> [v2:172.21.15.74:6800/9122,v1:172.21.15.74:6801/9122] conn(0x7f1ddc017580 msgr2=0x7f1ddc019a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-28T22:21:58.735 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:58.734+0000 7f1ddb7fe700 20 reqs_thread_entry: start 2019-11-28T22:21:58.735 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:58.735+0000 7f1dd97fa700 20 reqs_thread_entry: start 2019-11-28T22:21:58.736 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:58.735+0000 7f1eabac5ec0 20 init_complete bucket index max shards: 0 2019-11-28T22:21:58.736 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:58.735+0000 7f1dc77fe700 20 reqs_thread_entry: start 2019-11-28T22:21:58.736 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:58.735+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-28T22:21:58.786 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:58.785+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:21:58.802 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:58.802+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:21:58.810 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:58.810+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:21:58.843 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:58.842+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-28T22:21:58.913 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:58.913+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:21:58.933 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:58.933+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:21:58.950 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:58.950+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:21:59.001 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:59.001+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-28T22:21:59.050 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:59.049+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:21:59.068 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:59.067+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:21:59.079 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:59.079+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:21:59.127 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:59.126+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-28T22:21:59.201 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:59.196+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:21:59.220 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:59.219+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:21:59.231 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:59.231+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:21:59.281 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:59.277+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-28T22:21:59.323 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:59.322+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:21:59.339 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:59.337+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:21:59.356 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:59.348+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:21:59.397 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:59.390+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-28T22:21:59.448 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:59.447+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:21:59.483 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:59.480+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:21:59.490 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:59.488+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:21:59.535 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:59.533+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-28T22:21:59.580 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:59.580+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:21:59.601 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:59.600+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:21:59.614 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:59.613+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:21:59.657 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:59.656+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-28T22:21:59.718 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:59.717+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:21:59.747 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:59.746+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:21:59.765 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:59.764+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:21:59.814 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:59.814+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-28T22:21:59.872 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:59.871+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:21:59.887 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:59.886+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:21:59.897 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:59.896+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:21:59.944 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:21:59.944+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-28T22:22:00.013 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:00.013+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:00.051 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:00.050+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:00.073 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:00.073+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:00.137 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:00.136+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-28T22:22:00.191 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:00.190+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:00.214 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:00.214+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:00.226 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:00.226+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:00.273 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:00.272+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-28T22:22:00.336 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:00.335+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:00.365 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:00.365+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:00.378 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:00.378+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:00.434 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:00.433+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-28T22:22:00.509 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:00.508+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:00.529 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:00.528+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:00.541 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:00.541+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:00.587 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:00.586+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-28T22:22:00.638 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:00.637+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:00.657 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:00.656+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:00.666 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:00.666+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:00.708 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:00.707+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-28T22:22:00.753 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:00.752+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:00.774 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:00.773+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:00.785 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:00.785+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:00.827 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:00.827+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-28T22:22:00.869 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:00.868+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:00.886 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:00.885+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:00.894 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:00.893+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:00.930 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:00.930+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-28T22:22:01.040 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:01.039+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:01.071 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:01.071+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:01.089 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:01.088+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:01.161 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:01.160+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-28T22:22:01.233 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:01.232+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:01.264 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:01.263+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:01.280 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:01.279+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:01.345 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:01.344+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-28T22:22:01.405 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:01.404+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:01.430 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:01.430+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:01.445 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:01.445+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:01.489 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:01.488+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-28T22:22:01.539 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:01.539+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:01.557 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:01.557+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:01.568 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:01.567+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:01.610 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:01.609+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-28T22:22:01.653 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:01.652+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:01.671 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:01.671+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:01.684 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:01.683+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:01.727 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:01.726+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-28T22:22:01.785 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:01.784+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:01.807 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:01.806+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:01.818 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:01.818+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:01.882 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:01.881+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-28T22:22:01.938 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:01.937+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:01.970 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:01.970+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:01.980 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:01.980+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:02.023 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:02.023+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-28T22:22:02.148 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:02.147+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:02.176 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:02.176+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:02.191 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:02.191+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:02.252 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:02.251+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-28T22:22:02.338 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:02.337+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:02.365 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:02.364+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:02.383 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:02.383+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:02.428 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:02.427+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-28T22:22:02.488 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:02.487+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:02.507 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:02.506+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:02.515 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:02.515+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:02.566 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:02.565+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-28T22:22:02.625 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:02.624+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:02.654 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:02.653+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:02.668 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:02.667+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:02.737 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:02.736+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-28T22:22:02.807 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:02.806+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:02.828 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:02.827+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:02.840 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:02.839+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:02.881 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:02.880+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-28T22:22:02.952 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:02.951+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:02.974 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:02.974+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:02.989 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:02.988+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:03.043 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:03.043+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-28T22:22:03.105 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:03.104+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:03.128 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:03.128+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:03.139 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:03.138+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:03.203 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:03.202+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-28T22:22:03.285 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:03.284+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:03.312 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:03.311+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:03.327 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:03.326+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:03.370 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:03.369+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-28T22:22:03.418 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:03.418+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:03.434 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:03.434+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:03.443 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:03.442+0000 7f1eabac5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:03.509 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:03.509+0000 7f1eabac5ec0 20 remove_watcher() i=0 2019-11-28T22:22:03.510 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:03.509+0000 7f1eabac5ec0 2 removed watcher, disabling cache 2019-11-28T22:22:03.555 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:03.555+0000 7f1eabac5ec0 20 remove_watcher() i=1 2019-11-28T22:22:03.596 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:03.595+0000 7f1eabac5ec0 20 remove_watcher() i=2 2019-11-28T22:22:03.655 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:03.654+0000 7f1eabac5ec0 20 remove_watcher() i=3 2019-11-28T22:22:03.691 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:03.690+0000 7f1eabac5ec0 20 remove_watcher() i=4 2019-11-28T22:22:03.722 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:03.722+0000 7f1eabac5ec0 20 remove_watcher() i=5 2019-11-28T22:22:03.752 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:03.751+0000 7f1eabac5ec0 20 remove_watcher() i=6 2019-11-28T22:22:03.792 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:03.791+0000 7f1eabac5ec0 20 remove_watcher() i=7 2019-11-28T22:22:03.801 INFO:teuthology.orchestra.run.smithi074:> radosgw-admin gc process --include-all 2019-11-28T22:22:03.913 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:03.912+0000 7f25e523fec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:03.943 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:03.942+0000 7f25e523fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:22:03.943 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:03.942+0000 7f25e523fec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:03.953 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:03.953+0000 7f25e523fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:22:03.954 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:03.953+0000 7f25e523fec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:03.965 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:03.964+0000 7f25e523fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:22:03.965 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:03.964+0000 7f25e523fec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:03.986 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:03.985+0000 7f25e523fec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:22:04.213 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.212+0000 7f25e523fec0 20 RGWRados::pool_iterate: got zonegroup_info.cb1773b4-411c-4317-a760-df89ca0f54fc 2019-11-28T22:22:04.213 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.212+0000 7f25e523fec0 20 RGWRados::pool_iterate: got zone_info.bd5ae442-b074-4d35-94cc-b1d71bd6ac02 2019-11-28T22:22:04.214 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.212+0000 7f25e523fec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-28T22:22:04.214 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.212+0000 7f25e523fec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-28T22:22:04.214 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.212+0000 7f25e523fec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:04.228 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.228+0000 7f25e523fec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:22:04.228 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.228+0000 7f25e523fec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:04.244 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.244+0000 7f25e523fec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T22:22:04.245 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.244+0000 7f25e523fec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:04.264 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.263+0000 7f25e523fec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:22:04.264 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.263+0000 7f25e523fec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:04.279 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.279+0000 7f25e523fec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T22:22:04.279 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.279+0000 7f25e523fec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:04.293 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.293+0000 7f25e523fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:22:04.293 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.293+0000 7f25e523fec0 10 cannot find current period zonegroup using local zonegroup 2019-11-28T22:22:04.294 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.293+0000 7f25e523fec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:04.306 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.305+0000 7f25e523fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:22:04.306 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.305+0000 7f25e523fec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:04.322 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.321+0000 7f25e523fec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:22:04.322 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.321+0000 7f25e523fec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:04.337 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.336+0000 7f25e523fec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T22:22:04.337 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.336+0000 7f25e523fec0 20 zonegroup default 2019-11-28T22:22:04.337 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.337+0000 7f25e523fec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:04.347 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.346+0000 7f25e523fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:22:04.347 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.346+0000 7f25e523fec0 10 Cannot find current period zone using local zone 2019-11-28T22:22:04.347 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.346+0000 7f25e523fec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:04.358 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.357+0000 7f25e523fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:22:04.358 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.357+0000 7f25e523fec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:04.368 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.368+0000 7f25e523fec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:22:04.369 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.368+0000 7f25e523fec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:04.389 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.389+0000 7f25e523fec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T22:22:04.390 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.389+0000 7f25e523fec0 20 zone default found 2019-11-28T22:22:04.390 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.389+0000 7f25e523fec0 20 started sync module instance, tier type = 2019-11-28T22:22:04.390 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.389+0000 7f25e523fec0 20 started zone id=bd5ae442-b074-4d35-94cc-b1d71bd6ac02 (name=default) with tier type = 2019-11-28T22:22:04.778 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.777+0000 7f25e523fec0 20 add_watcher() i=0 2019-11-28T22:22:04.778 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.777+0000 7f25e523fec0 20 add_watcher() i=1 2019-11-28T22:22:04.778 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.777+0000 7f25e523fec0 20 add_watcher() i=2 2019-11-28T22:22:04.778 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.777+0000 7f25e523fec0 20 add_watcher() i=3 2019-11-28T22:22:04.778 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.777+0000 7f25e523fec0 20 add_watcher() i=4 2019-11-28T22:22:04.778 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.777+0000 7f25e523fec0 20 add_watcher() i=5 2019-11-28T22:22:04.779 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.777+0000 7f25e523fec0 20 add_watcher() i=6 2019-11-28T22:22:04.812 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.811+0000 7f25e523fec0 20 add_watcher() i=7 2019-11-28T22:22:04.812 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.811+0000 7f25e523fec0 2 all 8 watchers are set, enabling cache 2019-11-28T22:22:04.812 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.811+0000 7f25a2fdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-28T22:22:04.825 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.825+0000 7f25cbfff700 0 -- 172.21.15.74:0/1738286984 >> [v2:172.21.15.74:3301/0,v1:172.21.15.74:6790/0] conn(0x5639d81372e0 msgr2=0x5639d813a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-28T22:22:04.958 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:04.958+0000 7f25d2c6d700 0 -- 172.21.15.74:0/2365543272 >> [v2:172.21.15.141:6818/9904,v1:172.21.15.141:6820/9904] conn(0x5639d8169bc0 msgr2=0x5639d816bfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-28T22:22:06.677 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:06.676+0000 7f25117fa700 20 reqs_thread_entry: start 2019-11-28T22:22:06.677 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:06.676+0000 7f250affd700 20 reqs_thread_entry: start 2019-11-28T22:22:06.677 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:06.676+0000 7f25e523fec0 20 init_complete bucket index max shards: 0 2019-11-28T22:22:06.678 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:06.677+0000 7f25097fa700 20 reqs_thread_entry: start 2019-11-28T22:22:06.678 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:06.677+0000 7f25e523fec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-28T22:22:06.730 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:06.730+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:06.750 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:06.749+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:06.764 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:06.764+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:06.797 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:06.796+0000 7f25e523fec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-28T22:22:06.861 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:06.861+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:06.886 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:06.885+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:06.899 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:06.897+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:06.961 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:06.959+0000 7f25e523fec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-28T22:22:07.019 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:07.018+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:07.042 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:07.041+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:07.060 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:07.058+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:07.116 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:07.114+0000 7f25e523fec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-28T22:22:07.192 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:07.191+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:07.216 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:07.214+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:07.230 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:07.229+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:07.274 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:07.272+0000 7f25e523fec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-28T22:22:07.351 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:07.350+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:07.373 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:07.371+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:07.382 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:07.381+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:07.420 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:07.419+0000 7f25e523fec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-28T22:22:07.480 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:07.479+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:07.503 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:07.502+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:07.513 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:07.512+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:07.548 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:07.546+0000 7f25e523fec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-28T22:22:07.600 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:07.598+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:07.618 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:07.616+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:07.628 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:07.626+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:07.673 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:07.671+0000 7f25e523fec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-28T22:22:07.713 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:07.712+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:07.730 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:07.728+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:07.752 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:07.750+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:07.798 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:07.797+0000 7f25e523fec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-28T22:22:07.852 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:07.850+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:07.872 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:07.868+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:07.880 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:07.878+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:07.914 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:07.913+0000 7f25e523fec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-28T22:22:07.983 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:07.981+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:08.002 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:08.000+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:08.014 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:08.012+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:08.050 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:08.048+0000 7f25e523fec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-28T22:22:08.091 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:08.090+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:08.113 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:08.112+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:08.123 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:08.121+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:08.158 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:08.157+0000 7f25e523fec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-28T22:22:08.209 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:08.207+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:08.226 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:08.225+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:08.247 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:08.245+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:08.298 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:08.297+0000 7f25e523fec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-28T22:22:08.384 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:08.382+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:08.413 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:08.411+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:08.432 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:08.430+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:08.485 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:08.483+0000 7f25e523fec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-28T22:22:08.564 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:08.562+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:08.594 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:08.592+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:08.609 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:08.607+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:08.676 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:08.675+0000 7f25e523fec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-28T22:22:08.753 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:08.751+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:08.780 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:08.778+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:08.792 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:08.790+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:08.841 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:08.839+0000 7f25e523fec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-28T22:22:08.897 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:08.895+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:08.916 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:08.914+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:08.930 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:08.928+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:08.968 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:08.966+0000 7f25e523fec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-28T22:22:09.015 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:09.014+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:09.031 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:09.030+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:09.041 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:09.040+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:09.085 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:09.083+0000 7f25e523fec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-28T22:22:09.142 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:09.140+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:09.164 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:09.162+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:09.177 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:09.175+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:09.245 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:09.243+0000 7f25e523fec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-28T22:22:09.334 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:09.333+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:09.362 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:09.361+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:09.376 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:09.375+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:09.434 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:09.432+0000 7f25e523fec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-28T22:22:09.519 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:09.517+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:09.546 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:09.544+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:09.563 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:09.562+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:09.634 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:09.632+0000 7f25e523fec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-28T22:22:09.717 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:09.715+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:09.743 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:09.741+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:09.757 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:09.755+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:09.810 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:09.808+0000 7f25e523fec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-28T22:22:09.885 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:09.884+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:09.912 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:09.910+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:09.935 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:09.934+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:09.986 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:09.985+0000 7f25e523fec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-28T22:22:10.082 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:10.081+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:10.111 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:10.110+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:10.121 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:10.119+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:10.173 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:10.171+0000 7f25e523fec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-28T22:22:10.228 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:10.226+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:10.243 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:10.241+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:10.251 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:10.250+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:10.293 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:10.291+0000 7f25e523fec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-28T22:22:10.375 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:10.374+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:10.403 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:10.402+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:10.421 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:10.419+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:10.488 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:10.486+0000 7f25e523fec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-28T22:22:10.543 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:10.541+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:10.562 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:10.560+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:10.573 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:10.571+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:10.617 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:10.616+0000 7f25e523fec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-28T22:22:10.696 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:10.694+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:10.723 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:10.722+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:10.737 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:10.736+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:10.780 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:10.779+0000 7f25e523fec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-28T22:22:10.832 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:10.831+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:10.857 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:10.854+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:10.874 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:10.867+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:10.933 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:10.932+0000 7f25e523fec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-28T22:22:11.017 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:11.016+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:11.043 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:11.041+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:11.057 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:11.056+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:11.112 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:11.110+0000 7f25e523fec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-28T22:22:11.205 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:11.204+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:11.233 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:11.231+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:11.295 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:11.243+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:11.295 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:11.288+0000 7f25e523fec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-28T22:22:11.350 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:11.349+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:11.372 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:11.370+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:11.379 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:11.378+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:11.424 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:11.422+0000 7f25e523fec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-28T22:22:11.520 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:11.518+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:11.548 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:11.546+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:11.562 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:11.561+0000 7f25e523fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:11.691 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:11.689+0000 7f25e523fec0 20 remove_watcher() i=0 2019-11-28T22:22:11.691 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:11.689+0000 7f25e523fec0 2 removed watcher, disabling cache 2019-11-28T22:22:11.760 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:11.759+0000 7f25e523fec0 20 remove_watcher() i=1 2019-11-28T22:22:11.813 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:11.811+0000 7f25e523fec0 20 remove_watcher() i=2 2019-11-28T22:22:11.880 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:11.879+0000 7f25e523fec0 20 remove_watcher() i=3 2019-11-28T22:22:11.918 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:11.916+0000 7f25e523fec0 20 remove_watcher() i=4 2019-11-28T22:22:11.963 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:11.961+0000 7f25e523fec0 20 remove_watcher() i=5 2019-11-28T22:22:11.995 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:11.994+0000 7f25e523fec0 20 remove_watcher() i=6 2019-11-28T22:22:12.031 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.030+0000 7f25e523fec0 20 remove_watcher() i=7 2019-11-28T22:22:12.038 INFO:teuthology.orchestra.run.smithi074:> radosgw-admin gc process --include-all 2019-11-28T22:22:12.157 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.155+0000 7f3c64e4cec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:12.188 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.186+0000 7f3c64e4cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:22:12.188 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.186+0000 7f3c64e4cec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:12.199 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.197+0000 7f3c64e4cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:22:12.199 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.197+0000 7f3c64e4cec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:12.212 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.211+0000 7f3c64e4cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:22:12.213 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.211+0000 7f3c64e4cec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:12.231 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.230+0000 7f3c64e4cec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:22:12.483 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.481+0000 7f3c64e4cec0 20 RGWRados::pool_iterate: got zonegroup_info.cb1773b4-411c-4317-a760-df89ca0f54fc 2019-11-28T22:22:12.517 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.481+0000 7f3c64e4cec0 20 RGWRados::pool_iterate: got zone_info.bd5ae442-b074-4d35-94cc-b1d71bd6ac02 2019-11-28T22:22:12.517 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.481+0000 7f3c64e4cec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-28T22:22:12.517 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.481+0000 7f3c64e4cec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-28T22:22:12.518 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.481+0000 7f3c64e4cec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:12.518 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.494+0000 7f3c64e4cec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:22:12.518 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.494+0000 7f3c64e4cec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:12.518 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.512+0000 7f3c64e4cec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T22:22:12.519 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.512+0000 7f3c64e4cec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:12.526 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.524+0000 7f3c64e4cec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:22:12.526 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.524+0000 7f3c64e4cec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:12.535 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.533+0000 7f3c64e4cec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T22:22:12.535 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.533+0000 7f3c64e4cec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:12.545 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.543+0000 7f3c64e4cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:22:12.545 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.543+0000 7f3c64e4cec0 10 cannot find current period zonegroup using local zonegroup 2019-11-28T22:22:12.545 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.543+0000 7f3c64e4cec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:12.556 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.555+0000 7f3c64e4cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:22:12.557 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.555+0000 7f3c64e4cec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:12.574 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.572+0000 7f3c64e4cec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:22:12.574 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.572+0000 7f3c64e4cec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:12.584 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.583+0000 7f3c64e4cec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T22:22:12.585 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.583+0000 7f3c64e4cec0 20 zonegroup default 2019-11-28T22:22:12.585 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.583+0000 7f3c64e4cec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:12.594 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.592+0000 7f3c64e4cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:22:12.594 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.592+0000 7f3c64e4cec0 10 Cannot find current period zone using local zone 2019-11-28T22:22:12.594 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.592+0000 7f3c64e4cec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:12.608 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.607+0000 7f3c64e4cec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:22:12.609 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.607+0000 7f3c64e4cec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:12.618 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.617+0000 7f3c64e4cec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:22:12.618 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.617+0000 7f3c64e4cec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:12.629 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.627+0000 7f3c64e4cec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T22:22:12.629 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.627+0000 7f3c64e4cec0 20 zone default found 2019-11-28T22:22:12.629 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.627+0000 7f3c64e4cec0 20 started sync module instance, tier type = 2019-11-28T22:22:12.629 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.627+0000 7f3c64e4cec0 20 started zone id=bd5ae442-b074-4d35-94cc-b1d71bd6ac02 (name=default) with tier type = 2019-11-28T22:22:12.998 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.996+0000 7f3c64e4cec0 20 add_watcher() i=0 2019-11-28T22:22:12.998 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.996+0000 7f3c64e4cec0 20 add_watcher() i=1 2019-11-28T22:22:12.998 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.996+0000 7f3c64e4cec0 20 add_watcher() i=2 2019-11-28T22:22:12.998 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.996+0000 7f3c64e4cec0 20 add_watcher() i=3 2019-11-28T22:22:12.999 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.996+0000 7f3c64e4cec0 20 add_watcher() i=4 2019-11-28T22:22:12.999 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:12.996+0000 7f3c64e4cec0 20 add_watcher() i=5 2019-11-28T22:22:13.017 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:13.015+0000 7f3c64e4cec0 20 add_watcher() i=6 2019-11-28T22:22:13.035 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:13.033+0000 7f3c64e4cec0 20 add_watcher() i=7 2019-11-28T22:22:13.035 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:13.033+0000 7f3c64e4cec0 2 all 8 watchers are set, enabling cache 2019-11-28T22:22:13.035 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:13.033+0000 7f3c22fdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-28T22:22:13.042 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:13.041+0000 7f3c52079700 0 -- 172.21.15.74:0/1480690225 >> [v2:172.21.15.74:3301/0,v1:172.21.15.74:6790/0] conn(0x555874202710 msgr2=0x555874202b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-28T22:22:13.245 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:13.244+0000 7f3c52079700 0 --2- 172.21.15.74:0/1480690225 >> [v2:172.21.15.74:3301/0,v1:172.21.15.74:6790/0] conn(0x555874202710 0x555874202b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-28T22:22:13.281 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:13.280+0000 7f3c5287a700 0 -- 172.21.15.74:0/183391705 >> [v2:172.21.15.74:3301/0,v1:172.21.15.74:6790/0] conn(0x5558741f9740 msgr2=0x5558741f8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-28T22:22:14.539 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:14.537+0000 7f3b917fa700 20 reqs_thread_entry: start 2019-11-28T22:22:14.539 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:14.537+0000 7f3b8affd700 20 reqs_thread_entry: start 2019-11-28T22:22:14.539 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:14.537+0000 7f3c64e4cec0 20 init_complete bucket index max shards: 0 2019-11-28T22:22:14.540 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:14.537+0000 7f3b897fa700 20 reqs_thread_entry: start 2019-11-28T22:22:14.540 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:14.537+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-28T22:22:14.589 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:14.588+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:14.614 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:14.612+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:14.644 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:14.625+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:14.677 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:14.675+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-28T22:22:14.743 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:14.741+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:14.763 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:14.761+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:14.775 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:14.774+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:14.831 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:14.830+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-28T22:22:14.885 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:14.884+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:14.901 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:14.899+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:14.909 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:14.908+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:14.935 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:14.934+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-28T22:22:14.978 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:14.976+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:14.993 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:14.992+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:15.002 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:15.000+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:15.043 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:15.041+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-28T22:22:15.110 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:15.108+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:15.132 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:15.130+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:15.140 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:15.139+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:15.176 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:15.175+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-28T22:22:15.218 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:15.217+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:15.236 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:15.234+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:15.243 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:15.242+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:15.286 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:15.285+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-28T22:22:15.341 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:15.340+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:15.363 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:15.361+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:15.373 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:15.372+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:15.411 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:15.410+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-28T22:22:15.465 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:15.464+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:15.484 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:15.482+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:15.493 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:15.492+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:15.530 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:15.528+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-28T22:22:15.573 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:15.571+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:15.591 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:15.590+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:15.602 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:15.600+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:15.635 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:15.633+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-28T22:22:15.678 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:15.676+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:15.694 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:15.692+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:15.703 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:15.702+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:15.751 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:15.749+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-28T22:22:15.812 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:15.810+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:15.832 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:15.828+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:15.841 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:15.839+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:15.876 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:15.873+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-28T22:22:15.919 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:15.917+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:15.962 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:15.943+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:15.967 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:15.959+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:16.008 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:16.002+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-28T22:22:16.066 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:16.059+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:16.102 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:16.092+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:16.112 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:16.105+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:16.163 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:16.158+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-28T22:22:16.208 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:16.206+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:16.224 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:16.222+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:16.235 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:16.233+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:16.280 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:16.278+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-28T22:22:16.333 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:16.331+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:16.352 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:16.350+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:16.364 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:16.363+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:16.408 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:16.406+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-28T22:22:16.498 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:16.496+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:16.524 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:16.523+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:16.541 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:16.539+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:16.609 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:16.607+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-28T22:22:16.706 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:16.705+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:16.727 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:16.725+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:16.739 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:16.738+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:16.783 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:16.781+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-28T22:22:16.842 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:16.841+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:16.866 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:16.864+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:16.874 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:16.872+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:16.934 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:16.932+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-28T22:22:16.996 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:16.994+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:17.021 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:17.019+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:17.034 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:17.032+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:17.092 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:17.090+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-28T22:22:17.292 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:17.290+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:17.320 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:17.318+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:17.339 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:17.337+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:17.381 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:17.379+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-28T22:22:17.454 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:17.452+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:17.475 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:17.474+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:17.488 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:17.484+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:17.532 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:17.531+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-28T22:22:17.585 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:17.583+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:17.604 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:17.603+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:17.616 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:17.615+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:17.657 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:17.655+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-28T22:22:17.723 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:17.721+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:17.750 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:17.748+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:17.766 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:17.764+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:17.799 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:17.798+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-28T22:22:17.842 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:17.841+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:17.859 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:17.857+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:17.869 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:17.868+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:17.903 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:17.902+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-28T22:22:17.972 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:17.970+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:17.995 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:17.993+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:18.004 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:18.003+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:18.050 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:18.048+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-28T22:22:18.110 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:18.108+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:18.134 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:18.132+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:18.147 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:18.146+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:18.192 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:18.191+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-28T22:22:18.266 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:18.264+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:18.287 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:18.286+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:18.297 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:18.295+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:18.352 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:18.351+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-28T22:22:18.432 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:18.430+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:18.469 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:18.468+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:18.488 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:18.487+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:18.543 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:18.542+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-28T22:22:18.613 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:18.611+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:18.637 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:18.635+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:18.646 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:18.644+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:18.695 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:18.694+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-28T22:22:18.769 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:18.768+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:18.794 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:18.793+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:18.807 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:18.806+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:18.856 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:18.855+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-28T22:22:18.906 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:18.905+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:18.921 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:18.919+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:18.932 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:18.929+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:18.961 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:18.959+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-28T22:22:19.040 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:19.038+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:19.073 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:19.071+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:19.090 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:19.088+0000 7f3c64e4cec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:19.200 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:19.199+0000 7f3c64e4cec0 20 remove_watcher() i=0 2019-11-28T22:22:19.201 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:19.199+0000 7f3c64e4cec0 2 removed watcher, disabling cache 2019-11-28T22:22:19.249 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:19.247+0000 7f3c64e4cec0 20 remove_watcher() i=1 2019-11-28T22:22:19.302 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:19.301+0000 7f3c64e4cec0 20 remove_watcher() i=2 2019-11-28T22:22:19.360 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:19.359+0000 7f3c64e4cec0 20 remove_watcher() i=3 2019-11-28T22:22:19.406 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:19.405+0000 7f3c64e4cec0 20 remove_watcher() i=4 2019-11-28T22:22:19.442 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:19.440+0000 7f3c64e4cec0 20 remove_watcher() i=5 2019-11-28T22:22:19.474 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:19.472+0000 7f3c64e4cec0 20 remove_watcher() i=6 2019-11-28T22:22:19.508 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:19.506+0000 7f3c64e4cec0 20 remove_watcher() i=7 2019-11-28T22:22:19.517 INFO:teuthology.orchestra.run.smithi074:> radosgw-admin gc process --include-all 2019-11-28T22:22:19.622 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:19.620+0000 7f03632bfec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:19.646 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:19.645+0000 7f03632bfec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:22:19.647 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:19.645+0000 7f03632bfec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:19.654 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:19.653+0000 7f03632bfec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:22:19.655 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:19.653+0000 7f03632bfec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:19.664 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:19.662+0000 7f03632bfec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:22:19.664 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:19.662+0000 7f03632bfec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:19.681 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:19.679+0000 7f03632bfec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:22:19.901 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:19.899+0000 7f03632bfec0 20 RGWRados::pool_iterate: got zonegroup_info.cb1773b4-411c-4317-a760-df89ca0f54fc 2019-11-28T22:22:19.901 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:19.899+0000 7f03632bfec0 20 RGWRados::pool_iterate: got zone_info.bd5ae442-b074-4d35-94cc-b1d71bd6ac02 2019-11-28T22:22:19.901 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:19.899+0000 7f03632bfec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-28T22:22:19.901 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:19.899+0000 7f03632bfec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-28T22:22:19.901 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:19.899+0000 7f03632bfec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:19.922 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:19.920+0000 7f03632bfec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:22:19.922 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:19.920+0000 7f03632bfec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:19.940 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:19.939+0000 7f03632bfec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T22:22:19.941 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:19.939+0000 7f03632bfec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:19.953 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:19.952+0000 7f03632bfec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:22:19.954 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:19.952+0000 7f03632bfec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:19.967 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:19.965+0000 7f03632bfec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T22:22:19.967 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:19.965+0000 7f03632bfec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:19.977 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:19.976+0000 7f03632bfec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:22:19.977 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:19.976+0000 7f03632bfec0 10 cannot find current period zonegroup using local zonegroup 2019-11-28T22:22:19.978 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:19.976+0000 7f03632bfec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:19.989 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:19.987+0000 7f03632bfec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:22:19.989 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:19.987+0000 7f03632bfec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:20.001 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:20.000+0000 7f03632bfec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:22:20.001 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:20.000+0000 7f03632bfec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:20.011 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:20.010+0000 7f03632bfec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T22:22:20.011 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:20.010+0000 7f03632bfec0 20 zonegroup default 2019-11-28T22:22:20.011 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:20.010+0000 7f03632bfec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:20.022 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:20.020+0000 7f03632bfec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:22:20.022 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:20.020+0000 7f03632bfec0 10 Cannot find current period zone using local zone 2019-11-28T22:22:20.022 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:20.021+0000 7f03632bfec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:20.034 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:20.032+0000 7f03632bfec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:22:20.034 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:20.032+0000 7f03632bfec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:20.045 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:20.043+0000 7f03632bfec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:22:20.045 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:20.043+0000 7f03632bfec0 20 rados->read ofs=0 len=0 2019-11-28T22:22:20.055 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:20.053+0000 7f03632bfec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T22:22:20.055 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:20.053+0000 7f03632bfec0 20 zone default found 2019-11-28T22:22:20.055 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:20.053+0000 7f03632bfec0 20 started sync module instance, tier type = 2019-11-28T22:22:20.055 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:20.053+0000 7f03632bfec0 20 started zone id=bd5ae442-b074-4d35-94cc-b1d71bd6ac02 (name=default) with tier type = 2019-11-28T22:22:20.400 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:20.398+0000 7f03632bfec0 20 add_watcher() i=0 2019-11-28T22:22:20.400 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:20.398+0000 7f03632bfec0 20 add_watcher() i=1 2019-11-28T22:22:20.401 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:20.398+0000 7f03632bfec0 20 add_watcher() i=2 2019-11-28T22:22:20.401 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:20.398+0000 7f03632bfec0 20 add_watcher() i=3 2019-11-28T22:22:20.401 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:20.398+0000 7f03632bfec0 20 add_watcher() i=4 2019-11-28T22:22:20.401 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:20.398+0000 7f03632bfec0 20 add_watcher() i=5 2019-11-28T22:22:20.401 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:20.398+0000 7f03632bfec0 20 add_watcher() i=6 2019-11-28T22:22:20.431 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:20.430+0000 7f03632bfec0 20 add_watcher() i=7 2019-11-28T22:22:20.432 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:20.430+0000 7f03632bfec0 2 all 8 watchers are set, enabling cache 2019-11-28T22:22:20.432 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:20.430+0000 7f0320fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-28T22:22:20.441 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:20.439+0000 7f034fceb700 0 -- 172.21.15.74:0/841986721 >> [v2:172.21.15.74:3300/0,v1:172.21.15.74:6789/0] conn(0x563c101674b0 msgr2=0x563c101678c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-28T22:22:20.497 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:20.496+0000 7f03504ec700 0 -- 172.21.15.74:0/2055632594 >> [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] conn(0x563c1019cf20 msgr2=0x563c1019f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-28T22:22:22.310 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:22.308+0000 7f0292ffd700 20 reqs_thread_entry: start 2019-11-28T22:22:22.310 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:22.308+0000 7f0290ff9700 20 reqs_thread_entry: start 2019-11-28T22:22:22.310 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:22.308+0000 7f03632bfec0 20 init_complete bucket index max shards: 0 2019-11-28T22:22:22.311 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:22.309+0000 7f0286ffd700 20 reqs_thread_entry: start 2019-11-28T22:22:22.311 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:22.309+0000 7f03632bfec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-28T22:22:22.392 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:22.390+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:22.420 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:22.418+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:22.437 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:22.435+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:22.486 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:22.485+0000 7f03632bfec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-28T22:22:22.559 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:22.557+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:22.581 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:22.579+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:22.591 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:22.590+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:22.647 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:22.645+0000 7f03632bfec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-28T22:22:22.702 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:22.700+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:22.725 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:22.723+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:22.738 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:22.737+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:22.779 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:22.772+0000 7f03632bfec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-28T22:22:22.827 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:22.825+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:22.847 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:22.846+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:22.858 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:22.857+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:22.899 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:22.897+0000 7f03632bfec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-28T22:22:22.945 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:22.943+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:22.961 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:22.959+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:22.972 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:22.970+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:23.013 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:23.011+0000 7f03632bfec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-28T22:22:23.075 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:23.073+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:23.106 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:23.104+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:23.123 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:23.121+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:23.170 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:23.169+0000 7f03632bfec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-28T22:22:23.228 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:23.224+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:23.245 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:23.244+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:23.253 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:23.252+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:23.283 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:23.282+0000 7f03632bfec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-28T22:22:23.333 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:23.331+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:23.351 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:23.349+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:23.361 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:23.359+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:23.401 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:23.400+0000 7f03632bfec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-28T22:22:23.477 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:23.475+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:23.498 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:23.496+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:23.511 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:23.509+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:23.552 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:23.551+0000 7f03632bfec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-28T22:22:23.636 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:23.635+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:23.668 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:23.667+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:23.685 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:23.684+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:23.744 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:23.742+0000 7f03632bfec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-28T22:22:23.798 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:23.796+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:23.820 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:23.819+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:23.830 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:23.829+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:23.864 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:23.862+0000 7f03632bfec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-28T22:22:23.915 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:23.913+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:23.931 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:23.930+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:23.941 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:23.939+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:23.975 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:23.973+0000 7f03632bfec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-28T22:22:24.017 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:24.015+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:24.033 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:24.031+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:24.042 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:24.040+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:24.078 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:24.077+0000 7f03632bfec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-28T22:22:24.120 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:24.118+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:24.135 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:24.133+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:24.144 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:24.143+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:24.178 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:24.176+0000 7f03632bfec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-28T22:22:24.259 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:24.257+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:24.289 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:24.288+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:24.301 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:24.299+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:24.371 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:24.369+0000 7f03632bfec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-28T22:22:24.456 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:24.454+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:24.474 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:24.472+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:24.482 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:24.480+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:24.529 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:24.528+0000 7f03632bfec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-28T22:22:24.582 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:24.580+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:24.598 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:24.596+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:24.607 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:24.605+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:24.658 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:24.652+0000 7f03632bfec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-28T22:22:24.725 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:24.724+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:24.752 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:24.751+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:24.772 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:24.763+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:24.807 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:24.806+0000 7f03632bfec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-28T22:22:24.855 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:24.853+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:24.871 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:24.869+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:24.879 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:24.877+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:24.909 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:24.908+0000 7f03632bfec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-28T22:22:24.954 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:24.953+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:24.970 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:24.968+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:24.978 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:24.977+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:25.018 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:25.016+0000 7f03632bfec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-28T22:22:25.073 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:25.071+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:25.091 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:25.090+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:25.100 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:25.098+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:25.147 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:25.146+0000 7f03632bfec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-28T22:22:25.208 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:25.207+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:25.240 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:25.238+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:25.256 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:25.254+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:25.307 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:25.305+0000 7f03632bfec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-28T22:22:25.378 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:25.373+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:25.408 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:25.404+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:25.421 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:25.420+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:25.479 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:25.477+0000 7f03632bfec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-28T22:22:25.564 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:25.551+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:25.581 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:25.579+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:25.592 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:25.590+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:25.637 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:25.635+0000 7f03632bfec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-28T22:22:25.710 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:25.708+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:25.733 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:25.731+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:25.742 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:25.741+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:25.783 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:25.781+0000 7f03632bfec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-28T22:22:25.852 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:25.850+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:25.875 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:25.874+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:25.891 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:25.887+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:25.937 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:25.935+0000 7f03632bfec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-28T22:22:26.024 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:26.022+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:26.050 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:26.048+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:26.070 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:26.069+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:26.126 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:26.124+0000 7f03632bfec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-28T22:22:26.208 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:26.206+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:26.237 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:26.236+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:26.250 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:26.248+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:26.300 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:26.299+0000 7f03632bfec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-28T22:22:26.387 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:26.385+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:26.422 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:26.420+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:26.443 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:26.441+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:26.496 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:26.494+0000 7f03632bfec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-28T22:22:26.577 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:26.575+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:26.612 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:26.608+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:26.627 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:26.625+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:26.679 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:26.677+0000 7f03632bfec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-28T22:22:26.738 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:26.737+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:26.773 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:26.771+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:26.781 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:26.780+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:26.859 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:26.857+0000 7f03632bfec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-28T22:22:26.907 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:26.905+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:26.923 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:26.921+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:22:26.932 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:26.930+0000 7f03632bfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:22:27.039 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:27.038+0000 7f03632bfec0 20 remove_watcher() i=0 2019-11-28T22:22:27.039 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:27.038+0000 7f03632bfec0 2 removed watcher, disabling cache 2019-11-28T22:22:27.094 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:27.092+0000 7f03632bfec0 20 remove_watcher() i=1 2019-11-28T22:22:27.146 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:27.144+0000 7f03632bfec0 20 remove_watcher() i=2 2019-11-28T22:22:27.201 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:27.200+0000 7f03632bfec0 20 remove_watcher() i=3 2019-11-28T22:22:27.250 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:27.248+0000 7f03632bfec0 20 remove_watcher() i=4 2019-11-28T22:22:27.312 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:27.310+0000 7f03632bfec0 20 remove_watcher() i=5 2019-11-28T22:22:27.365 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:27.363+0000 7f03632bfec0 20 remove_watcher() i=6 2019-11-28T22:22:27.404 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:22:27.403+0000 7f03632bfec0 20 remove_watcher() i=7 2019-11-28T22:22:27.410 INFO:teuthology.orchestra.run.smithi074:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2019-11-28T22:22:28.032 INFO:teuthology.orchestra.run.smithi074.stdout:> Task :clean 2019-11-28T22:22:28.630 INFO:teuthology.orchestra.run.smithi074.stdout:> Task :compileJava 2019-11-28T22:22:28.630 INFO:teuthology.orchestra.run.smithi074.stdout:> Task :processResources 2019-11-28T22:22:28.630 INFO:teuthology.orchestra.run.smithi074.stdout:> Task :classes 2019-11-28T22:22:28.930 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:22:28.930 INFO:teuthology.orchestra.run.smithi074.stdout:> Task :compileTestJava 2019-11-28T22:22:28.931 INFO:teuthology.orchestra.run.smithi074.stdout:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2019-11-28T22:22:28.931 INFO:teuthology.orchestra.run.smithi074.stdout:Note: Recompile with -Xlint:deprecation for details. 2019-11-28T22:22:28.931 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:22:28.931 INFO:teuthology.orchestra.run.smithi074.stdout:> Task :processTestResources NO-SOURCE 2019-11-28T22:22:28.938 INFO:teuthology.orchestra.run.smithi074.stdout:> Task :testClasses 2019-11-28T22:22:31.030 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:22:31.030 INFO:teuthology.orchestra.run.smithi074.stdout:> Task :test 2019-11-28T22:22:31.030 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:22:31.030 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2019-11-28T22:22:36.729 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:22:36.730 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2019-11-28T22:22:47.829 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:22:47.830 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2019-11-28T22:22:50.830 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:22:50.830 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2019-11-28T22:22:56.930 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:22:56.930 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2019-11-28T22:22:59.929 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:22:59.930 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2019-11-28T22:23:03.729 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:23:03.730 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2019-11-28T22:23:26.828 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:37:09.046 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:23:26.835 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:37:09.053 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:23:26.846 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:37:09.066 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:23:26.850 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:37:09.070 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:23:26.857 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:37:09.084 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:23:26.864 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:37:09.093 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:23:27.009 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:37:09.229 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:23:27.034 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:37:09.252 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:23:27.088 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:37:09.316 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:23:28.830 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:23:28.830 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2019-11-28T22:23:34.829 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:23:34.830 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2019-11-28T22:23:36.829 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:23:36.830 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2019-11-28T22:23:43.929 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:23:43.930 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2019-11-28T22:23:49.130 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:23:49.130 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2019-11-28T22:23:55.030 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:23:55.030 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2019-11-28T22:23:55.429 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:23:55.430 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2019-11-28T22:23:57.429 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:23:57.430 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2019-11-28T22:23:59.329 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:23:59.330 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2019-11-28T22:24:05.330 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:24:05.330 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2019-11-28T22:24:13.130 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:24:13.130 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2019-11-28T22:24:20.630 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:24:20.630 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2019-11-28T22:24:23.229 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:24:23.230 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2019-11-28T22:24:28.429 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:24:28.430 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2019-11-28T22:24:31.329 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:24:31.347 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2019-11-28T22:24:37.729 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:24:37.729 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2019-11-28T22:24:39.630 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:24:39.630 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2019-11-28T22:24:46.832 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:24:46.832 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2019-11-28T22:24:49.530 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:24:49.530 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2019-11-28T22:24:53.730 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:24:53.730 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2019-11-28T22:24:57.330 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:24:57.330 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2019-11-28T22:25:03.929 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:25:03.930 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2019-11-28T22:25:06.930 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:25:06.930 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2019-11-28T22:25:12.129 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:25:12.129 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2019-11-28T22:25:18.529 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:25:18.530 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2019-11-28T22:25:26.129 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:25:26.130 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2019-11-28T22:25:45.332 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:25:45.333 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2019-11-28T22:25:59.129 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:25:59.130 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2019-11-28T22:28:39.002 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:42:21.221 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:28:39.025 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:42:21.247 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:28:39.025 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:42:21.228 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:28:39.025 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:42:21.236 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:28:39.025 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:42:21.240 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:28:39.026 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:42:21.252 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:28:39.190 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:42:21.409 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:28:39.199 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:42:21.420 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:28:39.222 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:42:21.449 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:28:49.808 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:42:32.027 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:28:49.843 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:42:32.062 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:28:49.843 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:42:32.061 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:28:49.844 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:42:32.063 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:28:49.864 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:42:32.082 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:28:49.864 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:42:32.085 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:28:49.877 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:42:32.105 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:28:49.893 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:42:32.121 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:28:49.920 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:42:32.148 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:29:18.929 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:29:18.929 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2019-11-28T22:29:32.929 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:29:32.929 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2019-11-28T22:29:34.929 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:29:34.929 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2019-11-28T22:29:41.029 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:29:41.029 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2019-11-28T22:29:44.329 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:29:44.329 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2019-11-28T22:29:53.929 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:29:53.929 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2019-11-28T22:30:06.129 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:30:06.129 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2019-11-28T22:30:14.729 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:30:14.729 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2019-11-28T22:30:15.029 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:30:15.029 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2019-11-28T22:30:15.729 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:30:15.729 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2019-11-28T22:30:44.774 INFO:tasks.rgw.client.0.smithi074.stdout:2019-11-28T22:30:44.711+0000 41a62700 -1 handle_data failed with exit code -5 2019-11-28T22:31:01.414 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:31:01.415 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2019-11-28T22:31:01.415 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:31:01.415 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2019-11-28T22:31:15.729 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:31:15.729 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2019-11-28T22:31:28.529 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:31:28.529 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2019-11-28T22:31:51.129 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:31:51.129 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2019-11-28T22:31:58.629 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:31:58.629 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2019-11-28T22:33:50.656 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:47:32.875 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:33:50.662 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:47:32.881 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:33:50.674 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:47:32.894 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:33:50.680 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:47:32.900 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:33:50.684 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:47:32.911 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:33:50.702 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:47:32.929 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:33:50.832 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:47:33.051 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:33:50.846 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:47:33.066 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:33:50.988 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:47:33.215 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:33:53.829 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:33:53.830 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2019-11-28T22:34:02.229 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:34:02.229 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2019-11-28T22:34:31.029 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:34:31.029 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2019-11-28T22:34:37.229 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:34:37.229 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2019-11-28T22:35:03.229 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:35:03.230 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2019-11-28T22:35:10.929 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:35:10.930 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2019-11-28T22:35:17.729 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:35:17.730 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2019-11-28T22:35:28.029 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:35:28.029 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2019-11-28T22:35:28.629 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:35:28.630 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2019-11-28T22:35:29.629 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:35:29.629 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectCreateBadContentlengthNegative STARTED 2019-11-28T22:35:30.829 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:35:30.829 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectCreateBadContentlengthNegative PASSED 2019-11-28T22:35:34.429 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:35:34.429 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2019-11-28T22:35:36.029 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:35:36.029 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2019-11-28T22:35:40.529 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:35:40.529 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2019-11-28T22:35:41.930 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:35:41.930 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2019-11-28T22:35:45.929 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:35:45.930 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2019-11-28T22:35:47.329 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:35:47.329 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2019-11-28T22:35:50.629 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:35:50.629 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2019-11-28T22:35:51.429 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:35:51.430 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2019-11-28T22:35:55.629 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:35:55.629 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2019-11-28T22:35:57.229 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:35:57.230 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2019-11-28T22:36:01.229 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:36:01.230 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2019-11-28T22:36:04.129 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:36:04.129 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2019-11-28T22:36:11.629 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:36:11.629 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2019-11-28T22:36:19.929 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:36:19.929 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2019-11-28T22:36:30.829 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:36:30.829 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2019-11-28T22:36:37.529 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:36:37.530 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2019-11-28T22:36:46.029 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:36:46.029 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2019-11-28T22:36:53.329 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:36:53.330 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2019-11-28T22:37:03.429 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:37:03.430 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2019-11-28T22:37:09.429 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:37:09.429 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2019-11-28T22:37:11.113 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:50:53.331 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:37:11.116 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:50:53.334 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:37:11.143 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:50:53.363 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:37:11.166 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:50:53.386 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:37:11.167 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:50:53.395 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:37:11.169 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:50:53.397 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:37:11.232 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:50:53.451 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:37:11.271 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:50:53.490 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:37:11.280 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:50:53.507 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:37:17.729 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:37:17.729 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2019-11-28T22:37:25.429 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:37:25.430 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2019-11-28T22:37:35.229 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:37:35.230 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2019-11-28T22:37:41.229 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:37:41.229 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2019-11-28T22:37:50.929 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:37:50.930 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2019-11-28T22:37:58.929 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:37:58.929 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2019-11-28T22:38:09.029 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:38:09.029 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2019-11-28T22:38:15.729 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:38:15.730 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2019-11-28T22:38:24.029 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:38:24.030 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2019-11-28T22:38:29.929 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:38:29.929 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2019-11-28T22:38:40.029 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:38:40.030 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2019-11-28T22:38:45.829 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:38:45.830 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2019-11-28T22:38:54.529 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:38:54.530 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2019-11-28T22:39:01.367 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:52:43.585 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:39:01.370 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:52:43.588 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:39:01.392 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:52:43.619 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:39:01.392 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:52:43.612 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:39:01.395 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:52:43.615 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:39:01.395 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:52:43.622 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:39:01.458 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:52:43.676 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:39:01.475 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:52:43.702 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:39:01.481 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:52:43.701 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:39:01.529 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:39:01.530 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2019-11-28T22:39:07.729 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:39:07.729 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2019-11-28T22:39:12.730 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:39:12.730 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2019-11-28T22:39:19.029 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:39:19.030 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2019-11-28T22:39:25.129 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:39:25.136 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2019-11-28T22:39:33.829 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:39:33.830 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2019-11-28T22:39:38.329 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:39:38.330 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2019-11-28T22:39:49.529 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:39:49.530 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2019-11-28T22:39:55.030 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:39:55.030 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2019-11-28T22:40:06.229 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:40:06.230 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2019-11-28T22:40:13.229 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:40:13.230 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2019-11-28T22:40:24.129 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:41:13.155 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2019-11-28T22:41:13.157 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:41:13.157 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2019-11-28T22:41:13.157 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:41:13.157 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2019-11-28T22:41:13.157 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:41:13.157 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2019-11-28T22:41:13.158 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:41:13.158 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2019-11-28T22:41:13.158 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:41:13.158 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2019-11-28T22:41:13.158 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:41:13.158 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2019-11-28T22:41:14.430 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:41:14.430 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2019-11-28T22:41:24.329 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:41:24.330 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2019-11-28T22:41:30.729 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:41:30.730 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2019-11-28T22:41:41.129 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:41:41.129 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2019-11-28T22:41:46.629 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:41:46.630 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2019-11-28T22:41:56.130 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:41:56.130 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2019-11-28T22:41:57.929 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:41:57.930 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2019-11-28T22:42:01.930 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:42:01.930 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2019-11-28T22:42:04.830 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:42:04.830 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2019-11-28T22:42:11.729 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:42:11.730 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2019-11-28T22:42:15.530 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:42:15.530 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2019-11-28T22:42:22.630 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:42:22.630 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2019-11-28T22:42:25.730 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:42:25.730 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2019-11-28T22:42:33.029 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:42:33.030 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2019-11-28T22:42:41.831 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:42:41.831 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2019-11-28T22:42:47.929 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:42:47.930 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2019-11-28T22:42:48.129 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:42:48.130 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2019-11-28T22:42:48.929 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:42:48.930 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2019-11-28T22:42:52.129 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:42:52.130 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2019-11-28T22:42:59.529 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:42:59.530 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2019-11-28T22:43:04.029 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:43:04.030 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2019-11-28T22:43:11.529 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:43:11.530 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2019-11-28T22:43:13.930 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:43:13.930 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2019-11-28T22:43:19.929 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:43:19.930 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2019-11-28T22:43:21.829 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:43:21.830 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2019-11-28T22:43:28.129 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:43:28.130 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testSSEKMSPresent STARTED 2019-11-28T22:43:32.230 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:43:32.230 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testSSEKMSPresent PASSED 2019-11-28T22:43:39.131 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:43:39.131 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2019-11-28T22:43:50.229 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:43:50.230 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2019-11-28T22:43:57.729 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:43:57.730 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testUploadFileListHLAPI STARTED 2019-11-28T22:44:14.497 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:57:56.715 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:44:14.503 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:57:56.721 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:44:14.511 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:57:56.731 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:44:14.514 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:57:56.734 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:44:14.536 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:57:56.763 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:44:14.563 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:57:56.790 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:44:14.691 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:57:56.909 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:44:14.704 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:57:56.924 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:44:14.843 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:57:57.070 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:44:23.429 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:44:23.430 INFO:teuthology.orchestra.run.smithi074.stdout:suite > Object tests > ObjectTest.testUploadFileListHLAPI PASSED 2019-11-28T22:44:32.430 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:44:32.430 INFO:teuthology.orchestra.run.smithi074.stdout:---------------------------------------------------------------------- 2019-11-28T22:44:32.430 INFO:teuthology.orchestra.run.smithi074.stdout:| Results: SUCCESS (72 tests, 72 successes, 0 failures, 0 skipped) | 2019-11-28T22:44:32.430 INFO:teuthology.orchestra.run.smithi074.stdout:---------------------------------------------------------------------- 2019-11-28T22:44:32.431 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:44:32.431 INFO:teuthology.orchestra.run.smithi074.stdout:BUILD SUCCESSFUL in 22m 4s 2019-11-28T22:44:32.431 INFO:teuthology.orchestra.run.smithi074.stdout:5 actionable tasks: 5 executed 2019-11-28T22:44:32.443 INFO:teuthology.orchestra.run.smithi074:> radosgw-admin gc process --include-all 2019-11-28T22:44:32.569 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:32.567+0000 7efeb0fbfec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:32.603 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:32.601+0000 7efeb0fbfec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:44:32.603 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:32.601+0000 7efeb0fbfec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:32.615 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:32.613+0000 7efeb0fbfec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:44:32.615 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:32.613+0000 7efeb0fbfec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:32.628 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:32.626+0000 7efeb0fbfec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:44:32.628 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:32.627+0000 7efeb0fbfec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:32.643 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:32.641+0000 7efeb0fbfec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:44:32.929 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:32.927+0000 7efeb0fbfec0 20 RGWRados::pool_iterate: got zonegroup_info.cb1773b4-411c-4317-a760-df89ca0f54fc 2019-11-28T22:44:32.929 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:32.927+0000 7efeb0fbfec0 20 RGWRados::pool_iterate: got zone_info.bd5ae442-b074-4d35-94cc-b1d71bd6ac02 2019-11-28T22:44:32.929 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:32.927+0000 7efeb0fbfec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-28T22:44:32.929 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:32.927+0000 7efeb0fbfec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-28T22:44:32.930 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:32.927+0000 7efeb0fbfec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:32.945 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:32.943+0000 7efeb0fbfec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:44:32.945 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:32.943+0000 7efeb0fbfec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:32.959 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:32.957+0000 7efeb0fbfec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T22:44:32.959 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:32.957+0000 7efeb0fbfec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:32.975 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:32.974+0000 7efeb0fbfec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:44:32.976 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:32.974+0000 7efeb0fbfec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:32.990 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:32.989+0000 7efeb0fbfec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T22:44:32.991 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:32.989+0000 7efeb0fbfec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:33.003 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:33.001+0000 7efeb0fbfec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:44:33.003 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:33.001+0000 7efeb0fbfec0 10 cannot find current period zonegroup using local zonegroup 2019-11-28T22:44:33.003 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:33.001+0000 7efeb0fbfec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:33.012 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:33.010+0000 7efeb0fbfec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:44:33.012 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:33.010+0000 7efeb0fbfec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:33.022 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:33.021+0000 7efeb0fbfec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:44:33.023 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:33.021+0000 7efeb0fbfec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:33.034 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:33.033+0000 7efeb0fbfec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T22:44:33.035 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:33.033+0000 7efeb0fbfec0 20 zonegroup default 2019-11-28T22:44:33.035 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:33.033+0000 7efeb0fbfec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:33.043 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:33.042+0000 7efeb0fbfec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:44:33.044 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:33.042+0000 7efeb0fbfec0 10 Cannot find current period zone using local zone 2019-11-28T22:44:33.044 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:33.042+0000 7efeb0fbfec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:33.052 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:33.050+0000 7efeb0fbfec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:44:33.052 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:33.050+0000 7efeb0fbfec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:33.064 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:33.062+0000 7efeb0fbfec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:44:33.064 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:33.062+0000 7efeb0fbfec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:33.082 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:33.080+0000 7efeb0fbfec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T22:44:33.082 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:33.080+0000 7efeb0fbfec0 20 zone default found 2019-11-28T22:44:33.082 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:33.080+0000 7efeb0fbfec0 20 started sync module instance, tier type = 2019-11-28T22:44:33.082 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:33.080+0000 7efeb0fbfec0 20 started zone id=bd5ae442-b074-4d35-94cc-b1d71bd6ac02 (name=default) with tier type = 2019-11-28T22:44:33.472 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:33.470+0000 7efeb0fbfec0 20 add_watcher() i=0 2019-11-28T22:44:33.472 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:33.470+0000 7efeb0fbfec0 20 add_watcher() i=1 2019-11-28T22:44:33.472 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:33.470+0000 7efeb0fbfec0 20 add_watcher() i=2 2019-11-28T22:44:33.473 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:33.470+0000 7efeb0fbfec0 20 add_watcher() i=3 2019-11-28T22:44:33.473 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:33.470+0000 7efeb0fbfec0 20 add_watcher() i=4 2019-11-28T22:44:33.473 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:33.470+0000 7efeb0fbfec0 20 add_watcher() i=5 2019-11-28T22:44:33.476 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:33.475+0000 7efeb0fbfec0 20 add_watcher() i=6 2019-11-28T22:44:33.501 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:33.498+0000 7efe9e1ec700 0 -- 172.21.15.74:0/1356759966 >> [v2:172.21.15.74:6804/10097,v1:172.21.15.74:6805/10097] conn(0x7efe9000e860 msgr2=0x7efe90011050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-28T22:44:33.501 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:33.499+0000 7efeb0fbfec0 20 add_watcher() i=7 2019-11-28T22:44:33.501 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:33.499+0000 7efeb0fbfec0 2 all 8 watchers are set, enabling cache 2019-11-28T22:44:33.501 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:33.499+0000 7efe6e7e4700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-28T22:44:33.519 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:33.517+0000 7efe9e9ed700 0 -- 172.21.15.74:0/4046143550 >> v1:172.21.15.141:6789/0 conn(0x5585f65ed300 legacy=0x5585f65eaf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-28T22:44:33.727 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:33.725+0000 7efe9d9eb700 0 --2- 172.21.15.74:0/4046143550 >> [v2:172.21.15.74:3301/0,v1:172.21.15.74:6790/0] conn(0x5585f65ed900 0x5585f65dcb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-28T22:44:35.099 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:35.096+0000 7efde4ff9700 20 reqs_thread_entry: start 2019-11-28T22:44:35.099 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:35.097+0000 7efdde7fc700 20 reqs_thread_entry: start 2019-11-28T22:44:35.099 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:35.097+0000 7efeb0fbfec0 20 init_complete bucket index max shards: 0 2019-11-28T22:44:35.100 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:35.097+0000 7efddcff9700 20 reqs_thread_entry: start 2019-11-28T22:44:35.100 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:35.097+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-28T22:44:35.145 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:35.143+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:35.160 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:35.158+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:35.174 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:35.172+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-28T22:44:35.174 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:35.172+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.1066', time=2019-11-29T00:27:03.695925+0000, chain.objs.size()=9 2019-11-28T22:44:35.174 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:35.172+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__multipart_key1.2~MvmaqTg9NqK4HDPi9bFkrSSo8xtY5Zg.1 2019-11-28T22:44:35.174 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:35.172+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__shadow_key1.2~MvmaqTg9NqK4HDPi9bFkrSSo8xtY5Zg.1_1 2019-11-28T22:44:35.175 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:35.172+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__multipart_key1.2~MvmaqTg9NqK4HDPi9bFkrSSo8xtY5Zg.2 2019-11-28T22:44:35.175 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:35.172+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__shadow_key1.2~MvmaqTg9NqK4HDPi9bFkrSSo8xtY5Zg.2_1 2019-11-28T22:44:35.175 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:35.172+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__multipart_key1.2~MvmaqTg9NqK4HDPi9bFkrSSo8xtY5Zg.3 2019-11-28T22:44:35.175 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:35.172+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__shadow_key1.2~MvmaqTg9NqK4HDPi9bFkrSSo8xtY5Zg.3_1 2019-11-28T22:44:35.175 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:35.172+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__multipart_key1.2~MvmaqTg9NqK4HDPi9bFkrSSo8xtY5Zg.4 2019-11-28T22:44:35.175 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:35.172+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__shadow_key1.2~MvmaqTg9NqK4HDPi9bFkrSSo8xtY5Zg.4_1 2019-11-28T22:44:35.176 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:35.172+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__multipart_key1.2~MvmaqTg9NqK4HDPi9bFkrSSo8xtY5Zg.5 2019-11-28T22:44:35.480 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:35.478+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:44:35.563 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:35.561+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-28T22:44:35.606 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:35.604+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:35.621 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:35.620+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:35.637 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:35.635+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-28T22:44:35.638 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:35.635+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.1233', time=2019-11-29T00:33:22.160137+0000, chain.objs.size()=9 2019-11-28T22:44:35.638 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:35.635+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__multipart_key1.2~KR8MuWd-LYG2vbQ9axPK6WuZhI-J0II.1 2019-11-28T22:44:35.638 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:35.635+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__shadow_key1.2~KR8MuWd-LYG2vbQ9axPK6WuZhI-J0II.1_1 2019-11-28T22:44:35.638 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:35.635+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__multipart_key1.2~KR8MuWd-LYG2vbQ9axPK6WuZhI-J0II.2 2019-11-28T22:44:35.638 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:35.635+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__shadow_key1.2~KR8MuWd-LYG2vbQ9axPK6WuZhI-J0II.2_1 2019-11-28T22:44:35.638 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:35.635+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__multipart_key1.2~KR8MuWd-LYG2vbQ9axPK6WuZhI-J0II.3 2019-11-28T22:44:35.639 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:35.635+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__shadow_key1.2~KR8MuWd-LYG2vbQ9axPK6WuZhI-J0II.3_1 2019-11-28T22:44:35.639 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:35.635+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__multipart_key1.2~KR8MuWd-LYG2vbQ9axPK6WuZhI-J0II.4 2019-11-28T22:44:35.639 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:35.635+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__shadow_key1.2~KR8MuWd-LYG2vbQ9axPK6WuZhI-J0II.4_1 2019-11-28T22:44:35.639 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:35.635+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__multipart_key1.2~KR8MuWd-LYG2vbQ9axPK6WuZhI-J0II.5 2019-11-28T22:44:35.894 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:35.892+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:44:36.030 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:36.028+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-28T22:44:36.085 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:36.084+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:36.102 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:36.101+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:36.120 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:36.117+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2019-11-28T22:44:36.120 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:36.117+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.974', time=2019-11-29T00:24:14.666920+0000, chain.objs.size()=2 2019-11-28T22:44:36.120 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:36.117+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.56__shadow_.0EmBz4t0gEYdAynU0RViHPtNhikgOC__1 2019-11-28T22:44:36.120 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:36.117+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.56__shadow_.0EmBz4t0gEYdAynU0RViHPtNhikgOC__2 2019-11-28T22:44:36.121 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:36.118+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.1088', time=2019-11-29T00:28:41.342747+0000, chain.objs.size()=7 2019-11-28T22:44:36.121 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:36.118+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__multipart_key1.2~2k-rdvzOOEzcw-dJU6vcIZ1dwvFi6ZJ.1 2019-11-28T22:44:36.121 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:36.118+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__shadow_key1.2~2k-rdvzOOEzcw-dJU6vcIZ1dwvFi6ZJ.1_1 2019-11-28T22:44:36.121 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:36.118+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__shadow_key1.2~2k-rdvzOOEzcw-dJU6vcIZ1dwvFi6ZJ.1_2 2019-11-28T22:44:36.121 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:36.118+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__multipart_key1.2~2k-rdvzOOEzcw-dJU6vcIZ1dwvFi6ZJ.2 2019-11-28T22:44:36.121 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:36.118+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__shadow_key1.2~2k-rdvzOOEzcw-dJU6vcIZ1dwvFi6ZJ.2_1 2019-11-28T22:44:36.121 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:36.118+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__shadow_key1.2~2k-rdvzOOEzcw-dJU6vcIZ1dwvFi6ZJ.2_2 2019-11-28T22:44:36.122 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:36.118+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__multipart_key1.2~2k-rdvzOOEzcw-dJU6vcIZ1dwvFi6ZJ.3 2019-11-28T22:44:36.122 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:36.118+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.1137', time=2019-11-29T00:30:07.663258+0000, chain.objs.size()=9 2019-11-28T22:44:36.122 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:36.118+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.71__multipart_key1.2~x4ShmovbvwSEHIPM67hyHyYCCfiE9_n.1 2019-11-28T22:44:36.122 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:36.118+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.71__shadow_key1.2~x4ShmovbvwSEHIPM67hyHyYCCfiE9_n.1_1 2019-11-28T22:44:36.122 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:36.118+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.71__multipart_key1.2~x4ShmovbvwSEHIPM67hyHyYCCfiE9_n.2 2019-11-28T22:44:36.376 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:36.375+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.71__shadow_key1.2~x4ShmovbvwSEHIPM67hyHyYCCfiE9_n.2_1 2019-11-28T22:44:36.377 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:36.375+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.71__multipart_key1.2~x4ShmovbvwSEHIPM67hyHyYCCfiE9_n.3 2019-11-28T22:44:36.377 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:36.375+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.71__shadow_key1.2~x4ShmovbvwSEHIPM67hyHyYCCfiE9_n.3_1 2019-11-28T22:44:36.377 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:36.375+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.71__multipart_key1.2~x4ShmovbvwSEHIPM67hyHyYCCfiE9_n.4 2019-11-28T22:44:36.377 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:36.375+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.71__shadow_key1.2~x4ShmovbvwSEHIPM67hyHyYCCfiE9_n.4_1 2019-11-28T22:44:36.412 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:36.410+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.71__multipart_key1.2~x4ShmovbvwSEHIPM67hyHyYCCfiE9_n.5 2019-11-28T22:44:36.660 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:36.658+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:44:36.775 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:36.773+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-28T22:44:36.818 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:36.817+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:36.835 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:36.833+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:36.843 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:36.841+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:36.879 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:36.877+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-28T22:44:36.936 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:36.934+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:36.961 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:36.960+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:36.978 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:36.976+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:37.028 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:37.027+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-28T22:44:37.083 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:37.081+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:37.102 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:37.100+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:37.112 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:37.110+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:37.153 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:37.151+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-28T22:44:37.199 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:37.197+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:37.216 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:37.214+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:37.232 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:37.230+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-28T22:44:37.232 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:37.230+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.1074', time=2019-11-29T00:27:36.057474+0000, chain.objs.size()=9 2019-11-28T22:44:37.233 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:37.230+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__multipart_key1.2~tNuxXsFgSrR1EJuVQAI2mJ310PQ3BW7.1 2019-11-28T22:44:37.233 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:37.230+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__shadow_key1.2~tNuxXsFgSrR1EJuVQAI2mJ310PQ3BW7.1_1 2019-11-28T22:44:37.233 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:37.230+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__multipart_key1.2~tNuxXsFgSrR1EJuVQAI2mJ310PQ3BW7.2 2019-11-28T22:44:37.233 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:37.230+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__shadow_key1.2~tNuxXsFgSrR1EJuVQAI2mJ310PQ3BW7.2_1 2019-11-28T22:44:37.233 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:37.230+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__multipart_key1.2~tNuxXsFgSrR1EJuVQAI2mJ310PQ3BW7.3 2019-11-28T22:44:37.233 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:37.230+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__shadow_key1.2~tNuxXsFgSrR1EJuVQAI2mJ310PQ3BW7.3_1 2019-11-28T22:44:37.233 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:37.230+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__multipart_key1.2~tNuxXsFgSrR1EJuVQAI2mJ310PQ3BW7.4 2019-11-28T22:44:37.234 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:37.231+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__shadow_key1.2~tNuxXsFgSrR1EJuVQAI2mJ310PQ3BW7.4_1 2019-11-28T22:44:37.234 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:37.231+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__multipart_key1.2~tNuxXsFgSrR1EJuVQAI2mJ310PQ3BW7.5 2019-11-28T22:44:37.704 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:37.702+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:44:37.796 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:37.795+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-28T22:44:37.837 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:37.835+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:37.852 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:37.851+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:37.874 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:37.872+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-28T22:44:37.875 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:37.872+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.1082', time=2019-11-29T00:28:19.648875+0000, chain.objs.size()=9 2019-11-28T22:44:37.875 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:37.872+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__multipart_key1.2~bHRfB9AS4s4MhqzWR3DJ3LqEBY7j2Yx.1 2019-11-28T22:44:37.875 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:37.872+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__shadow_key1.2~bHRfB9AS4s4MhqzWR3DJ3LqEBY7j2Yx.1_1 2019-11-28T22:44:37.875 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:37.872+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__multipart_key1.2~bHRfB9AS4s4MhqzWR3DJ3LqEBY7j2Yx.2 2019-11-28T22:44:37.875 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:37.872+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__shadow_key1.2~bHRfB9AS4s4MhqzWR3DJ3LqEBY7j2Yx.2_1 2019-11-28T22:44:37.875 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:37.872+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__multipart_key1.2~bHRfB9AS4s4MhqzWR3DJ3LqEBY7j2Yx.3 2019-11-28T22:44:37.875 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:37.872+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__shadow_key1.2~bHRfB9AS4s4MhqzWR3DJ3LqEBY7j2Yx.3_1 2019-11-28T22:44:37.876 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:37.872+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__multipart_key1.2~bHRfB9AS4s4MhqzWR3DJ3LqEBY7j2Yx.4 2019-11-28T22:44:37.876 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:37.872+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__shadow_key1.2~bHRfB9AS4s4MhqzWR3DJ3LqEBY7j2Yx.4_1 2019-11-28T22:44:37.876 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:37.872+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__multipart_key1.2~bHRfB9AS4s4MhqzWR3DJ3LqEBY7j2Yx.5 2019-11-28T22:44:37.876 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:37.872+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.1243', time=2019-11-29T00:33:51.692746+0000, chain.objs.size()=7 2019-11-28T22:44:37.876 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:37.872+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__multipart_key1.2~bVVFm2EY2l_RsHT_V9KzHsCvxfzLtdA.1 2019-11-28T22:44:37.876 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:37.872+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__shadow_key1.2~bVVFm2EY2l_RsHT_V9KzHsCvxfzLtdA.1_1 2019-11-28T22:44:37.877 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:37.872+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__shadow_key1.2~bVVFm2EY2l_RsHT_V9KzHsCvxfzLtdA.1_2 2019-11-28T22:44:38.182 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:38.180+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__multipart_key1.2~bVVFm2EY2l_RsHT_V9KzHsCvxfzLtdA.2 2019-11-28T22:44:38.182 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:38.180+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__shadow_key1.2~bVVFm2EY2l_RsHT_V9KzHsCvxfzLtdA.2_1 2019-11-28T22:44:38.182 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:38.180+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__shadow_key1.2~bVVFm2EY2l_RsHT_V9KzHsCvxfzLtdA.2_2 2019-11-28T22:44:38.182 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:38.180+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__multipart_key1.2~bVVFm2EY2l_RsHT_V9KzHsCvxfzLtdA.3 2019-11-28T22:44:38.407 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:38.405+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:44:38.496 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:38.495+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-28T22:44:38.536 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:38.534+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:38.550 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:38.549+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:38.563 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:38.561+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-28T22:44:38.564 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:38.561+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.1094', time=2019-11-29T00:29:16.431886+0000, chain.objs.size()=7 2019-11-28T22:44:38.564 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:38.561+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__multipart_key1.2~X_NzolUNTGA26tAXj_WnQlsf93h2WXI.1 2019-11-28T22:44:38.564 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:38.561+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__shadow_key1.2~X_NzolUNTGA26tAXj_WnQlsf93h2WXI.1_1 2019-11-28T22:44:38.564 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:38.561+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__shadow_key1.2~X_NzolUNTGA26tAXj_WnQlsf93h2WXI.1_2 2019-11-28T22:44:38.564 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:38.561+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__multipart_key1.2~X_NzolUNTGA26tAXj_WnQlsf93h2WXI.2 2019-11-28T22:44:38.564 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:38.561+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__shadow_key1.2~X_NzolUNTGA26tAXj_WnQlsf93h2WXI.2_1 2019-11-28T22:44:38.564 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:38.561+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__shadow_key1.2~X_NzolUNTGA26tAXj_WnQlsf93h2WXI.2_2 2019-11-28T22:44:38.565 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:38.561+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__multipart_key1.2~X_NzolUNTGA26tAXj_WnQlsf93h2WXI.3 2019-11-28T22:44:38.734 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:38.732+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:44:38.843 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:38.841+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-28T22:44:38.900 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:38.899+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:38.918 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:38.916+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:38.931 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:38.929+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-28T22:44:38.931 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:38.929+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.1263', time=2019-11-29T00:34:32.826653+0000, chain.objs.size()=9 2019-11-28T22:44:38.931 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:38.929+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.76__multipart_key1.2~moQ0BDL5Pr83YzVGurIZN0B0Vx_aYt-.1 2019-11-28T22:44:38.932 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:38.929+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.76__shadow_key1.2~moQ0BDL5Pr83YzVGurIZN0B0Vx_aYt-.1_1 2019-11-28T22:44:38.932 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:38.929+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.76__multipart_key1.2~moQ0BDL5Pr83YzVGurIZN0B0Vx_aYt-.2 2019-11-28T22:44:38.932 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:38.929+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.76__shadow_key1.2~moQ0BDL5Pr83YzVGurIZN0B0Vx_aYt-.2_1 2019-11-28T22:44:38.932 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:38.929+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.76__multipart_key1.2~moQ0BDL5Pr83YzVGurIZN0B0Vx_aYt-.3 2019-11-28T22:44:38.932 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:38.929+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.76__shadow_key1.2~moQ0BDL5Pr83YzVGurIZN0B0Vx_aYt-.3_1 2019-11-28T22:44:38.932 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:38.929+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.76__multipart_key1.2~moQ0BDL5Pr83YzVGurIZN0B0Vx_aYt-.4 2019-11-28T22:44:38.932 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:38.929+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.76__shadow_key1.2~moQ0BDL5Pr83YzVGurIZN0B0Vx_aYt-.4_1 2019-11-28T22:44:38.933 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:38.929+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.76__multipart_key1.2~moQ0BDL5Pr83YzVGurIZN0B0Vx_aYt-.5 2019-11-28T22:44:39.175 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:39.173+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:44:39.304 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:39.302+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-28T22:44:39.342 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:39.340+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:39.357 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:39.355+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:39.372 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:39.370+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-28T22:44:39.372 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:39.370+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.1916', time=2019-11-29T00:44:26.162410+0000, chain.objs.size()=9 2019-11-28T22:44:39.372 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:39.370+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.119__multipart_key1/data/file.mpg.2~POSqfiVlaxmMj5v_USJGwq5fRWNZFDZ.1 2019-11-28T22:44:39.372 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:39.370+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.119__shadow_key1/data/file.mpg.2~POSqfiVlaxmMj5v_USJGwq5fRWNZFDZ.1_1 2019-11-28T22:44:39.372 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:39.370+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.119__multipart_key1/data/file.mpg.2~POSqfiVlaxmMj5v_USJGwq5fRWNZFDZ.2 2019-11-28T22:44:39.372 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:39.370+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.119__shadow_key1/data/file.mpg.2~POSqfiVlaxmMj5v_USJGwq5fRWNZFDZ.2_1 2019-11-28T22:44:39.373 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:39.370+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.119__multipart_key1/data/file.mpg.2~POSqfiVlaxmMj5v_USJGwq5fRWNZFDZ.3 2019-11-28T22:44:39.373 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:39.370+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.119__shadow_key1/data/file.mpg.2~POSqfiVlaxmMj5v_USJGwq5fRWNZFDZ.3_1 2019-11-28T22:44:39.373 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:39.370+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.119__multipart_key1/data/file.mpg.2~POSqfiVlaxmMj5v_USJGwq5fRWNZFDZ.4 2019-11-28T22:44:39.373 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:39.370+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.119__shadow_key1/data/file.mpg.2~POSqfiVlaxmMj5v_USJGwq5fRWNZFDZ.4_1 2019-11-28T22:44:39.373 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:39.370+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.119__multipart_key1/data/file.mpg.2~POSqfiVlaxmMj5v_USJGwq5fRWNZFDZ.5 2019-11-28T22:44:39.700 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:39.698+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:44:39.816 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:39.814+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-28T22:44:39.869 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:39.868+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:39.892 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:39.891+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:39.913 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:39.911+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-28T22:44:39.914 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:39.912+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.1226', time=2019-11-29T00:33:08.492168+0000, chain.objs.size()=9 2019-11-28T22:44:39.914 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:39.912+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__multipart_key1.2~m3AFPJzqK_nPXhlAvIDjNEosF0Z1jLw.1 2019-11-28T22:44:39.914 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:39.912+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__shadow_key1.2~m3AFPJzqK_nPXhlAvIDjNEosF0Z1jLw.1_1 2019-11-28T22:44:39.914 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:39.912+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__multipart_key1.2~m3AFPJzqK_nPXhlAvIDjNEosF0Z1jLw.2 2019-11-28T22:44:39.914 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:39.912+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__shadow_key1.2~m3AFPJzqK_nPXhlAvIDjNEosF0Z1jLw.2_1 2019-11-28T22:44:39.914 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:39.912+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__multipart_key1.2~m3AFPJzqK_nPXhlAvIDjNEosF0Z1jLw.3 2019-11-28T22:44:39.914 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:39.912+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__shadow_key1.2~m3AFPJzqK_nPXhlAvIDjNEosF0Z1jLw.3_1 2019-11-28T22:44:39.915 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:39.912+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__multipart_key1.2~m3AFPJzqK_nPXhlAvIDjNEosF0Z1jLw.4 2019-11-28T22:44:39.915 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:39.912+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__shadow_key1.2~m3AFPJzqK_nPXhlAvIDjNEosF0Z1jLw.4_1 2019-11-28T22:44:39.915 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:39.912+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__multipart_key1.2~m3AFPJzqK_nPXhlAvIDjNEosF0Z1jLw.5 2019-11-28T22:44:40.217 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:40.215+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:44:40.404 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:40.402+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-28T22:44:40.446 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:40.444+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:40.461 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:40.459+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:40.477 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:40.474+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-28T22:44:40.477 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:40.474+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.1187', time=2019-11-29T00:31:17.127475+0000, chain.objs.size()=9 2019-11-28T22:44:40.477 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:40.474+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.73__multipart_file.mpg.2~uZmt_vsNMO3FrTeXjKYKC1g2gZJWFMP.1 2019-11-28T22:44:40.477 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:40.475+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.73__shadow_file.mpg.2~uZmt_vsNMO3FrTeXjKYKC1g2gZJWFMP.1_1 2019-11-28T22:44:40.477 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:40.475+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.73__multipart_file.mpg.2~uZmt_vsNMO3FrTeXjKYKC1g2gZJWFMP.2 2019-11-28T22:44:40.477 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:40.475+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.73__shadow_file.mpg.2~uZmt_vsNMO3FrTeXjKYKC1g2gZJWFMP.2_1 2019-11-28T22:44:40.478 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:40.475+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.73__multipart_file.mpg.2~uZmt_vsNMO3FrTeXjKYKC1g2gZJWFMP.3 2019-11-28T22:44:40.478 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:40.475+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.73__shadow_file.mpg.2~uZmt_vsNMO3FrTeXjKYKC1g2gZJWFMP.3_1 2019-11-28T22:44:40.478 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:40.475+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.73__multipart_file.mpg.2~uZmt_vsNMO3FrTeXjKYKC1g2gZJWFMP.4 2019-11-28T22:44:40.478 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:40.475+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.73__shadow_file.mpg.2~uZmt_vsNMO3FrTeXjKYKC1g2gZJWFMP.4_1 2019-11-28T22:44:40.478 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:40.475+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.73__multipart_file.mpg.2~uZmt_vsNMO3FrTeXjKYKC1g2gZJWFMP.5 2019-11-28T22:44:40.478 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:40.475+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.1238', time=2019-11-29T00:33:37.444190+0000, chain.objs.size()=7 2019-11-28T22:44:40.478 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:40.475+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__multipart_key1.2~Rn6tht6SwxgUpNP-jT89BPRFgbHyMxy.1 2019-11-28T22:44:40.479 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:40.475+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__shadow_key1.2~Rn6tht6SwxgUpNP-jT89BPRFgbHyMxy.1_1 2019-11-28T22:44:40.479 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:40.475+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__shadow_key1.2~Rn6tht6SwxgUpNP-jT89BPRFgbHyMxy.1_2 2019-11-28T22:44:40.739 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:40.737+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__multipart_key1.2~Rn6tht6SwxgUpNP-jT89BPRFgbHyMxy.2 2019-11-28T22:44:40.739 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:40.737+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__shadow_key1.2~Rn6tht6SwxgUpNP-jT89BPRFgbHyMxy.2_1 2019-11-28T22:44:40.739 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:40.737+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__shadow_key1.2~Rn6tht6SwxgUpNP-jT89BPRFgbHyMxy.2_2 2019-11-28T22:44:40.739 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:40.737+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__multipart_key1.2~Rn6tht6SwxgUpNP-jT89BPRFgbHyMxy.3 2019-11-28T22:44:40.948 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:40.946+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:44:41.098 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:41.096+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-28T22:44:41.165 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:41.163+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:41.180 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:41.178+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:41.193 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:41.191+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-28T22:44:41.193 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:41.191+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.1248', time=2019-11-29T00:33:56.980212+0000, chain.objs.size()=7 2019-11-28T22:44:41.193 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:41.191+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__multipart_key1.2~71aL71m7HqL7c432tdpww6gerkEbgDa.1 2019-11-28T22:44:41.193 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:41.191+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__shadow_key1.2~71aL71m7HqL7c432tdpww6gerkEbgDa.1_1 2019-11-28T22:44:41.194 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:41.191+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__shadow_key1.2~71aL71m7HqL7c432tdpww6gerkEbgDa.1_2 2019-11-28T22:44:41.194 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:41.191+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__multipart_key1.2~71aL71m7HqL7c432tdpww6gerkEbgDa.2 2019-11-28T22:44:41.194 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:41.191+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__shadow_key1.2~71aL71m7HqL7c432tdpww6gerkEbgDa.2_1 2019-11-28T22:44:41.194 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:41.191+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__shadow_key1.2~71aL71m7HqL7c432tdpww6gerkEbgDa.2_2 2019-11-28T22:44:41.194 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:41.191+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__multipart_key1.2~71aL71m7HqL7c432tdpww6gerkEbgDa.3 2019-11-28T22:44:41.543 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:41.541+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:44:41.693 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:41.692+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-28T22:44:41.748 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:41.746+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:41.768 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:41.766+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:41.794 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:41.791+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2019-11-28T22:44:41.794 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:41.791+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process iterating over entry tag='2~l_UIK69cBln6jZX_3XMlOTgvAb_9TsP', time=2019-11-29T00:23:27.737779+0000, chain.objs.size()=9 2019-11-28T22:44:41.794 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:41.791+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.52__multipart_key1.2~l_UIK69cBln6jZX_3XMlOTgvAb_9TsP.1 2019-11-28T22:44:41.794 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:41.791+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.52__shadow_key1.2~l_UIK69cBln6jZX_3XMlOTgvAb_9TsP.1_1 2019-11-28T22:44:41.795 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:41.791+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.52__multipart_key1.2~l_UIK69cBln6jZX_3XMlOTgvAb_9TsP.2 2019-11-28T22:44:41.795 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:41.791+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.52__shadow_key1.2~l_UIK69cBln6jZX_3XMlOTgvAb_9TsP.2_1 2019-11-28T22:44:41.795 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:41.791+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.52__multipart_key1.2~l_UIK69cBln6jZX_3XMlOTgvAb_9TsP.3 2019-11-28T22:44:41.795 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:41.791+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.52__shadow_key1.2~l_UIK69cBln6jZX_3XMlOTgvAb_9TsP.3_1 2019-11-28T22:44:41.795 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:41.791+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.52__multipart_key1.2~l_UIK69cBln6jZX_3XMlOTgvAb_9TsP.4 2019-11-28T22:44:41.795 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:41.791+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.52__shadow_key1.2~l_UIK69cBln6jZX_3XMlOTgvAb_9TsP.4_1 2019-11-28T22:44:41.795 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:41.791+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.52__multipart_key1.2~l_UIK69cBln6jZX_3XMlOTgvAb_9TsP.5 2019-11-28T22:44:41.796 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:41.791+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.1043', time=2019-11-29T00:25:46.615992+0000, chain.objs.size()=9 2019-11-28T22:44:41.796 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:41.791+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.64__multipart_key1.2~bOk5RMFNkHp1c1LlRupGnjR-e0LYVIE.1 2019-11-28T22:44:41.796 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:41.791+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.64__shadow_key1.2~bOk5RMFNkHp1c1LlRupGnjR-e0LYVIE.1_1 2019-11-28T22:44:41.796 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:41.791+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.64__multipart_key1.2~bOk5RMFNkHp1c1LlRupGnjR-e0LYVIE.2 2019-11-28T22:44:42.025 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:42.024+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.64__shadow_key1.2~bOk5RMFNkHp1c1LlRupGnjR-e0LYVIE.2_1 2019-11-28T22:44:42.135 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:42.133+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.64__multipart_key1.2~bOk5RMFNkHp1c1LlRupGnjR-e0LYVIE.3 2019-11-28T22:44:42.135 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:42.133+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.64__shadow_key1.2~bOk5RMFNkHp1c1LlRupGnjR-e0LYVIE.3_1 2019-11-28T22:44:42.135 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:42.133+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.64__multipart_key1.2~bOk5RMFNkHp1c1LlRupGnjR-e0LYVIE.4 2019-11-28T22:44:42.136 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:42.133+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.64__shadow_key1.2~bOk5RMFNkHp1c1LlRupGnjR-e0LYVIE.4_1 2019-11-28T22:44:42.138 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:42.137+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.64__multipart_key1.2~bOk5RMFNkHp1c1LlRupGnjR-e0LYVIE.5 2019-11-28T22:44:42.162 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:42.160+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.1045', time=2019-11-29T00:25:54.285927+0000, chain.objs.size()=9 2019-11-28T22:44:42.162 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:42.160+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.64__multipart_key1.2~bOk5RMFNkHp1c1LlRupGnjR-e0LYVIE.1 2019-11-28T22:44:42.162 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:42.160+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.64__shadow_key1.2~bOk5RMFNkHp1c1LlRupGnjR-e0LYVIE.1_1 2019-11-28T22:44:42.162 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:42.160+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.64__multipart_key1.2~bOk5RMFNkHp1c1LlRupGnjR-e0LYVIE.2 2019-11-28T22:44:42.162 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:42.160+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.64__shadow_key1.2~bOk5RMFNkHp1c1LlRupGnjR-e0LYVIE.2_1 2019-11-28T22:44:42.162 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:42.160+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.64__multipart_key1.2~bOk5RMFNkHp1c1LlRupGnjR-e0LYVIE.3 2019-11-28T22:44:42.353 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:42.351+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.64__shadow_key1.2~bOk5RMFNkHp1c1LlRupGnjR-e0LYVIE.3_1 2019-11-28T22:44:42.353 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:42.351+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.64__multipart_key1.2~bOk5RMFNkHp1c1LlRupGnjR-e0LYVIE.4 2019-11-28T22:44:42.358 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:42.357+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.64__shadow_key1.2~bOk5RMFNkHp1c1LlRupGnjR-e0LYVIE.4_1 2019-11-28T22:44:42.359 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:42.357+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.64__multipart_key1.2~bOk5RMFNkHp1c1LlRupGnjR-e0LYVIE.5 2019-11-28T22:44:42.359 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:42.357+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.1900', time=2019-11-29T00:43:52.220479+0000, chain.objs.size()=9 2019-11-28T22:44:42.359 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:42.357+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.118__multipart_key1.2~19FmDBybnlkbhPi5wieiiy1Dg67asV-.1 2019-11-28T22:44:42.359 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:42.357+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.118__shadow_key1.2~19FmDBybnlkbhPi5wieiiy1Dg67asV-.1_1 2019-11-28T22:44:42.496 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:42.495+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.118__multipart_key1.2~19FmDBybnlkbhPi5wieiiy1Dg67asV-.2 2019-11-28T22:44:42.497 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:42.495+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.118__shadow_key1.2~19FmDBybnlkbhPi5wieiiy1Dg67asV-.2_1 2019-11-28T22:44:42.510 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:42.508+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.118__multipart_key1.2~19FmDBybnlkbhPi5wieiiy1Dg67asV-.3 2019-11-28T22:44:42.642 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:42.640+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.118__shadow_key1.2~19FmDBybnlkbhPi5wieiiy1Dg67asV-.3_1 2019-11-28T22:44:42.642 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:42.640+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.118__multipart_key1.2~19FmDBybnlkbhPi5wieiiy1Dg67asV-.4 2019-11-28T22:44:42.643 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:42.640+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.118__shadow_key1.2~19FmDBybnlkbhPi5wieiiy1Dg67asV-.4_1 2019-11-28T22:44:42.643 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:42.640+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.118__multipart_key1.2~19FmDBybnlkbhPi5wieiiy1Dg67asV-.5 2019-11-28T22:44:42.905 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:42.903+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:44:42.999 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:42.997+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-28T22:44:43.046 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:43.044+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:43.062 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:43.060+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:43.071 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:43.069+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:43.103 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:43.102+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-28T22:44:43.144 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:43.142+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:43.160 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:43.158+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:43.168 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:43.167+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:43.216 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:43.215+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-28T22:44:43.318 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:43.316+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:43.354 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:43.352+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:43.367 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:43.365+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:43.437 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:43.435+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-28T22:44:43.481 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:43.479+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:43.507 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:43.505+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:43.516 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:43.515+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:43.551 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:43.549+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-28T22:44:43.617 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:43.615+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:43.632 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:43.630+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:43.641 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:43.639+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:43.685 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:43.683+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-28T22:44:43.749 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:43.747+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:43.780 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:43.779+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:43.803 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:43.800+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-28T22:44:43.803 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:43.800+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.1100', time=2019-11-29T00:29:22.118946+0000, chain.objs.size()=7 2019-11-28T22:44:43.803 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:43.800+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__multipart_key1.2~zrmrB8Z5edu9FBHfBpDhDUk_ChAIHa5.1 2019-11-28T22:44:43.803 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:43.800+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__shadow_key1.2~zrmrB8Z5edu9FBHfBpDhDUk_ChAIHa5.1_1 2019-11-28T22:44:43.804 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:43.800+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__shadow_key1.2~zrmrB8Z5edu9FBHfBpDhDUk_ChAIHa5.1_2 2019-11-28T22:44:43.804 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:43.800+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__multipart_key1.2~zrmrB8Z5edu9FBHfBpDhDUk_ChAIHa5.2 2019-11-28T22:44:43.804 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:43.800+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__shadow_key1.2~zrmrB8Z5edu9FBHfBpDhDUk_ChAIHa5.2_1 2019-11-28T22:44:43.804 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:43.800+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__shadow_key1.2~zrmrB8Z5edu9FBHfBpDhDUk_ChAIHa5.2_2 2019-11-28T22:44:43.804 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:43.800+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.67__multipart_key1.2~zrmrB8Z5edu9FBHfBpDhDUk_ChAIHa5.3 2019-11-28T22:44:44.047 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:44.045+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:44:44.195 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:44.193+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-28T22:44:44.251 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:44.249+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:44.276 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:44.274+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:44.303 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:44.301+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-28T22:44:44.303 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:44.301+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.1219', time=2019-11-29T00:32:41.990407+0000, chain.objs.size()=9 2019-11-28T22:44:44.303 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:44.301+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__multipart_key1.2~iVNQ6g3kNqcvzrLHEU-nz94A1KN4yqj.1 2019-11-28T22:44:44.303 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:44.301+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__shadow_key1.2~iVNQ6g3kNqcvzrLHEU-nz94A1KN4yqj.1_1 2019-11-28T22:44:44.304 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:44.301+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__multipart_key1.2~iVNQ6g3kNqcvzrLHEU-nz94A1KN4yqj.2 2019-11-28T22:44:44.304 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:44.301+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__shadow_key1.2~iVNQ6g3kNqcvzrLHEU-nz94A1KN4yqj.2_1 2019-11-28T22:44:44.304 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:44.301+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__multipart_key1.2~iVNQ6g3kNqcvzrLHEU-nz94A1KN4yqj.3 2019-11-28T22:44:44.304 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:44.301+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__shadow_key1.2~iVNQ6g3kNqcvzrLHEU-nz94A1KN4yqj.3_1 2019-11-28T22:44:44.304 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:44.301+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__multipart_key1.2~iVNQ6g3kNqcvzrLHEU-nz94A1KN4yqj.4 2019-11-28T22:44:44.304 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:44.301+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__shadow_key1.2~iVNQ6g3kNqcvzrLHEU-nz94A1KN4yqj.4_1 2019-11-28T22:44:44.305 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:44.301+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.75__multipart_key1.2~iVNQ6g3kNqcvzrLHEU-nz94A1KN4yqj.5 2019-11-28T22:44:44.305 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:44.301+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.1278', time=2019-11-29T00:35:05.219612+0000, chain.objs.size()=9 2019-11-28T22:44:44.305 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:44.301+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.77__multipart_key1.2~JvFfj347gdYF6BGwgR0kNevslBdkSfE.1 2019-11-28T22:44:44.305 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:44.301+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.77__shadow_key1.2~JvFfj347gdYF6BGwgR0kNevslBdkSfE.1_1 2019-11-28T22:44:44.305 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:44.301+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.77__multipart_key1.2~JvFfj347gdYF6BGwgR0kNevslBdkSfE.2 2019-11-28T22:44:44.486 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:44.484+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.77__shadow_key1.2~JvFfj347gdYF6BGwgR0kNevslBdkSfE.2_1 2019-11-28T22:44:44.647 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:44.645+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.77__multipart_key1.2~JvFfj347gdYF6BGwgR0kNevslBdkSfE.3 2019-11-28T22:44:44.647 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:44.645+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.77__shadow_key1.2~JvFfj347gdYF6BGwgR0kNevslBdkSfE.3_1 2019-11-28T22:44:44.648 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:44.645+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.77__multipart_key1.2~JvFfj347gdYF6BGwgR0kNevslBdkSfE.4 2019-11-28T22:44:44.648 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:44.645+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.77__shadow_key1.2~JvFfj347gdYF6BGwgR0kNevslBdkSfE.4_1 2019-11-28T22:44:44.648 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:44.645+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.77__multipart_key1.2~JvFfj347gdYF6BGwgR0kNevslBdkSfE.5 2019-11-28T22:44:44.825 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:44.823+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:44:44.987 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:44.986+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-28T22:44:45.047 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:45.045+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:45.077 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:45.075+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:45.094 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:45.092+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-28T22:44:45.094 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:45.092+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process iterating over entry tag='2~vTuzuaFMJsTzV_OZWB49OzKzPPKrKhg', time=2019-11-29T00:31:54.938986+0000, chain.objs.size()=9 2019-11-28T22:44:45.094 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:45.092+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.74__multipart_key1.2~vTuzuaFMJsTzV_OZWB49OzKzPPKrKhg.7 2019-11-28T22:44:45.095 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:45.092+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.74__shadow_key1.2~vTuzuaFMJsTzV_OZWB49OzKzPPKrKhg.7_1 2019-11-28T22:44:45.095 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:45.092+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.74__multipart_key1.2~vTuzuaFMJsTzV_OZWB49OzKzPPKrKhg.8 2019-11-28T22:44:45.095 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:45.092+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.74__shadow_key1.2~vTuzuaFMJsTzV_OZWB49OzKzPPKrKhg.8_1 2019-11-28T22:44:45.095 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:45.092+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.74__multipart_key1.2~vTuzuaFMJsTzV_OZWB49OzKzPPKrKhg.9 2019-11-28T22:44:45.095 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:45.092+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.74__shadow_key1.2~vTuzuaFMJsTzV_OZWB49OzKzPPKrKhg.9_1 2019-11-28T22:44:45.095 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:45.092+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.74__multipart_key1.2~vTuzuaFMJsTzV_OZWB49OzKzPPKrKhg.10 2019-11-28T22:44:45.095 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:45.092+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.74__shadow_key1.2~vTuzuaFMJsTzV_OZWB49OzKzPPKrKhg.10_1 2019-11-28T22:44:45.096 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:45.092+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.74__multipart_key1.2~vTuzuaFMJsTzV_OZWB49OzKzPPKrKhg.11 2019-11-28T22:44:45.353 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:45.351+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:44:45.603 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:45.601+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-28T22:44:45.668 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:45.666+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:45.693 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:45.691+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:45.706 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:45.705+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:45.741 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:45.740+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-28T22:44:45.819 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:45.817+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:45.853 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:45.851+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:45.902 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:45.900+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-28T22:44:45.903 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:45.900+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process iterating over entry tag='2~osCye6-lkwWkkuKV71zyjlIgs1qzhai', time=2019-11-29T00:35:23.676262+0000, chain.objs.size()=27 2019-11-28T22:44:45.903 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:45.900+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.78__multipart_key1.2~osCye6-lkwWkkuKV71zyjlIgs1qzhai.1 2019-11-28T22:44:45.903 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:45.900+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.78__multipart_key1.2~osCye6-lkwWkkuKV71zyjlIgs1qzhai.2 2019-11-28T22:44:45.903 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:45.900+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.78__multipart_key1.2~osCye6-lkwWkkuKV71zyjlIgs1qzhai.3 2019-11-28T22:44:45.903 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:45.900+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.78__multipart_key1.2~osCye6-lkwWkkuKV71zyjlIgs1qzhai.4 2019-11-28T22:44:45.903 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:45.900+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.78__multipart_key1.2~osCye6-lkwWkkuKV71zyjlIgs1qzhai.5 2019-11-28T22:44:45.904 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:45.900+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.78__multipart_key1.2~osCye6-lkwWkkuKV71zyjlIgs1qzhai.6 2019-11-28T22:44:45.904 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:45.900+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.78__multipart_key1.2~osCye6-lkwWkkuKV71zyjlIgs1qzhai.7 2019-11-28T22:44:45.904 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:45.900+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.78__multipart_key1.2~osCye6-lkwWkkuKV71zyjlIgs1qzhai.8 2019-11-28T22:44:45.904 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:45.900+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.78__multipart_key1.2~osCye6-lkwWkkuKV71zyjlIgs1qzhai.9 2019-11-28T22:44:45.904 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:45.900+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.78__multipart_key1.2~osCye6-lkwWkkuKV71zyjlIgs1qzhai.10 2019-11-28T22:44:45.904 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:45.900+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.78__multipart_key1.2~osCye6-lkwWkkuKV71zyjlIgs1qzhai.11 2019-11-28T22:44:45.904 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:45.900+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.78__multipart_key1.bd28SXAtiuHtpqw3Qffpy81fN22iepp.12 2019-11-28T22:44:46.091 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:46.089+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.78__multipart_key1.JOrwnHYw7P2l1B8Bw5o-FFVH1BAnH9_.13 2019-11-28T22:44:46.138 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:46.136+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.78__multipart_key1.0XIbAMbWVIxEVG_n2aTa1IRM6Axw_9i.14 2019-11-28T22:44:46.138 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:46.136+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.78__multipart_key1.n59NcG4M1QU1t-s4tgE_8D88FXweJxE.15 2019-11-28T22:44:46.138 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:46.136+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.78__multipart_key1.lnpsF2O6APgim_c9MtglnvrjQ0c_AIz.16 2019-11-28T22:44:46.138 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:46.136+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.78__multipart_key1.Jqj6ENL1hZGTPsAtoR1YX5loDvaQYuB.17 2019-11-28T22:44:46.139 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:46.136+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.78__multipart_key1.EAo9ENt-p4STrfIc2E3bYBxY25xHNV4.18 2019-11-28T22:44:46.139 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:46.136+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.78__multipart_key1.n1O4EnhMgPbGef9F_kkFAszefpjnqjp.19 2019-11-28T22:44:46.139 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:46.136+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.78__multipart_key1.EiPKX0ekEqZRXMW93jAv8rMQz7A69Mw.20 2019-11-28T22:44:46.139 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:46.136+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.78__multipart_key1.2~osCye6-lkwWkkuKV71zyjlIgs1qzhai.21 2019-11-28T22:44:46.139 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:46.136+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.78__multipart_key1.2~osCye6-lkwWkkuKV71zyjlIgs1qzhai.22 2019-11-28T22:44:46.139 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:46.136+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.78__multipart_key1.2~osCye6-lkwWkkuKV71zyjlIgs1qzhai.23 2019-11-28T22:44:46.214 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:46.213+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.78__multipart_key1.2~osCye6-lkwWkkuKV71zyjlIgs1qzhai.24 2019-11-28T22:44:46.333 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:46.330+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.78__multipart_key1.2~osCye6-lkwWkkuKV71zyjlIgs1qzhai.25 2019-11-28T22:44:46.333 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:46.330+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.78__multipart_key1.2~osCye6-lkwWkkuKV71zyjlIgs1qzhai.27 2019-11-28T22:44:46.333 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:46.331+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.78__multipart_key1.2~osCye6-lkwWkkuKV71zyjlIgs1qzhai.28 2019-11-28T22:44:46.490 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:46.489+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:44:46.592 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:46.591+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-28T22:44:46.638 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:46.636+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:46.671 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:46.669+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:46.685 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:46.683+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-28T22:44:46.685 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:46.683+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.1156', time=2019-11-29T00:30:46.615620+0000, chain.objs.size()=9 2019-11-28T22:44:46.685 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:46.683+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.72__multipart_key1.2~Y47XIQIfdClXj7EbVNb3_UHkPsnt3Al.1 2019-11-28T22:44:46.685 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:46.683+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.72__shadow_key1.2~Y47XIQIfdClXj7EbVNb3_UHkPsnt3Al.1_1 2019-11-28T22:44:46.685 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:46.683+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.72__multipart_key1.2~Y47XIQIfdClXj7EbVNb3_UHkPsnt3Al.2 2019-11-28T22:44:46.686 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:46.683+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.72__shadow_key1.2~Y47XIQIfdClXj7EbVNb3_UHkPsnt3Al.2_1 2019-11-28T22:44:46.686 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:46.683+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.72__multipart_key1.2~Y47XIQIfdClXj7EbVNb3_UHkPsnt3Al.3 2019-11-28T22:44:46.686 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:46.683+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.72__shadow_key1.2~Y47XIQIfdClXj7EbVNb3_UHkPsnt3Al.3_1 2019-11-28T22:44:46.686 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:46.683+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.72__multipart_key1.2~Y47XIQIfdClXj7EbVNb3_UHkPsnt3Al.4 2019-11-28T22:44:46.686 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:46.683+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.72__shadow_key1.2~Y47XIQIfdClXj7EbVNb3_UHkPsnt3Al.4_1 2019-11-28T22:44:46.686 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:46.683+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.72__multipart_key1.2~Y47XIQIfdClXj7EbVNb3_UHkPsnt3Al.5 2019-11-28T22:44:46.986 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:46.984+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:44:47.088 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:47.086+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-28T22:44:47.156 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:47.154+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:47.172 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:47.170+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:47.184 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:47.182+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-28T22:44:47.184 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:47.182+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.1058', time=2019-11-29T00:29:28.651663+0000, chain.objs.size()=5 2019-11-28T22:44:47.184 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:47.182+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.66__shadow_.ShSuhZo-mZHyD0sRRYgKlHi0_CMnVEl_1 2019-11-28T22:44:47.184 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:47.182+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.66__shadow_.ShSuhZo-mZHyD0sRRYgKlHi0_CMnVEl_2 2019-11-28T22:44:47.185 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:47.182+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.66__shadow_.ShSuhZo-mZHyD0sRRYgKlHi0_CMnVEl_3 2019-11-28T22:44:47.185 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:47.182+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.66__shadow_.ShSuhZo-mZHyD0sRRYgKlHi0_CMnVEl_4 2019-11-28T22:44:47.185 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:47.182+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.66__shadow_.ShSuhZo-mZHyD0sRRYgKlHi0_CMnVEl_5 2019-11-28T22:44:47.364 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:47.363+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:44:47.476 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:47.474+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-28T22:44:47.519 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:47.517+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:47.534 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:47.532+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:47.543 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:47.541+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:47.600 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:47.598+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-28T22:44:47.640 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:47.638+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:47.654 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:47.652+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:47.671 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:47.669+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-28T22:44:47.672 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:47.669+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process iterating over entry tag='bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4494.1188', time=2019-11-29T00:31:19.372281+0000, chain.objs.size()=9 2019-11-28T22:44:47.672 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:47.669+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.73__multipart_file2.mpg.2~a2M0wZo0LoramZnA34VtzrVFkeV4278.1 2019-11-28T22:44:47.672 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:47.669+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.73__shadow_file2.mpg.2~a2M0wZo0LoramZnA34VtzrVFkeV4278.1_1 2019-11-28T22:44:47.672 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:47.669+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.73__multipart_file2.mpg.2~a2M0wZo0LoramZnA34VtzrVFkeV4278.2 2019-11-28T22:44:47.672 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:47.669+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.73__shadow_file2.mpg.2~a2M0wZo0LoramZnA34VtzrVFkeV4278.2_1 2019-11-28T22:44:47.672 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:47.669+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.73__multipart_file2.mpg.2~a2M0wZo0LoramZnA34VtzrVFkeV4278.3 2019-11-28T22:44:47.673 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:47.669+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.73__shadow_file2.mpg.2~a2M0wZo0LoramZnA34VtzrVFkeV4278.3_1 2019-11-28T22:44:47.673 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:47.669+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.73__multipart_file2.mpg.2~a2M0wZo0LoramZnA34VtzrVFkeV4278.4 2019-11-28T22:44:47.673 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:47.669+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.73__shadow_file2.mpg.2~a2M0wZo0LoramZnA34VtzrVFkeV4278.4_1 2019-11-28T22:44:47.673 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:47.669+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.73__multipart_file2.mpg.2~a2M0wZo0LoramZnA34VtzrVFkeV4278.5 2019-11-28T22:44:47.861 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:47.859+0000 7efeb0fbfec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-28T22:44:47.989 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:47.987+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-28T22:44:48.029 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:48.027+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:48.044 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:48.043+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:48.053 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:48.051+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:48.099 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:48.097+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-28T22:44:48.155 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:48.153+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:48.180 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:48.178+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:48.192 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:48.191+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:48.263 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:48.261+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-28T22:44:48.321 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:48.319+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:48.336 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:48.335+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:48.345 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:48.343+0000 7efeb0fbfec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:48.424 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:48.422+0000 7efeb0fbfec0 20 remove_watcher() i=0 2019-11-28T22:44:48.424 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:48.422+0000 7efeb0fbfec0 2 removed watcher, disabling cache 2019-11-28T22:44:48.481 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:48.479+0000 7efeb0fbfec0 20 remove_watcher() i=1 2019-11-28T22:44:48.538 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:48.536+0000 7efeb0fbfec0 20 remove_watcher() i=2 2019-11-28T22:44:48.596 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:48.594+0000 7efeb0fbfec0 20 remove_watcher() i=3 2019-11-28T22:44:48.644 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:48.642+0000 7efeb0fbfec0 20 remove_watcher() i=4 2019-11-28T22:44:48.697 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:48.696+0000 7efeb0fbfec0 20 remove_watcher() i=5 2019-11-28T22:44:48.764 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:48.762+0000 7efeb0fbfec0 20 remove_watcher() i=6 2019-11-28T22:44:48.811 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:48.807+0000 7efeb0fbfec0 20 remove_watcher() i=7 2019-11-28T22:44:48.817 INFO:teuthology.orchestra.run.smithi074:> radosgw-admin gc process --include-all 2019-11-28T22:44:48.940 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:48.938+0000 7f69caec4ec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:48.977 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:48.975+0000 7f69caec4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:44:48.977 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:48.975+0000 7f69caec4ec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:48.986 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:48.985+0000 7f69caec4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:44:48.987 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:48.985+0000 7f69caec4ec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:49.002 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.000+0000 7f69caec4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:44:49.002 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.000+0000 7f69caec4ec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:49.026 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.024+0000 7f69caec4ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:44:49.276 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.274+0000 7f69caec4ec0 20 RGWRados::pool_iterate: got zonegroup_info.cb1773b4-411c-4317-a760-df89ca0f54fc 2019-11-28T22:44:49.277 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.274+0000 7f69caec4ec0 20 RGWRados::pool_iterate: got zone_info.bd5ae442-b074-4d35-94cc-b1d71bd6ac02 2019-11-28T22:44:49.277 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.274+0000 7f69caec4ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-28T22:44:49.277 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.274+0000 7f69caec4ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-28T22:44:49.277 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.274+0000 7f69caec4ec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:49.293 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.291+0000 7f69caec4ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:44:49.293 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.291+0000 7f69caec4ec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:49.305 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.303+0000 7f69caec4ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T22:44:49.305 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.303+0000 7f69caec4ec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:49.325 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.323+0000 7f69caec4ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:44:49.325 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.324+0000 7f69caec4ec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:49.348 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.346+0000 7f69caec4ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T22:44:49.348 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.346+0000 7f69caec4ec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:49.359 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.357+0000 7f69caec4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:44:49.359 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.357+0000 7f69caec4ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-28T22:44:49.359 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.357+0000 7f69caec4ec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:49.367 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.366+0000 7f69caec4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:44:49.368 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.366+0000 7f69caec4ec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:49.378 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.377+0000 7f69caec4ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:44:49.379 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.377+0000 7f69caec4ec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:49.391 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.389+0000 7f69caec4ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T22:44:49.391 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.389+0000 7f69caec4ec0 20 zonegroup default 2019-11-28T22:44:49.391 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.389+0000 7f69caec4ec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:49.401 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.399+0000 7f69caec4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:44:49.401 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.399+0000 7f69caec4ec0 10 Cannot find current period zone using local zone 2019-11-28T22:44:49.402 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.399+0000 7f69caec4ec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:49.411 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.409+0000 7f69caec4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:44:49.411 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.409+0000 7f69caec4ec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:49.422 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.421+0000 7f69caec4ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:44:49.423 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.421+0000 7f69caec4ec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:49.431 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.429+0000 7f69caec4ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T22:44:49.431 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.429+0000 7f69caec4ec0 20 zone default found 2019-11-28T22:44:49.432 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.429+0000 7f69caec4ec0 20 started sync module instance, tier type = 2019-11-28T22:44:49.432 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.429+0000 7f69caec4ec0 20 started zone id=bd5ae442-b074-4d35-94cc-b1d71bd6ac02 (name=default) with tier type = 2019-11-28T22:44:49.733 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.731+0000 7f69caec4ec0 20 add_watcher() i=0 2019-11-28T22:44:49.733 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.731+0000 7f69caec4ec0 20 add_watcher() i=1 2019-11-28T22:44:49.733 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.731+0000 7f69caec4ec0 20 add_watcher() i=2 2019-11-28T22:44:49.734 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.731+0000 7f69caec4ec0 20 add_watcher() i=3 2019-11-28T22:44:49.734 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.731+0000 7f69caec4ec0 20 add_watcher() i=4 2019-11-28T22:44:49.734 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.731+0000 7f69caec4ec0 20 add_watcher() i=5 2019-11-28T22:44:49.742 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.740+0000 7f69caec4ec0 20 add_watcher() i=6 2019-11-28T22:44:49.760 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.758+0000 7f69caec4ec0 20 add_watcher() i=7 2019-11-28T22:44:49.760 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.758+0000 7f69caec4ec0 2 all 8 watchers are set, enabling cache 2019-11-28T22:44:49.760 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.758+0000 7f6988fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-28T22:44:49.764 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.762+0000 7f69b88f2700 0 -- 172.21.15.74:0/1310762665 >> [v2:172.21.15.74:3301/0,v1:172.21.15.74:6790/0] conn(0x55da8afd92d0 msgr2=0x55da8b00aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-28T22:44:49.790 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:49.788+0000 7f69b88f2700 0 -- 172.21.15.74:0/494073489 >> [v2:172.21.15.74:3300/0,v1:172.21.15.74:6789/0] conn(0x55da8affa610 msgr2=0x55da8aff99f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-28T22:44:51.289 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:51.287+0000 7f68faffd700 20 reqs_thread_entry: start 2019-11-28T22:44:51.289 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:51.287+0000 7f68f8ff9700 20 reqs_thread_entry: start 2019-11-28T22:44:51.289 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:51.287+0000 7f69caec4ec0 20 init_complete bucket index max shards: 0 2019-11-28T22:44:51.290 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:51.288+0000 7f68eeffd700 20 reqs_thread_entry: start 2019-11-28T22:44:51.290 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:51.288+0000 7f69caec4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-28T22:44:51.350 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:51.348+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:51.374 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:51.372+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:51.384 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:51.383+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:51.425 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:51.423+0000 7f69caec4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-28T22:44:51.480 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:51.478+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:51.501 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:51.500+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:51.512 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:51.510+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:51.558 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:51.556+0000 7f69caec4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-28T22:44:51.609 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:51.607+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:51.626 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:51.624+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:51.636 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:51.634+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:51.675 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:51.673+0000 7f69caec4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-28T22:44:51.735 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:51.733+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:51.765 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:51.763+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:51.777 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:51.775+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:51.828 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:51.826+0000 7f69caec4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-28T22:44:51.890 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:51.888+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:51.914 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:51.912+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:51.922 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:51.920+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:51.960 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:51.958+0000 7f69caec4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-28T22:44:52.013 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:52.012+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:52.035 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:52.033+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:52.044 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:52.042+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:52.073 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:52.071+0000 7f69caec4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-28T22:44:52.112 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:52.110+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:52.130 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:52.129+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:52.139 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:52.137+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:52.171 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:52.169+0000 7f69caec4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-28T22:44:52.224 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:52.222+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:52.245 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:52.244+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:52.257 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:52.256+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:52.292 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:52.290+0000 7f69caec4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-28T22:44:52.356 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:52.354+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:52.377 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:52.375+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:52.391 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:52.389+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:52.433 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:52.431+0000 7f69caec4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-28T22:44:52.530 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:52.528+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:52.558 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:52.556+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:52.573 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:52.571+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:52.631 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:52.629+0000 7f69caec4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-28T22:44:52.716 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:52.714+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:52.743 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:52.741+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:52.756 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:52.754+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:52.815 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:52.813+0000 7f69caec4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-28T22:44:52.873 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:52.871+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:52.899 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:52.898+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:52.913 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:52.911+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:52.958 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:52.956+0000 7f69caec4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-28T22:44:53.030 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:53.028+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:53.057 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:53.055+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:53.069 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:53.068+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:53.144 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:53.142+0000 7f69caec4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-28T22:44:53.198 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:53.196+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:53.216 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:53.215+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:53.226 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:53.225+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:53.267 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:53.266+0000 7f69caec4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-28T22:44:53.322 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:53.320+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:53.353 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:53.351+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:53.366 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:53.364+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:53.491 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:53.487+0000 7f69caec4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-28T22:44:53.537 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:53.535+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:53.555 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:53.553+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:53.567 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:53.565+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:53.622 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:53.620+0000 7f69caec4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-28T22:44:53.701 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:53.699+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:53.737 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:53.736+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:53.752 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:53.750+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:53.804 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:53.802+0000 7f69caec4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-28T22:44:53.877 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:53.876+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:53.910 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:53.908+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:53.922 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:53.920+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:53.976 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:53.975+0000 7f69caec4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-28T22:44:54.025 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:54.023+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:54.045 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:54.043+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:54.056 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:54.054+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:54.103 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:54.101+0000 7f69caec4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-28T22:44:54.149 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:54.147+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:54.172 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:54.170+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:54.181 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:54.179+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:54.216 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:54.214+0000 7f69caec4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-28T22:44:54.269 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:54.267+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:54.293 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:54.291+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:54.301 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:54.300+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:54.339 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:54.338+0000 7f69caec4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-28T22:44:54.403 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:54.401+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:54.432 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:54.430+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:54.442 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:54.441+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:54.492 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:54.490+0000 7f69caec4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-28T22:44:54.540 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:54.539+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:54.555 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:54.554+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:54.567 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:54.565+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:54.609 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:54.607+0000 7f69caec4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-28T22:44:54.679 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:54.677+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:54.702 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:54.701+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:54.715 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:54.714+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:54.758 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:54.756+0000 7f69caec4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-28T22:44:54.818 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:54.817+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:54.839 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:54.837+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:54.848 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:54.847+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:54.884 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:54.883+0000 7f69caec4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-28T22:44:54.946 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:54.944+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:54.969 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:54.968+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:54.981 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:54.980+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:55.030 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:55.028+0000 7f69caec4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-28T22:44:55.084 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:55.083+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:55.102 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:55.100+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:55.110 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:55.109+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:55.145 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:55.143+0000 7f69caec4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-28T22:44:55.202 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:55.201+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:55.234 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:55.231+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:55.247 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:55.246+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:55.291 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:55.289+0000 7f69caec4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-28T22:44:55.364 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:55.362+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:55.383 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:55.381+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:55.392 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:55.391+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:55.430 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:55.428+0000 7f69caec4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-28T22:44:55.476 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:55.474+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:55.493 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:55.491+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:55.502 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:55.500+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:55.535 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:55.533+0000 7f69caec4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-28T22:44:55.588 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:55.586+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:55.604 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:55.602+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:55.613 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:55.611+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:55.650 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:55.648+0000 7f69caec4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-28T22:44:55.692 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:55.690+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:55.712 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:55.710+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-28T22:44:55.720 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:55.719+0000 7f69caec4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-28T22:44:55.783 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:55.781+0000 7f69caec4ec0 20 remove_watcher() i=0 2019-11-28T22:44:55.783 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:55.781+0000 7f69caec4ec0 2 removed watcher, disabling cache 2019-11-28T22:44:55.834 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:55.832+0000 7f69caec4ec0 20 remove_watcher() i=1 2019-11-28T22:44:55.908 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:55.906+0000 7f69caec4ec0 20 remove_watcher() i=2 2019-11-28T22:44:55.953 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:55.951+0000 7f69caec4ec0 20 remove_watcher() i=3 2019-11-28T22:44:55.992 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:55.990+0000 7f69caec4ec0 20 remove_watcher() i=4 2019-11-28T22:44:56.035 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:56.034+0000 7f69caec4ec0 20 remove_watcher() i=5 2019-11-28T22:44:56.076 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:56.074+0000 7f69caec4ec0 20 remove_watcher() i=6 2019-11-28T22:44:56.111 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:56.109+0000 7f69caec4ec0 20 remove_watcher() i=7 2019-11-28T22:44:56.119 INFO:teuthology.run_tasks:Running task s3tests... 2019-11-28T22:44:56.135 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'force-branch': 'ceph-master', 'slow_backend': True}} 2019-11-28T22:44:56.135 INFO:tasks.s3tests:Downloading s3-tests... 2019-11-28T22:44:56.135 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2019-11-28T22:44:56.136 INFO:teuthology.orchestra.run.smithi074:> git clone -b ceph-master git://git.ceph.com/git/s3-tests.git /home/ubuntu/cephtest/s3-tests 2019-11-28T22:44:56.197 INFO:teuthology.orchestra.run.smithi074.stdout:Cloning into '/home/ubuntu/cephtest/s3-tests'... 2019-11-28T22:44:56.729 INFO:tasks.s3tests:Creating rgw users... 2019-11-28T22:44:56.729 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2019-11-28T22:44:56.730 INFO:teuthology.orchestra.run.smithi074:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name 'Mr. bar.client.0' --access-key LQSDDOYHNPOJYWCWYTWN --secret SeCvN+53wvnrR2d6E9yjEUHK83TJ1K+Bbb1kB7wOF2SbYGAcVLhjfA== --email bar.client.0+test@test.test --cluster ceph 2019-11-28T22:44:56.854 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:56.853+0000 7f96232d0ec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:56.902 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:56.901+0000 7f96232d0ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:44:56.902 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:56.901+0000 7f96232d0ec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:56.914 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:56.912+0000 7f96232d0ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:44:56.914 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:56.912+0000 7f96232d0ec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:56.926 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:56.924+0000 7f96232d0ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:44:56.927 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:56.924+0000 7f96232d0ec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:56.953 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:56.952+0000 7f96232d0ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:44:57.215 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.213+0000 7f96232d0ec0 20 RGWRados::pool_iterate: got zonegroup_info.cb1773b4-411c-4317-a760-df89ca0f54fc 2019-11-28T22:44:57.215 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.213+0000 7f96232d0ec0 20 RGWRados::pool_iterate: got zone_info.bd5ae442-b074-4d35-94cc-b1d71bd6ac02 2019-11-28T22:44:57.216 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.213+0000 7f96232d0ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-28T22:44:57.216 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.213+0000 7f96232d0ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-28T22:44:57.216 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.213+0000 7f96232d0ec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:57.232 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.227+0000 7f96232d0ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:44:57.232 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.227+0000 7f96232d0ec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:57.243 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.241+0000 7f96232d0ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T22:44:57.243 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.241+0000 7f96232d0ec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:57.256 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.255+0000 7f96232d0ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:44:57.256 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.255+0000 7f96232d0ec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:57.273 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.271+0000 7f96232d0ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T22:44:57.273 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.272+0000 7f96232d0ec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:57.286 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.284+0000 7f96232d0ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:44:57.286 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.285+0000 7f96232d0ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-28T22:44:57.287 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.285+0000 7f96232d0ec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:57.296 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.294+0000 7f96232d0ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:44:57.296 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.294+0000 7f96232d0ec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:57.305 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.303+0000 7f96232d0ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:44:57.305 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.303+0000 7f96232d0ec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:57.312 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.311+0000 7f96232d0ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T22:44:57.313 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.311+0000 7f96232d0ec0 20 zonegroup default 2019-11-28T22:44:57.313 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.311+0000 7f96232d0ec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:57.320 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.318+0000 7f96232d0ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:44:57.320 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.318+0000 7f96232d0ec0 10 Cannot find current period zone using local zone 2019-11-28T22:44:57.320 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.318+0000 7f96232d0ec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:57.331 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.329+0000 7f96232d0ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:44:57.331 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.329+0000 7f96232d0ec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:57.341 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.339+0000 7f96232d0ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:44:57.341 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.339+0000 7f96232d0ec0 20 rados->read ofs=0 len=0 2019-11-28T22:44:57.351 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.349+0000 7f96232d0ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T22:44:57.351 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.349+0000 7f96232d0ec0 20 zone default found 2019-11-28T22:44:57.352 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.349+0000 7f96232d0ec0 20 started sync module instance, tier type = 2019-11-28T22:44:57.352 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.349+0000 7f96232d0ec0 20 started zone id=bd5ae442-b074-4d35-94cc-b1d71bd6ac02 (name=default) with tier type = 2019-11-28T22:44:57.667 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.665+0000 7f96232d0ec0 20 add_watcher() i=0 2019-11-28T22:44:57.667 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.665+0000 7f96232d0ec0 20 add_watcher() i=1 2019-11-28T22:44:57.667 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.665+0000 7f96232d0ec0 20 add_watcher() i=2 2019-11-28T22:44:57.667 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.665+0000 7f96232d0ec0 20 add_watcher() i=3 2019-11-28T22:44:57.667 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.665+0000 7f96232d0ec0 20 add_watcher() i=4 2019-11-28T22:44:57.667 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.665+0000 7f96232d0ec0 20 add_watcher() i=5 2019-11-28T22:44:57.668 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.665+0000 7f96232d0ec0 20 add_watcher() i=6 2019-11-28T22:44:57.696 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.694+0000 7f96104fd700 0 -- 172.21.15.74:0/851904884 >> [v2:172.21.15.74:6804/10097,v1:172.21.15.74:6805/10097] conn(0x7f960001b230 msgr2=0x7f960001b640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-28T22:44:57.696 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.694+0000 7f96232d0ec0 20 add_watcher() i=7 2019-11-28T22:44:57.696 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.694+0000 7f96232d0ec0 2 all 8 watchers are set, enabling cache 2019-11-28T22:44:57.697 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.694+0000 7f95e0fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-28T22:44:57.721 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.720+0000 7f9610cfe700 0 -- 172.21.15.74:0/2333779854 >> v2:172.21.15.74:3300/0 conn(0x55b465053f80 msgr2=0x55b465054390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-28T22:44:57.924 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:57.923+0000 7f9610cfe700 0 --2- 172.21.15.74:0/2333779854 >> v2:172.21.15.74:3300/0 conn(0x55b465053f80 0x55b465054390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-28T22:44:59.449 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:59.448+0000 7f9552ffd700 20 reqs_thread_entry: start 2019-11-28T22:44:59.450 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:59.448+0000 7f9550ff9700 20 reqs_thread_entry: start 2019-11-28T22:44:59.450 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:59.448+0000 7f96232d0ec0 20 init_complete bucket index max shards: 0 2019-11-28T22:44:59.450 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:59.449+0000 7f9546ffd700 20 reqs_thread_entry: start 2019-11-28T22:44:59.450 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:59.449+0000 7f96232d0ec0 20 get_system_obj_state: rctx=0x7ffd33ba6ef8 obj=default.rgw.meta:users.uid:bar.client.0 state=0x55b4650c69e0 s->prefetch_data=0 2019-11-28T22:44:59.450 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:59.449+0000 7f96232d0ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2019-11-28T22:44:59.457 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:59.456+0000 7f96232d0ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2019-11-28T22:44:59.457 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:59.456+0000 7f96232d0ec0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-28T22:44:59.458 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:59.456+0000 7f96232d0ec0 20 get_system_obj_state: rctx=0x7ffd33ba6f08 obj=default.rgw.meta:users.email:bar.client.0+test@test.test state=0x55b4650c8770 s->prefetch_data=0 2019-11-28T22:44:59.458 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:59.456+0000 7f96232d0ec0 10 cache get: name=default.rgw.meta+users.email+bar.client.0+test@test.test : miss 2019-11-28T22:44:59.467 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:59.466+0000 7f96232d0ec0 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x0 2019-11-28T22:44:59.467 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:59.466+0000 7f96232d0ec0 10 adding default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-11-28T22:44:59.467 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:59.466+0000 7f96232d0ec0 20 get_system_obj_state: rctx=0x7ffd33ba6f08 obj=default.rgw.meta:users.keys:LQSDDOYHNPOJYWCWYTWN state=0x55b4650c8770 s->prefetch_data=0 2019-11-28T22:44:59.467 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:59.466+0000 7f96232d0ec0 10 cache get: name=default.rgw.meta+users.keys+LQSDDOYHNPOJYWCWYTWN : miss 2019-11-28T22:44:59.476 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:59.475+0000 7f96232d0ec0 10 cache put: name=default.rgw.meta+users.keys+LQSDDOYHNPOJYWCWYTWN info.flags=0x0 2019-11-28T22:44:59.476 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:59.475+0000 7f96232d0ec0 10 adding default.rgw.meta+users.keys+LQSDDOYHNPOJYWCWYTWN to cache LRU end 2019-11-28T22:44:59.476 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:59.475+0000 7f96232d0ec0 20 get_system_obj_state: rctx=0x7ffd33ba6b18 obj=default.rgw.meta:users.keys:LQSDDOYHNPOJYWCWYTWN state=0x55b4650c8770 s->prefetch_data=0 2019-11-28T22:44:59.476 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:59.475+0000 7f96232d0ec0 10 cache get: name=default.rgw.meta+users.keys+LQSDDOYHNPOJYWCWYTWN : type miss (requested=0x6, cached=0x0) 2019-11-28T22:44:59.485 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:59.485+0000 7f96232d0ec0 10 cache put: name=default.rgw.meta+users.keys+LQSDDOYHNPOJYWCWYTWN info.flags=0x0 2019-11-28T22:44:59.486 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:59.485+0000 7f96232d0ec0 10 moving default.rgw.meta+users.keys+LQSDDOYHNPOJYWCWYTWN to cache LRU end 2019-11-28T22:44:59.486 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:59.485+0000 7f96232d0ec0 20 get_system_obj_state: rctx=0x7ffd33ba6c98 obj=default.rgw.meta:users.keys:LQSDDOYHNPOJYWCWYTWN state=0x55b4650c8770 s->prefetch_data=0 2019-11-28T22:44:59.486 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:59.485+0000 7f96232d0ec0 10 cache get: name=default.rgw.meta+users.keys+LQSDDOYHNPOJYWCWYTWN : type miss (requested=0x6, cached=0x0) 2019-11-28T22:44:59.495 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:59.495+0000 7f96232d0ec0 10 cache put: name=default.rgw.meta+users.keys+LQSDDOYHNPOJYWCWYTWN info.flags=0x0 2019-11-28T22:44:59.495 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:59.495+0000 7f96232d0ec0 10 moving default.rgw.meta+users.keys+LQSDDOYHNPOJYWCWYTWN to cache LRU end 2019-11-28T22:44:59.559 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:59.559+0000 7f96232d0ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-28T22:44:59.560 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:59.559+0000 7f96232d0ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-28T22:44:59.560 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:59.559+0000 7f96232d0ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=617 2019-11-28T22:44:59.570 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:59.569+0000 7f95f5ffb700 10 RGWWatcher::handle_notify() notify_id 579820585037 cookie 94233277229184 notifier 4580 bl.length()=617 2019-11-28T22:44:59.570 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:59.569+0000 7f95f5ffb700 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-28T22:44:59.570 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:44:59.569+0000 7f95f5ffb700 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-28T22:45:00.067 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:00.066+0000 7f96232d0ec0 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2019-11-28T22:45:00.067 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:00.066+0000 7f96232d0ec0 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-11-28T22:45:00.067 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:00.066+0000 7f96232d0ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=194 2019-11-28T22:45:00.081 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:00.080+0000 7f95f5ffb700 10 RGWWatcher::handle_notify() notify_id 579820585038 cookie 94233277229184 notifier 4580 bl.length()=194 2019-11-28T22:45:00.081 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:00.080+0000 7f95f5ffb700 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2019-11-28T22:45:00.081 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:00.080+0000 7f95f5ffb700 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-11-28T22:45:00.875 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:00.874+0000 7f96232d0ec0 10 cache put: name=default.rgw.meta+users.keys+LQSDDOYHNPOJYWCWYTWN info.flags=0x7 2019-11-28T22:45:00.876 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:00.874+0000 7f96232d0ec0 10 moving default.rgw.meta+users.keys+LQSDDOYHNPOJYWCWYTWN to cache LRU end 2019-11-28T22:45:00.876 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:00.874+0000 7f96232d0ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=186 2019-11-28T22:45:00.907 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:00.907+0000 7f95f5ffb700 10 RGWWatcher::handle_notify() notify_id 579820585039 cookie 94233277229184 notifier 4580 bl.length()=186 2019-11-28T22:45:00.908 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:00.907+0000 7f95f5ffb700 10 cache put: name=default.rgw.meta+users.keys+LQSDDOYHNPOJYWCWYTWN info.flags=0x7 2019-11-28T22:45:00.908 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:00.907+0000 7f95f5ffb700 10 moving default.rgw.meta+users.keys+LQSDDOYHNPOJYWCWYTWN to cache LRU end 2019-11-28T22:45:01.333 INFO:teuthology.orchestra.run.smithi074.stdout:{ 2019-11-28T22:45:01.333 INFO:teuthology.orchestra.run.smithi074.stdout: "user_id": "bar.client.0", 2019-11-28T22:45:01.333 INFO:teuthology.orchestra.run.smithi074.stdout: "display_name": "Mr. bar.client.0", 2019-11-28T22:45:01.333 INFO:teuthology.orchestra.run.smithi074.stdout: "email": "bar.client.0+test@test.test", 2019-11-28T22:45:01.334 INFO:teuthology.orchestra.run.smithi074.stdout: "suspended": 0, 2019-11-28T22:45:01.334 INFO:teuthology.orchestra.run.smithi074.stdout: "max_buckets": 1000, 2019-11-28T22:45:01.334 INFO:teuthology.orchestra.run.smithi074.stdout: "subusers": [], 2019-11-28T22:45:01.334 INFO:teuthology.orchestra.run.smithi074.stdout: "keys": [ 2019-11-28T22:45:01.334 INFO:teuthology.orchestra.run.smithi074.stdout: { 2019-11-28T22:45:01.334 INFO:teuthology.orchestra.run.smithi074.stdout: "user": "bar.client.0", 2019-11-28T22:45:01.334 INFO:teuthology.orchestra.run.smithi074.stdout: "access_key": "LQSDDOYHNPOJYWCWYTWN", 2019-11-28T22:45:01.334 INFO:teuthology.orchestra.run.smithi074.stdout: "secret_key": "SeCvN+53wvnrR2d6E9yjEUHK83TJ1K+Bbb1kB7wOF2SbYGAcVLhjfA==" 2019-11-28T22:45:01.335 INFO:teuthology.orchestra.run.smithi074.stdout: } 2019-11-28T22:45:01.335 INFO:teuthology.orchestra.run.smithi074.stdout: ], 2019-11-28T22:45:01.335 INFO:teuthology.orchestra.run.smithi074.stdout: "swift_keys": [], 2019-11-28T22:45:01.335 INFO:teuthology.orchestra.run.smithi074.stdout: "caps": [], 2019-11-28T22:45:01.335 INFO:teuthology.orchestra.run.smithi074.stdout: "op_mask": "read, write, delete", 2019-11-28T22:45:01.335 INFO:teuthology.orchestra.run.smithi074.stdout: "default_placement": "", 2019-11-28T22:45:01.335 INFO:teuthology.orchestra.run.smithi074.stdout: "default_storage_class": "", 2019-11-28T22:45:01.336 INFO:teuthology.orchestra.run.smithi074.stdout: "placement_tags": [], 2019-11-28T22:45:01.336 INFO:teuthology.orchestra.run.smithi074.stdout: "bucket_quota": { 2019-11-28T22:45:01.336 INFO:teuthology.orchestra.run.smithi074.stdout: "enabled": false, 2019-11-28T22:45:01.336 INFO:teuthology.orchestra.run.smithi074.stdout: "check_on_raw": false, 2019-11-28T22:45:01.336 INFO:teuthology.orchestra.run.smithi074.stdout: "max_size": -1, 2019-11-28T22:45:01.336 INFO:teuthology.orchestra.run.smithi074.stdout: "max_size_kb": 0, 2019-11-28T22:45:01.336 INFO:teuthology.orchestra.run.smithi074.stdout: "max_objects": -1 2019-11-28T22:45:01.337 INFO:teuthology.orchestra.run.smithi074.stdout: }, 2019-11-28T22:45:01.337 INFO:teuthology.orchestra.run.smithi074.stdout: "user_quota": { 2019-11-28T22:45:01.337 INFO:teuthology.orchestra.run.smithi074.stdout: "enabled": false, 2019-11-28T22:45:01.337 INFO:teuthology.orchestra.run.smithi074.stdout: "check_on_raw": false, 2019-11-28T22:45:01.337 INFO:teuthology.orchestra.run.smithi074.stdout: "max_size": -1, 2019-11-28T22:45:01.337 INFO:teuthology.orchestra.run.smithi074.stdout: "max_size_kb": 0, 2019-11-28T22:45:01.337 INFO:teuthology.orchestra.run.smithi074.stdout: "max_objects": -1 2019-11-28T22:45:01.337 INFO:teuthology.orchestra.run.smithi074.stdout: }, 2019-11-28T22:45:01.338 INFO:teuthology.orchestra.run.smithi074.stdout: "temp_url_keys": [], 2019-11-28T22:45:01.338 INFO:teuthology.orchestra.run.smithi074.stdout: "type": "rgw", 2019-11-28T22:45:01.338 INFO:teuthology.orchestra.run.smithi074.stdout: "mfa_ids": [] 2019-11-28T22:45:01.338 INFO:teuthology.orchestra.run.smithi074.stdout:} 2019-11-28T22:45:01.338 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:45:01.386 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:01.385+0000 7f96232d0ec0 20 remove_watcher() i=0 2019-11-28T22:45:01.386 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:01.385+0000 7f96232d0ec0 2 removed watcher, disabling cache 2019-11-28T22:45:01.418 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:01.418+0000 7f96232d0ec0 20 remove_watcher() i=1 2019-11-28T22:45:01.471 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:01.470+0000 7f96232d0ec0 20 remove_watcher() i=2 2019-11-28T22:45:01.520 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:01.520+0000 7f96232d0ec0 20 remove_watcher() i=3 2019-11-28T22:45:01.578 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:01.577+0000 7f96232d0ec0 20 remove_watcher() i=4 2019-11-28T22:45:01.631 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:01.630+0000 7f96232d0ec0 20 remove_watcher() i=5 2019-11-28T22:45:01.678 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:01.677+0000 7f96232d0ec0 20 remove_watcher() i=6 2019-11-28T22:45:01.720 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:01.719+0000 7f96232d0ec0 20 remove_watcher() i=7 2019-11-28T22:45:01.728 INFO:teuthology.orchestra.run.smithi074:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 0664259257 --totp-seed LMEFNKSQKLKTNKDC4SHVXQZ7CWFV4CIJ5LIKFZHJSBDXRQUGLZSWK74BHJYZ7ZWY --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2019-11-28T22:45:01.854 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:01.853+0000 7f10983acec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:01.885 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:01.885+0000 7f10983acec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:45:01.886 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:01.885+0000 7f10983acec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:01.897 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:01.896+0000 7f10983acec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:45:01.897 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:01.896+0000 7f10983acec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:01.918 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:01.918+0000 7f10983acec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:45:01.919 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:01.918+0000 7f10983acec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:01.936 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:01.936+0000 7f10983acec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:45:02.195 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.194+0000 7f10983acec0 20 RGWRados::pool_iterate: got zonegroup_info.cb1773b4-411c-4317-a760-df89ca0f54fc 2019-11-28T22:45:02.195 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.194+0000 7f10983acec0 20 RGWRados::pool_iterate: got zone_info.bd5ae442-b074-4d35-94cc-b1d71bd6ac02 2019-11-28T22:45:02.195 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.194+0000 7f10983acec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-28T22:45:02.195 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.194+0000 7f10983acec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-28T22:45:02.195 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.194+0000 7f10983acec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:02.207 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.206+0000 7f10983acec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:45:02.207 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.206+0000 7f10983acec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:02.244 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.243+0000 7f10983acec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T22:45:02.244 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.243+0000 7f10983acec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:02.255 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.254+0000 7f10983acec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:45:02.255 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.254+0000 7f10983acec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:02.267 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.266+0000 7f10983acec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T22:45:02.267 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.266+0000 7f10983acec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:02.280 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.280+0000 7f10983acec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:45:02.281 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.280+0000 7f10983acec0 10 cannot find current period zonegroup using local zonegroup 2019-11-28T22:45:02.281 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.280+0000 7f10983acec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:02.292 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.292+0000 7f10983acec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:45:02.292 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.292+0000 7f10983acec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:02.307 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.306+0000 7f10983acec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:45:02.307 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.306+0000 7f10983acec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:02.316 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.315+0000 7f10983acec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T22:45:02.316 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.315+0000 7f10983acec0 20 zonegroup default 2019-11-28T22:45:02.316 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.315+0000 7f10983acec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:02.324 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.322+0000 7f10983acec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:45:02.324 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.322+0000 7f10983acec0 10 Cannot find current period zone using local zone 2019-11-28T22:45:02.324 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.322+0000 7f10983acec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:02.334 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.333+0000 7f10983acec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:45:02.334 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.333+0000 7f10983acec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:02.342 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.342+0000 7f10983acec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:45:02.343 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.342+0000 7f10983acec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:02.350 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.349+0000 7f10983acec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T22:45:02.350 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.349+0000 7f10983acec0 20 zone default found 2019-11-28T22:45:02.350 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.349+0000 7f10983acec0 20 started sync module instance, tier type = 2019-11-28T22:45:02.350 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.349+0000 7f10983acec0 20 started zone id=bd5ae442-b074-4d35-94cc-b1d71bd6ac02 (name=default) with tier type = 2019-11-28T22:45:02.702 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.701+0000 7f10983acec0 20 add_watcher() i=0 2019-11-28T22:45:02.702 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.701+0000 7f10983acec0 20 add_watcher() i=1 2019-11-28T22:45:02.702 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.701+0000 7f10983acec0 20 add_watcher() i=2 2019-11-28T22:45:02.702 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.701+0000 7f10983acec0 20 add_watcher() i=3 2019-11-28T22:45:02.702 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.701+0000 7f10983acec0 20 add_watcher() i=4 2019-11-28T22:45:02.702 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.701+0000 7f10983acec0 20 add_watcher() i=5 2019-11-28T22:45:02.703 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.701+0000 7f10983acec0 20 add_watcher() i=6 2019-11-28T22:45:02.738 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.737+0000 7f10983acec0 20 add_watcher() i=7 2019-11-28T22:45:02.738 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.737+0000 7f10983acec0 2 all 8 watchers are set, enabling cache 2019-11-28T22:45:02.738 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.737+0000 7f1055fdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-28T22:45:02.747 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.746+0000 7f1085dda700 0 -- 172.21.15.74:0/2614893559 >> v2:172.21.15.141:3300/0 conn(0x561895c6c1d0 msgr2=0x561895c6c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2019-11-28T22:45:02.950 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:02.949+0000 7f1085dda700 0 --2- 172.21.15.74:0/2614893559 >> v2:172.21.15.141:3300/0 conn(0x561895c6c1d0 0x561895c6c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-28T22:45:03.007 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:03.006+0000 7f10855d9700 0 -- 172.21.15.74:0/1380190931 >> [v2:172.21.15.74:3301/0,v1:172.21.15.74:6790/0] conn(0x561895c76c70 msgr2=0x561895c79090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-28T22:45:05.313 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:05.312+0000 7f0fc7fff700 20 reqs_thread_entry: start 2019-11-28T22:45:05.313 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:05.312+0000 7f0fc5ffb700 20 reqs_thread_entry: start 2019-11-28T22:45:05.313 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:05.312+0000 7f10983acec0 20 init_complete bucket index max shards: 0 2019-11-28T22:45:05.314 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:05.313+0000 7f0fb3fff700 20 reqs_thread_entry: start 2019-11-28T22:45:05.314 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:05.313+0000 7f10983acec0 20 get_system_obj_state: rctx=0x7ffefd4b5fe8 obj=default.rgw.meta:users.uid:bar.client.0 state=0x561895ceb2e0 s->prefetch_data=0 2019-11-28T22:45:05.314 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:05.313+0000 7f10983acec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2019-11-28T22:45:05.328 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:05.327+0000 7f10983acec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x16 2019-11-28T22:45:05.328 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:05.327+0000 7f10983acec0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-28T22:45:05.328 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:05.327+0000 7f10983acec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T22:45:05.328 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:05.327+0000 7f10983acec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T22:45:05.328 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:05.327+0000 7f10983acec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-28T22:45:05.328 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:05.327+0000 7f10983acec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:05.346 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:05.345+0000 7f10983acec0 20 rados_obj.operate() r=0 bl.length=432 2019-11-28T22:45:05.346 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:05.345+0000 7f10983acec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x11 2019-11-28T22:45:05.346 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:05.345+0000 7f10983acec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-28T22:45:07.398 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:07.397+0000 7f10983acec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-28T22:45:07.398 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:07.397+0000 7f10983acec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-28T22:45:07.399 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:07.397+0000 7f10983acec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=631 2019-11-28T22:45:07.414 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:07.413+0000 7f10667fc700 10 RGWWatcher::handle_notify() notify_id 588410519632 cookie 94663591971344 notifier 4589 bl.length()=631 2019-11-28T22:45:07.414 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:07.413+0000 7f10667fc700 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-28T22:45:07.414 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:07.413+0000 7f10667fc700 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-28T22:45:08.026 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:08.026+0000 7f10983acec0 20 remove_watcher() i=0 2019-11-28T22:45:08.027 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:08.026+0000 7f10983acec0 2 removed watcher, disabling cache 2019-11-28T22:45:08.190 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:08.189+0000 7f10983acec0 20 remove_watcher() i=1 2019-11-28T22:45:08.247 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:08.246+0000 7f10983acec0 20 remove_watcher() i=2 2019-11-28T22:45:08.276 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:08.276+0000 7f10983acec0 20 remove_watcher() i=3 2019-11-28T22:45:08.326 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:08.325+0000 7f10983acec0 20 remove_watcher() i=4 2019-11-28T22:45:08.375 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:08.375+0000 7f10983acec0 20 remove_watcher() i=5 2019-11-28T22:45:08.412 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:08.411+0000 7f10983acec0 20 remove_watcher() i=6 2019-11-28T22:45:08.462 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:08.461+0000 7f10983acec0 20 remove_watcher() i=7 2019-11-28T22:45:08.468 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0 2019-11-28T22:45:08.469 INFO:teuthology.orchestra.run.smithi074:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name 'Mr. foo.client.0' --access-key XGODGXWUWCDXEYUTJVUP --secret uRBGvmqxHyZ6/oBdImq4tQL+ErK7PU9RsyGpY7dDOXCre3ZmnykL9g== --email foo.client.0+test@test.test --cluster ceph 2019-11-28T22:45:08.590 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:08.589+0000 7fd8b7f02ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:08.626 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:08.625+0000 7fd8b7f02ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:45:08.626 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:08.625+0000 7fd8b7f02ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:08.638 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:08.637+0000 7fd8b7f02ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:45:08.638 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:08.637+0000 7fd8b7f02ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:08.654 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:08.653+0000 7fd8b7f02ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:45:08.654 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:08.653+0000 7fd8b7f02ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:08.678 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:08.677+0000 7fd8b7f02ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:45:08.920 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:08.920+0000 7fd8b7f02ec0 20 RGWRados::pool_iterate: got zonegroup_info.cb1773b4-411c-4317-a760-df89ca0f54fc 2019-11-28T22:45:08.921 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:08.920+0000 7fd8b7f02ec0 20 RGWRados::pool_iterate: got zone_info.bd5ae442-b074-4d35-94cc-b1d71bd6ac02 2019-11-28T22:45:08.921 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:08.920+0000 7fd8b7f02ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-28T22:45:08.921 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:08.920+0000 7fd8b7f02ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-28T22:45:08.921 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:08.920+0000 7fd8b7f02ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:08.929 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:08.928+0000 7fd8b7f02ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:45:08.929 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:08.928+0000 7fd8b7f02ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:08.940 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:08.940+0000 7fd8b7f02ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T22:45:08.941 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:08.940+0000 7fd8b7f02ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:08.953 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:08.953+0000 7fd8b7f02ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:45:08.953 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:08.953+0000 7fd8b7f02ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:08.967 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:08.966+0000 7fd8b7f02ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T22:45:08.967 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:08.966+0000 7fd8b7f02ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:08.977 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:08.976+0000 7fd8b7f02ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:45:08.977 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:08.976+0000 7fd8b7f02ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-28T22:45:08.977 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:08.976+0000 7fd8b7f02ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:08.999 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:08.999+0000 7fd8b7f02ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:45:09.000 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:08.999+0000 7fd8b7f02ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:09.013 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:09.012+0000 7fd8b7f02ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:45:09.013 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:09.013+0000 7fd8b7f02ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:09.026 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:09.025+0000 7fd8b7f02ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T22:45:09.026 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:09.025+0000 7fd8b7f02ec0 20 zonegroup default 2019-11-28T22:45:09.026 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:09.025+0000 7fd8b7f02ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:09.043 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:09.042+0000 7fd8b7f02ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:45:09.043 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:09.042+0000 7fd8b7f02ec0 10 Cannot find current period zone using local zone 2019-11-28T22:45:09.043 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:09.042+0000 7fd8b7f02ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:09.059 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:09.058+0000 7fd8b7f02ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:45:09.059 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:09.058+0000 7fd8b7f02ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:09.073 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:09.072+0000 7fd8b7f02ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:45:09.073 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:09.072+0000 7fd8b7f02ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:09.088 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:09.087+0000 7fd8b7f02ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T22:45:09.088 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:09.087+0000 7fd8b7f02ec0 20 zone default found 2019-11-28T22:45:09.088 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:09.087+0000 7fd8b7f02ec0 20 started sync module instance, tier type = 2019-11-28T22:45:09.088 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:09.087+0000 7fd8b7f02ec0 20 started zone id=bd5ae442-b074-4d35-94cc-b1d71bd6ac02 (name=default) with tier type = 2019-11-28T22:45:09.461 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:09.460+0000 7fd8b7f02ec0 20 add_watcher() i=0 2019-11-28T22:45:09.461 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:09.460+0000 7fd8b7f02ec0 20 add_watcher() i=1 2019-11-28T22:45:09.461 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:09.460+0000 7fd8b7f02ec0 20 add_watcher() i=2 2019-11-28T22:45:09.462 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:09.460+0000 7fd8b7f02ec0 20 add_watcher() i=3 2019-11-28T22:45:09.462 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:09.460+0000 7fd8b7f02ec0 20 add_watcher() i=4 2019-11-28T22:45:09.462 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:09.460+0000 7fd8b7f02ec0 20 add_watcher() i=5 2019-11-28T22:45:09.462 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:09.460+0000 7fd8b7f02ec0 20 add_watcher() i=6 2019-11-28T22:45:09.499 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:09.498+0000 7fd8b7f02ec0 20 add_watcher() i=7 2019-11-28T22:45:09.499 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:09.498+0000 7fd8b7f02ec0 2 all 8 watchers are set, enabling cache 2019-11-28T22:45:09.499 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:09.499+0000 7fd875fdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-28T22:45:09.504 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:09.504+0000 7fd8a5930700 0 -- 172.21.15.74:0/1659170082 >> [v2:172.21.15.74:3301/0,v1:172.21.15.74:6790/0] conn(0x562202df0730 msgr2=0x562202df0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-28T22:45:09.707 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:09.706+0000 7fd8a5930700 0 --2- 172.21.15.74:0/1659170082 >> [v2:172.21.15.74:3301/0,v1:172.21.15.74:6790/0] conn(0x562202df0730 0x562202df0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-28T22:45:09.760 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:09.759+0000 7fd8a5930700 0 -- 172.21.15.74:0/2355215003 >> [v2:172.21.15.74:6800/9122,v1:172.21.15.74:6801/9122] conn(0x7fd7e8017580 msgr2=0x7fd7e8019ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-28T22:45:11.063 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.062+0000 7fd7e7fff700 20 reqs_thread_entry: start 2019-11-28T22:45:11.064 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.063+0000 7fd7e5ffb700 20 reqs_thread_entry: start 2019-11-28T22:45:11.064 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.063+0000 7fd8b7f02ec0 20 init_complete bucket index max shards: 0 2019-11-28T22:45:11.064 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.063+0000 7fd7d3fff700 20 reqs_thread_entry: start 2019-11-28T22:45:11.065 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.064+0000 7fd8b7f02ec0 20 get_system_obj_state: rctx=0x7ffc122d87d8 obj=default.rgw.meta:users.uid:foo.client.0 state=0x562202e72620 s->prefetch_data=0 2019-11-28T22:45:11.065 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.064+0000 7fd8b7f02ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2019-11-28T22:45:11.076 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.075+0000 7fd8b7f02ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2019-11-28T22:45:11.076 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.075+0000 7fd8b7f02ec0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-28T22:45:11.076 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.075+0000 7fd8b7f02ec0 20 get_system_obj_state: rctx=0x7ffc122d87e8 obj=default.rgw.meta:users.email:foo.client.0+test@test.test state=0x562202e743b0 s->prefetch_data=0 2019-11-28T22:45:11.076 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.075+0000 7fd8b7f02ec0 10 cache get: name=default.rgw.meta+users.email+foo.client.0+test@test.test : miss 2019-11-28T22:45:11.083 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.082+0000 7fd8b7f02ec0 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x0 2019-11-28T22:45:11.083 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.082+0000 7fd8b7f02ec0 10 adding default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-11-28T22:45:11.083 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.082+0000 7fd8b7f02ec0 20 get_system_obj_state: rctx=0x7ffc122d87e8 obj=default.rgw.meta:users.keys:XGODGXWUWCDXEYUTJVUP state=0x562202e743b0 s->prefetch_data=0 2019-11-28T22:45:11.083 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.082+0000 7fd8b7f02ec0 10 cache get: name=default.rgw.meta+users.keys+XGODGXWUWCDXEYUTJVUP : miss 2019-11-28T22:45:11.097 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.097+0000 7fd8b7f02ec0 10 cache put: name=default.rgw.meta+users.keys+XGODGXWUWCDXEYUTJVUP info.flags=0x0 2019-11-28T22:45:11.097 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.097+0000 7fd8b7f02ec0 10 adding default.rgw.meta+users.keys+XGODGXWUWCDXEYUTJVUP to cache LRU end 2019-11-28T22:45:11.098 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.097+0000 7fd8b7f02ec0 20 get_system_obj_state: rctx=0x7ffc122d83f8 obj=default.rgw.meta:users.keys:XGODGXWUWCDXEYUTJVUP state=0x562202e743b0 s->prefetch_data=0 2019-11-28T22:45:11.098 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.097+0000 7fd8b7f02ec0 10 cache get: name=default.rgw.meta+users.keys+XGODGXWUWCDXEYUTJVUP : type miss (requested=0x6, cached=0x0) 2019-11-28T22:45:11.108 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.107+0000 7fd8b7f02ec0 10 cache put: name=default.rgw.meta+users.keys+XGODGXWUWCDXEYUTJVUP info.flags=0x0 2019-11-28T22:45:11.108 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.107+0000 7fd8b7f02ec0 10 moving default.rgw.meta+users.keys+XGODGXWUWCDXEYUTJVUP to cache LRU end 2019-11-28T22:45:11.108 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.107+0000 7fd8b7f02ec0 20 get_system_obj_state: rctx=0x7ffc122d8578 obj=default.rgw.meta:users.keys:XGODGXWUWCDXEYUTJVUP state=0x562202e743b0 s->prefetch_data=0 2019-11-28T22:45:11.108 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.107+0000 7fd8b7f02ec0 10 cache get: name=default.rgw.meta+users.keys+XGODGXWUWCDXEYUTJVUP : type miss (requested=0x6, cached=0x0) 2019-11-28T22:45:11.120 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.119+0000 7fd8b7f02ec0 10 cache put: name=default.rgw.meta+users.keys+XGODGXWUWCDXEYUTJVUP info.flags=0x0 2019-11-28T22:45:11.120 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.119+0000 7fd8b7f02ec0 10 moving default.rgw.meta+users.keys+XGODGXWUWCDXEYUTJVUP to cache LRU end 2019-11-28T22:45:11.200 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.199+0000 7fd8b7f02ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-28T22:45:11.200 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.199+0000 7fd8b7f02ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-28T22:45:11.200 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.199+0000 7fd8b7f02ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=617 2019-11-28T22:45:11.209 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.208+0000 7fd8867fc700 10 RGWWatcher::handle_notify() notify_id 592705486907 cookie 94704076980832 notifier 4923 bl.length()=617 2019-11-28T22:45:11.209 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.208+0000 7fd8867fc700 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-28T22:45:11.209 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.208+0000 7fd8867fc700 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-28T22:45:11.307 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.307+0000 7fd8b7f02ec0 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2019-11-28T22:45:11.308 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.307+0000 7fd8b7f02ec0 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-11-28T22:45:11.308 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.307+0000 7fd8b7f02ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=194 2019-11-28T22:45:11.320 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.319+0000 7fd8867fc700 10 RGWWatcher::handle_notify() notify_id 592705486876 cookie 94704076996896 notifier 4923 bl.length()=194 2019-11-28T22:45:11.320 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.319+0000 7fd8867fc700 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2019-11-28T22:45:11.320 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.319+0000 7fd8867fc700 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-11-28T22:45:11.659 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.658+0000 7fd8b7f02ec0 10 cache put: name=default.rgw.meta+users.keys+XGODGXWUWCDXEYUTJVUP info.flags=0x7 2019-11-28T22:45:11.659 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.658+0000 7fd8b7f02ec0 10 moving default.rgw.meta+users.keys+XGODGXWUWCDXEYUTJVUP to cache LRU end 2019-11-28T22:45:11.659 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.658+0000 7fd8b7f02ec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=186 2019-11-28T22:45:11.670 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.669+0000 7fd8867fc700 10 RGWWatcher::handle_notify() notify_id 592705486908 cookie 94704076998256 notifier 4923 bl.length()=186 2019-11-28T22:45:11.670 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.669+0000 7fd8867fc700 10 cache put: name=default.rgw.meta+users.keys+XGODGXWUWCDXEYUTJVUP info.flags=0x7 2019-11-28T22:45:11.670 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.669+0000 7fd8867fc700 10 moving default.rgw.meta+users.keys+XGODGXWUWCDXEYUTJVUP to cache LRU end 2019-11-28T22:45:11.933 INFO:teuthology.orchestra.run.smithi074.stdout:{ 2019-11-28T22:45:11.933 INFO:teuthology.orchestra.run.smithi074.stdout: "user_id": "foo.client.0", 2019-11-28T22:45:11.933 INFO:teuthology.orchestra.run.smithi074.stdout: "display_name": "Mr. foo.client.0", 2019-11-28T22:45:11.934 INFO:teuthology.orchestra.run.smithi074.stdout: "email": "foo.client.0+test@test.test", 2019-11-28T22:45:11.934 INFO:teuthology.orchestra.run.smithi074.stdout: "suspended": 0, 2019-11-28T22:45:11.934 INFO:teuthology.orchestra.run.smithi074.stdout: "max_buckets": 1000, 2019-11-28T22:45:11.934 INFO:teuthology.orchestra.run.smithi074.stdout: "subusers": [], 2019-11-28T22:45:11.934 INFO:teuthology.orchestra.run.smithi074.stdout: "keys": [ 2019-11-28T22:45:11.934 INFO:teuthology.orchestra.run.smithi074.stdout: { 2019-11-28T22:45:11.934 INFO:teuthology.orchestra.run.smithi074.stdout: "user": "foo.client.0", 2019-11-28T22:45:11.935 INFO:teuthology.orchestra.run.smithi074.stdout: "access_key": "XGODGXWUWCDXEYUTJVUP", 2019-11-28T22:45:11.935 INFO:teuthology.orchestra.run.smithi074.stdout: "secret_key": "uRBGvmqxHyZ6/oBdImq4tQL+ErK7PU9RsyGpY7dDOXCre3ZmnykL9g==" 2019-11-28T22:45:11.935 INFO:teuthology.orchestra.run.smithi074.stdout: } 2019-11-28T22:45:11.935 INFO:teuthology.orchestra.run.smithi074.stdout: ], 2019-11-28T22:45:11.935 INFO:teuthology.orchestra.run.smithi074.stdout: "swift_keys": [], 2019-11-28T22:45:11.935 INFO:teuthology.orchestra.run.smithi074.stdout: "caps": [], 2019-11-28T22:45:11.935 INFO:teuthology.orchestra.run.smithi074.stdout: "op_mask": "read, write, delete", 2019-11-28T22:45:11.936 INFO:teuthology.orchestra.run.smithi074.stdout: "default_placement": "", 2019-11-28T22:45:11.936 INFO:teuthology.orchestra.run.smithi074.stdout: "default_storage_class": "", 2019-11-28T22:45:11.936 INFO:teuthology.orchestra.run.smithi074.stdout: "placement_tags": [], 2019-11-28T22:45:11.936 INFO:teuthology.orchestra.run.smithi074.stdout: "bucket_quota": { 2019-11-28T22:45:11.936 INFO:teuthology.orchestra.run.smithi074.stdout: "enabled": false, 2019-11-28T22:45:11.936 INFO:teuthology.orchestra.run.smithi074.stdout: "check_on_raw": false, 2019-11-28T22:45:11.936 INFO:teuthology.orchestra.run.smithi074.stdout: "max_size": -1, 2019-11-28T22:45:11.937 INFO:teuthology.orchestra.run.smithi074.stdout: "max_size_kb": 0, 2019-11-28T22:45:11.937 INFO:teuthology.orchestra.run.smithi074.stdout: "max_objects": -1 2019-11-28T22:45:11.937 INFO:teuthology.orchestra.run.smithi074.stdout: }, 2019-11-28T22:45:11.937 INFO:teuthology.orchestra.run.smithi074.stdout: "user_quota": { 2019-11-28T22:45:11.937 INFO:teuthology.orchestra.run.smithi074.stdout: "enabled": false, 2019-11-28T22:45:11.937 INFO:teuthology.orchestra.run.smithi074.stdout: "check_on_raw": false, 2019-11-28T22:45:11.937 INFO:teuthology.orchestra.run.smithi074.stdout: "max_size": -1, 2019-11-28T22:45:11.938 INFO:teuthology.orchestra.run.smithi074.stdout: "max_size_kb": 0, 2019-11-28T22:45:11.938 INFO:teuthology.orchestra.run.smithi074.stdout: "max_objects": -1 2019-11-28T22:45:11.938 INFO:teuthology.orchestra.run.smithi074.stdout: }, 2019-11-28T22:45:11.938 INFO:teuthology.orchestra.run.smithi074.stdout: "temp_url_keys": [], 2019-11-28T22:45:11.938 INFO:teuthology.orchestra.run.smithi074.stdout: "type": "rgw", 2019-11-28T22:45:11.938 INFO:teuthology.orchestra.run.smithi074.stdout: "mfa_ids": [] 2019-11-28T22:45:11.938 INFO:teuthology.orchestra.run.smithi074.stdout:} 2019-11-28T22:45:11.938 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:45:11.978 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.978+0000 7fd8b7f02ec0 20 remove_watcher() i=0 2019-11-28T22:45:11.979 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:11.978+0000 7fd8b7f02ec0 2 removed watcher, disabling cache 2019-11-28T22:45:12.044 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.043+0000 7fd8b7f02ec0 20 remove_watcher() i=1 2019-11-28T22:45:12.101 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.100+0000 7fd8b7f02ec0 20 remove_watcher() i=2 2019-11-28T22:45:12.136 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.135+0000 7fd8b7f02ec0 20 remove_watcher() i=3 2019-11-28T22:45:12.190 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.189+0000 7fd8b7f02ec0 20 remove_watcher() i=4 2019-11-28T22:45:12.236 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.236+0000 7fd8b7f02ec0 20 remove_watcher() i=5 2019-11-28T22:45:12.276 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.275+0000 7fd8b7f02ec0 20 remove_watcher() i=6 2019-11-28T22:45:12.319 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.318+0000 7fd8b7f02ec0 20 remove_watcher() i=7 2019-11-28T22:45:12.326 INFO:teuthology.orchestra.run.smithi074:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 9136203493 --totp-seed THIOIP7YA4LRJEGQNAJDPITQUZ7MCL62N4YJOTLRTWANEVD4YASR4GBTW63XVIZP --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2019-11-28T22:45:12.445 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.445+0000 7f8d61884ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:12.482 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.481+0000 7f8d61884ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:45:12.482 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.481+0000 7f8d61884ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:12.499 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.498+0000 7f8d61884ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:45:12.499 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.498+0000 7f8d61884ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:12.508 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.506+0000 7f8d61884ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:45:12.508 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.506+0000 7f8d61884ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:12.523 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.522+0000 7f8d61884ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:45:12.767 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.766+0000 7f8d61884ec0 20 RGWRados::pool_iterate: got zonegroup_info.cb1773b4-411c-4317-a760-df89ca0f54fc 2019-11-28T22:45:12.768 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.766+0000 7f8d61884ec0 20 RGWRados::pool_iterate: got zone_info.bd5ae442-b074-4d35-94cc-b1d71bd6ac02 2019-11-28T22:45:12.768 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.766+0000 7f8d61884ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-28T22:45:12.768 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.766+0000 7f8d61884ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-28T22:45:12.768 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.766+0000 7f8d61884ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:12.778 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.777+0000 7f8d61884ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:45:12.778 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.777+0000 7f8d61884ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:12.792 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.791+0000 7f8d61884ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T22:45:12.792 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.791+0000 7f8d61884ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:12.802 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.800+0000 7f8d61884ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:45:12.802 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.800+0000 7f8d61884ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:12.812 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.810+0000 7f8d61884ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T22:45:12.812 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.810+0000 7f8d61884ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:12.820 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.819+0000 7f8d61884ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:45:12.821 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.819+0000 7f8d61884ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-28T22:45:12.821 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.819+0000 7f8d61884ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:12.829 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.827+0000 7f8d61884ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:45:12.829 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.827+0000 7f8d61884ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:12.839 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.837+0000 7f8d61884ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:45:12.839 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.837+0000 7f8d61884ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:12.854 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.852+0000 7f8d61884ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T22:45:12.854 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.852+0000 7f8d61884ec0 20 zonegroup default 2019-11-28T22:45:12.854 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.852+0000 7f8d61884ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:12.861 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.859+0000 7f8d61884ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:45:12.861 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.859+0000 7f8d61884ec0 10 Cannot find current period zone using local zone 2019-11-28T22:45:12.861 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.859+0000 7f8d61884ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:12.872 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.870+0000 7f8d61884ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:45:12.872 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.870+0000 7f8d61884ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:12.881 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.879+0000 7f8d61884ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:45:12.881 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.879+0000 7f8d61884ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:12.889 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.888+0000 7f8d61884ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T22:45:12.890 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.888+0000 7f8d61884ec0 20 zone default found 2019-11-28T22:45:12.890 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.888+0000 7f8d61884ec0 20 started sync module instance, tier type = 2019-11-28T22:45:12.890 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:12.888+0000 7f8d61884ec0 20 started zone id=bd5ae442-b074-4d35-94cc-b1d71bd6ac02 (name=default) with tier type = 2019-11-28T22:45:13.215 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:13.213+0000 7f8d61884ec0 20 add_watcher() i=0 2019-11-28T22:45:13.215 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:13.213+0000 7f8d61884ec0 20 add_watcher() i=1 2019-11-28T22:45:13.215 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:13.213+0000 7f8d61884ec0 20 add_watcher() i=2 2019-11-28T22:45:13.215 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:13.213+0000 7f8d61884ec0 20 add_watcher() i=3 2019-11-28T22:45:13.215 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:13.213+0000 7f8d61884ec0 20 add_watcher() i=4 2019-11-28T22:45:13.215 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:13.213+0000 7f8d61884ec0 20 add_watcher() i=5 2019-11-28T22:45:13.216 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:13.214+0000 7f8d61884ec0 20 add_watcher() i=6 2019-11-28T22:45:13.253 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:13.251+0000 7f8d61884ec0 20 add_watcher() i=7 2019-11-28T22:45:13.254 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:13.251+0000 7f8d61884ec0 2 all 8 watchers are set, enabling cache 2019-11-28T22:45:13.254 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:13.252+0000 7f8d1f7de700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-28T22:45:13.266 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:13.264+0000 7f8d4f2b2700 0 -- >> v1:172.21.15.74:6789/0 conn(0x561e9449cca0 legacy=0x561e944a01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-28T22:45:13.385 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:13.383+0000 7f8d4f2b2700 0 -- 172.21.15.74:0/3948549988 >> [v2:172.21.15.141:6818/9904,v1:172.21.15.141:6820/9904] conn(0x561e944b3000 msgr2=0x561e944b5420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-28T22:45:14.895 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:14.892+0000 7f8c8dffb700 20 reqs_thread_entry: start 2019-11-28T22:45:14.895 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:14.892+0000 7f8c877fe700 20 reqs_thread_entry: start 2019-11-28T22:45:14.895 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:14.892+0000 7f8d61884ec0 20 init_complete bucket index max shards: 0 2019-11-28T22:45:14.895 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:14.893+0000 7f8c85ffb700 20 reqs_thread_entry: start 2019-11-28T22:45:14.895 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:14.893+0000 7f8d61884ec0 20 get_system_obj_state: rctx=0x7ffedaf5e768 obj=default.rgw.meta:users.uid:foo.client.0 state=0x561e94519830 s->prefetch_data=0 2019-11-28T22:45:14.896 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:14.893+0000 7f8d61884ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2019-11-28T22:45:14.906 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:14.904+0000 7f8d61884ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x16 2019-11-28T22:45:14.906 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:14.904+0000 7f8d61884ec0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-28T22:45:14.906 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:14.904+0000 7f8d61884ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T22:45:14.906 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:14.904+0000 7f8d61884ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T22:45:14.906 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:14.904+0000 7f8d61884ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-28T22:45:14.906 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:14.904+0000 7f8d61884ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:14.917 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:14.916+0000 7f8d61884ec0 20 rados_obj.operate() r=0 bl.length=432 2019-11-28T22:45:14.918 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:14.916+0000 7f8d61884ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x11 2019-11-28T22:45:14.918 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:14.916+0000 7f8d61884ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-28T22:45:15.019 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:15.018+0000 7f8d61884ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-28T22:45:15.020 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:15.018+0000 7f8d61884ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-28T22:45:15.020 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:15.018+0000 7f8d61884ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=631 2019-11-28T22:45:15.027 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:15.026+0000 7f8d2ffff700 10 RGWWatcher::handle_notify() notify_id 592705486909 cookie 94689336779408 notifier 4935 bl.length()=631 2019-11-28T22:45:15.028 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:15.026+0000 7f8d2ffff700 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-28T22:45:15.028 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:15.026+0000 7f8d2ffff700 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-28T22:45:15.313 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:15.311+0000 7f8d61884ec0 20 remove_watcher() i=0 2019-11-28T22:45:15.313 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:15.311+0000 7f8d61884ec0 2 removed watcher, disabling cache 2019-11-28T22:45:15.379 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:15.377+0000 7f8d61884ec0 20 remove_watcher() i=1 2019-11-28T22:45:15.448 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:15.446+0000 7f8d61884ec0 20 remove_watcher() i=2 2019-11-28T22:45:15.497 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:15.495+0000 7f8d61884ec0 20 remove_watcher() i=3 2019-11-28T22:45:15.539 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:15.537+0000 7f8d61884ec0 20 remove_watcher() i=4 2019-11-28T22:45:15.576 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:15.574+0000 7f8d61884ec0 20 remove_watcher() i=5 2019-11-28T22:45:15.614 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:15.612+0000 7f8d61884ec0 20 remove_watcher() i=6 2019-11-28T22:45:15.647 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:15.646+0000 7f8d61884ec0 20 remove_watcher() i=7 2019-11-28T22:45:15.653 DEBUG:tasks.s3tests:Creating user testx$tenanteduser.client.0 on client.0 2019-11-28T22:45:15.654 INFO:teuthology.orchestra.run.smithi074:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name 'Mr. testx$tenanteduser.client.0' --access-key USROIVIPJVLEJSLOBVRG --secret U3FDJDtmBGv8ExON8kYdY+JKa0uLBLh/7oc6aj81lNJC1HgHdhae8g== --email 'testx$tenanteduser.client.0+test@test.test' --cluster ceph 2019-11-28T22:45:15.771 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:15.769+0000 7f21838a9ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:15.801 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:15.800+0000 7f21838a9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:45:15.802 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:15.800+0000 7f21838a9ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:15.822 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:15.821+0000 7f21838a9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:45:15.823 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:15.821+0000 7f21838a9ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:15.836 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:15.834+0000 7f21838a9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:45:15.836 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:15.834+0000 7f21838a9ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:15.854 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:15.852+0000 7f21838a9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:45:16.103 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.100+0000 7f21838a9ec0 20 RGWRados::pool_iterate: got zonegroup_info.cb1773b4-411c-4317-a760-df89ca0f54fc 2019-11-28T22:45:16.103 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.100+0000 7f21838a9ec0 20 RGWRados::pool_iterate: got zone_info.bd5ae442-b074-4d35-94cc-b1d71bd6ac02 2019-11-28T22:45:16.103 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.100+0000 7f21838a9ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-28T22:45:16.103 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.100+0000 7f21838a9ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-28T22:45:16.103 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.100+0000 7f21838a9ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:16.117 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.115+0000 7f21838a9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:45:16.117 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.115+0000 7f21838a9ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:16.131 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.130+0000 7f21838a9ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T22:45:16.132 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.130+0000 7f21838a9ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:16.145 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.143+0000 7f21838a9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:45:16.145 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.143+0000 7f21838a9ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:16.157 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.155+0000 7f21838a9ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T22:45:16.157 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.155+0000 7f21838a9ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:16.166 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.164+0000 7f21838a9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:45:16.166 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.164+0000 7f21838a9ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-28T22:45:16.166 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.164+0000 7f21838a9ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:16.175 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.173+0000 7f21838a9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:45:16.175 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.173+0000 7f21838a9ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:16.190 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.188+0000 7f21838a9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:45:16.190 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.188+0000 7f21838a9ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:16.200 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.199+0000 7f21838a9ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T22:45:16.201 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.199+0000 7f21838a9ec0 20 zonegroup default 2019-11-28T22:45:16.201 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.199+0000 7f21838a9ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:16.212 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.211+0000 7f21838a9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:45:16.212 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.211+0000 7f21838a9ec0 10 Cannot find current period zone using local zone 2019-11-28T22:45:16.213 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.211+0000 7f21838a9ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:16.221 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.219+0000 7f21838a9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:45:16.221 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.219+0000 7f21838a9ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:16.232 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.230+0000 7f21838a9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:45:16.232 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.230+0000 7f21838a9ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:16.243 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.241+0000 7f21838a9ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T22:45:16.243 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.241+0000 7f21838a9ec0 20 zone default found 2019-11-28T22:45:16.243 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.241+0000 7f21838a9ec0 20 started sync module instance, tier type = 2019-11-28T22:45:16.244 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.241+0000 7f21838a9ec0 20 started zone id=bd5ae442-b074-4d35-94cc-b1d71bd6ac02 (name=default) with tier type = 2019-11-28T22:45:16.599 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.597+0000 7f21838a9ec0 20 add_watcher() i=0 2019-11-28T22:45:16.599 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.597+0000 7f21838a9ec0 20 add_watcher() i=1 2019-11-28T22:45:16.599 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.597+0000 7f21838a9ec0 20 add_watcher() i=2 2019-11-28T22:45:16.599 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.597+0000 7f21838a9ec0 20 add_watcher() i=3 2019-11-28T22:45:16.599 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.597+0000 7f21838a9ec0 20 add_watcher() i=4 2019-11-28T22:45:16.600 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.597+0000 7f21838a9ec0 20 add_watcher() i=5 2019-11-28T22:45:16.600 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.597+0000 7f21838a9ec0 20 add_watcher() i=6 2019-11-28T22:45:16.630 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.628+0000 7f21838a9ec0 20 add_watcher() i=7 2019-11-28T22:45:16.630 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.628+0000 7f21838a9ec0 2 all 8 watchers are set, enabling cache 2019-11-28T22:45:16.630 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.628+0000 7f21417e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-28T22:45:16.630 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.628+0000 7f2170ad6700 0 -- >> v2:172.21.15.74:3300/0 conn(0x55efe1f56b20 msgr2=0x55efe1f58f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2019-11-28T22:45:16.676 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:16.673+0000 7f21712d7700 0 -- 172.21.15.74:0/3328176767 >> [v2:172.21.15.74:6800/9122,v1:172.21.15.74:6801/9122] conn(0x7f20b4017570 msgr2=0x7f20b4019a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-28T22:45:18.143 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:18.140+0000 7f20b37fe700 20 reqs_thread_entry: start 2019-11-28T22:45:18.143 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:18.140+0000 7f20b17fa700 20 reqs_thread_entry: start 2019-11-28T22:45:18.143 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:18.140+0000 7f21838a9ec0 20 init_complete bucket index max shards: 0 2019-11-28T22:45:18.143 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:18.141+0000 7f209f7fe700 20 reqs_thread_entry: start 2019-11-28T22:45:18.143 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:18.141+0000 7f21838a9ec0 20 get_system_obj_state: rctx=0x7fff5bd9b108 obj=default.rgw.meta:users.uid:testx$tenanteduser.client.0 state=0x55efe1fd54f0 s->prefetch_data=0 2019-11-28T22:45:18.144 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:18.141+0000 7f21838a9ec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2019-11-28T22:45:18.154 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:18.152+0000 7f21838a9ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2019-11-28T22:45:18.154 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:18.152+0000 7f21838a9ec0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-28T22:45:18.154 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:18.152+0000 7f21838a9ec0 20 get_system_obj_state: rctx=0x7fff5bd9b118 obj=default.rgw.meta:users.email:testx$tenanteduser.client.0+test@test.test state=0x55efe1fd72a0 s->prefetch_data=0 2019-11-28T22:45:18.154 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:18.152+0000 7f21838a9ec0 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test : miss 2019-11-28T22:45:18.166 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:18.164+0000 7f21838a9ec0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x0 2019-11-28T22:45:18.166 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:18.164+0000 7f21838a9ec0 10 adding default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2019-11-28T22:45:18.166 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:18.164+0000 7f21838a9ec0 20 get_system_obj_state: rctx=0x7fff5bd9b118 obj=default.rgw.meta:users.keys:USROIVIPJVLEJSLOBVRG state=0x55efe1fd72a0 s->prefetch_data=0 2019-11-28T22:45:18.166 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:18.164+0000 7f21838a9ec0 10 cache get: name=default.rgw.meta+users.keys+USROIVIPJVLEJSLOBVRG : miss 2019-11-28T22:45:18.176 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:18.174+0000 7f21838a9ec0 10 cache put: name=default.rgw.meta+users.keys+USROIVIPJVLEJSLOBVRG info.flags=0x0 2019-11-28T22:45:18.176 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:18.174+0000 7f21838a9ec0 10 adding default.rgw.meta+users.keys+USROIVIPJVLEJSLOBVRG to cache LRU end 2019-11-28T22:45:18.176 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:18.174+0000 7f21838a9ec0 20 get_system_obj_state: rctx=0x7fff5bd9ad28 obj=default.rgw.meta:users.keys:USROIVIPJVLEJSLOBVRG state=0x55efe1fd72a0 s->prefetch_data=0 2019-11-28T22:45:18.176 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:18.174+0000 7f21838a9ec0 10 cache get: name=default.rgw.meta+users.keys+USROIVIPJVLEJSLOBVRG : type miss (requested=0x6, cached=0x0) 2019-11-28T22:45:18.188 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:18.186+0000 7f21838a9ec0 10 cache put: name=default.rgw.meta+users.keys+USROIVIPJVLEJSLOBVRG info.flags=0x0 2019-11-28T22:45:18.188 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:18.186+0000 7f21838a9ec0 10 moving default.rgw.meta+users.keys+USROIVIPJVLEJSLOBVRG to cache LRU end 2019-11-28T22:45:18.189 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:18.186+0000 7f21838a9ec0 20 get_system_obj_state: rctx=0x7fff5bd9aea8 obj=default.rgw.meta:users.keys:USROIVIPJVLEJSLOBVRG state=0x55efe1fd72a0 s->prefetch_data=0 2019-11-28T22:45:18.189 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:18.186+0000 7f21838a9ec0 10 cache get: name=default.rgw.meta+users.keys+USROIVIPJVLEJSLOBVRG : type miss (requested=0x6, cached=0x0) 2019-11-28T22:45:18.196 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:18.194+0000 7f21838a9ec0 10 cache put: name=default.rgw.meta+users.keys+USROIVIPJVLEJSLOBVRG info.flags=0x0 2019-11-28T22:45:18.197 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:18.194+0000 7f21838a9ec0 10 moving default.rgw.meta+users.keys+USROIVIPJVLEJSLOBVRG to cache LRU end 2019-11-28T22:45:18.292 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:18.290+0000 7f21838a9ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-11-28T22:45:18.292 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:18.290+0000 7f21838a9ec0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-28T22:45:18.292 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:18.290+0000 7f21838a9ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=691 2019-11-28T22:45:18.316 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:18.314+0000 7f21567fc700 10 RGWWatcher::handle_notify() notify_id 592705486929 cookie 94488776433200 notifier 4619 bl.length()=691 2019-11-28T22:45:18.316 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:18.314+0000 7f21567fc700 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-11-28T22:45:18.317 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:18.314+0000 7f21567fc700 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-28T22:45:18.901 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:18.899+0000 7f21838a9ec0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x7 2019-11-28T22:45:18.901 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:18.899+0000 7f21838a9ec0 10 moving default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2019-11-28T22:45:18.901 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:18.899+0000 7f21838a9ec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=224 2019-11-28T22:45:18.918 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:18.916+0000 7f21567fc700 10 RGWWatcher::handle_notify() notify_id 592705486910 cookie 94488776437616 notifier 4619 bl.length()=224 2019-11-28T22:45:18.945 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:18.916+0000 7f21567fc700 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x7 2019-11-28T22:45:18.945 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:18.916+0000 7f21567fc700 10 moving default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2019-11-28T22:45:19.347 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:19.345+0000 7f21838a9ec0 10 cache put: name=default.rgw.meta+users.keys+USROIVIPJVLEJSLOBVRG info.flags=0x7 2019-11-28T22:45:19.347 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:19.345+0000 7f21838a9ec0 10 moving default.rgw.meta+users.keys+USROIVIPJVLEJSLOBVRG to cache LRU end 2019-11-28T22:45:19.348 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:19.345+0000 7f21838a9ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=201 2019-11-28T22:45:19.362 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:19.361+0000 7f21567fc700 10 RGWWatcher::handle_notify() notify_id 592705486908 cookie 94488776426736 notifier 4619 bl.length()=201 2019-11-28T22:45:19.363 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:19.361+0000 7f21567fc700 10 cache put: name=default.rgw.meta+users.keys+USROIVIPJVLEJSLOBVRG info.flags=0x7 2019-11-28T22:45:19.363 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:19.361+0000 7f21567fc700 10 moving default.rgw.meta+users.keys+USROIVIPJVLEJSLOBVRG to cache LRU end 2019-11-28T22:45:19.621 INFO:teuthology.orchestra.run.smithi074.stdout:{ 2019-11-28T22:45:19.622 INFO:teuthology.orchestra.run.smithi074.stdout: "user_id": "testx$tenanteduser.client.0", 2019-11-28T22:45:19.622 INFO:teuthology.orchestra.run.smithi074.stdout: "display_name": "Mr. testx$tenanteduser.client.0", 2019-11-28T22:45:19.622 INFO:teuthology.orchestra.run.smithi074.stdout: "email": "testx$tenanteduser.client.0+test@test.test", 2019-11-28T22:45:19.622 INFO:teuthology.orchestra.run.smithi074.stdout: "suspended": 0, 2019-11-28T22:45:19.622 INFO:teuthology.orchestra.run.smithi074.stdout: "max_buckets": 1000, 2019-11-28T22:45:19.623 INFO:teuthology.orchestra.run.smithi074.stdout: "subusers": [], 2019-11-28T22:45:19.623 INFO:teuthology.orchestra.run.smithi074.stdout: "keys": [ 2019-11-28T22:45:19.623 INFO:teuthology.orchestra.run.smithi074.stdout: { 2019-11-28T22:45:19.623 INFO:teuthology.orchestra.run.smithi074.stdout: "user": "testx$tenanteduser.client.0", 2019-11-28T22:45:19.623 INFO:teuthology.orchestra.run.smithi074.stdout: "access_key": "USROIVIPJVLEJSLOBVRG", 2019-11-28T22:45:19.623 INFO:teuthology.orchestra.run.smithi074.stdout: "secret_key": "U3FDJDtmBGv8ExON8kYdY+JKa0uLBLh/7oc6aj81lNJC1HgHdhae8g==" 2019-11-28T22:45:19.624 INFO:teuthology.orchestra.run.smithi074.stdout: } 2019-11-28T22:45:19.624 INFO:teuthology.orchestra.run.smithi074.stdout: ], 2019-11-28T22:45:19.624 INFO:teuthology.orchestra.run.smithi074.stdout: "swift_keys": [], 2019-11-28T22:45:19.624 INFO:teuthology.orchestra.run.smithi074.stdout: "caps": [], 2019-11-28T22:45:19.624 INFO:teuthology.orchestra.run.smithi074.stdout: "op_mask": "read, write, delete", 2019-11-28T22:45:19.625 INFO:teuthology.orchestra.run.smithi074.stdout: "default_placement": "", 2019-11-28T22:45:19.625 INFO:teuthology.orchestra.run.smithi074.stdout: "default_storage_class": "", 2019-11-28T22:45:19.625 INFO:teuthology.orchestra.run.smithi074.stdout: "placement_tags": [], 2019-11-28T22:45:19.625 INFO:teuthology.orchestra.run.smithi074.stdout: "bucket_quota": { 2019-11-28T22:45:19.625 INFO:teuthology.orchestra.run.smithi074.stdout: "enabled": false, 2019-11-28T22:45:19.625 INFO:teuthology.orchestra.run.smithi074.stdout: "check_on_raw": false, 2019-11-28T22:45:19.625 INFO:teuthology.orchestra.run.smithi074.stdout: "max_size": -1, 2019-11-28T22:45:19.625 INFO:teuthology.orchestra.run.smithi074.stdout: "max_size_kb": 0, 2019-11-28T22:45:19.626 INFO:teuthology.orchestra.run.smithi074.stdout: "max_objects": -1 2019-11-28T22:45:19.626 INFO:teuthology.orchestra.run.smithi074.stdout: }, 2019-11-28T22:45:19.626 INFO:teuthology.orchestra.run.smithi074.stdout: "user_quota": { 2019-11-28T22:45:19.626 INFO:teuthology.orchestra.run.smithi074.stdout: "enabled": false, 2019-11-28T22:45:19.626 INFO:teuthology.orchestra.run.smithi074.stdout: "check_on_raw": false, 2019-11-28T22:45:19.626 INFO:teuthology.orchestra.run.smithi074.stdout: "max_size": -1, 2019-11-28T22:45:19.627 INFO:teuthology.orchestra.run.smithi074.stdout: "max_size_kb": 0, 2019-11-28T22:45:19.627 INFO:teuthology.orchestra.run.smithi074.stdout: "max_objects": -1 2019-11-28T22:45:19.627 INFO:teuthology.orchestra.run.smithi074.stdout: }, 2019-11-28T22:45:19.627 INFO:teuthology.orchestra.run.smithi074.stdout: "temp_url_keys": [], 2019-11-28T22:45:19.627 INFO:teuthology.orchestra.run.smithi074.stdout: "type": "rgw", 2019-11-28T22:45:19.627 INFO:teuthology.orchestra.run.smithi074.stdout: "mfa_ids": [] 2019-11-28T22:45:19.627 INFO:teuthology.orchestra.run.smithi074.stdout:} 2019-11-28T22:45:19.628 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:45:19.670 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:19.669+0000 7f21838a9ec0 20 remove_watcher() i=0 2019-11-28T22:45:19.671 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:19.669+0000 7f21838a9ec0 2 removed watcher, disabling cache 2019-11-28T22:45:19.737 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:19.735+0000 7f21838a9ec0 20 remove_watcher() i=1 2019-11-28T22:45:19.795 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:19.793+0000 7f21838a9ec0 20 remove_watcher() i=2 2019-11-28T22:45:19.835 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:19.834+0000 7f21838a9ec0 20 remove_watcher() i=3 2019-11-28T22:45:19.891 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:19.889+0000 7f21838a9ec0 20 remove_watcher() i=4 2019-11-28T22:45:19.945 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:19.944+0000 7f21838a9ec0 20 remove_watcher() i=5 2019-11-28T22:45:19.990 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:19.988+0000 7f21838a9ec0 20 remove_watcher() i=6 2019-11-28T22:45:20.026 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.024+0000 7f21838a9ec0 20 remove_watcher() i=7 2019-11-28T22:45:20.034 INFO:teuthology.orchestra.run.smithi074:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 5662197479 --totp-seed I7JH5EZ6DTY5X3U4XDE2IBR5VMIBD7SGU7KPYP7S7HGL27QXGY2FAR6CFYK22JBX --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2019-11-28T22:45:20.169 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.167+0000 7f10b8915ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:20.207 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.205+0000 7f10b8915ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:45:20.207 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.205+0000 7f10b8915ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:20.216 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.214+0000 7f10b8915ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:45:20.216 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.214+0000 7f10b8915ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:20.232 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.230+0000 7f10b8915ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:45:20.232 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.230+0000 7f10b8915ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:20.249 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.248+0000 7f10b8915ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:45:20.486 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.484+0000 7f10b8915ec0 20 RGWRados::pool_iterate: got zonegroup_info.cb1773b4-411c-4317-a760-df89ca0f54fc 2019-11-28T22:45:20.487 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.484+0000 7f10b8915ec0 20 RGWRados::pool_iterate: got zone_info.bd5ae442-b074-4d35-94cc-b1d71bd6ac02 2019-11-28T22:45:20.487 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.484+0000 7f10b8915ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-28T22:45:20.487 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.484+0000 7f10b8915ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-28T22:45:20.487 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.484+0000 7f10b8915ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:20.496 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.495+0000 7f10b8915ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:45:20.496 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.495+0000 7f10b8915ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:20.508 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.506+0000 7f10b8915ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T22:45:20.508 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.506+0000 7f10b8915ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:20.522 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.520+0000 7f10b8915ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:45:20.522 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.520+0000 7f10b8915ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:20.532 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.530+0000 7f10b8915ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T22:45:20.532 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.530+0000 7f10b8915ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:20.542 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.541+0000 7f10b8915ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:45:20.543 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.541+0000 7f10b8915ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-28T22:45:20.543 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.541+0000 7f10b8915ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:20.553 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.552+0000 7f10b8915ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:45:20.554 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.552+0000 7f10b8915ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:20.567 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.565+0000 7f10b8915ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:45:20.567 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.565+0000 7f10b8915ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:20.575 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.573+0000 7f10b8915ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-28T22:45:20.575 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.573+0000 7f10b8915ec0 20 zonegroup default 2019-11-28T22:45:20.576 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.573+0000 7f10b8915ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:20.589 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.587+0000 7f10b8915ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:45:20.589 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.587+0000 7f10b8915ec0 10 Cannot find current period zone using local zone 2019-11-28T22:45:20.589 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.587+0000 7f10b8915ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:20.597 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.595+0000 7f10b8915ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-28T22:45:20.597 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.595+0000 7f10b8915ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:20.615 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.614+0000 7f10b8915ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-28T22:45:20.616 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.614+0000 7f10b8915ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:20.625 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.623+0000 7f10b8915ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-28T22:45:20.626 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.623+0000 7f10b8915ec0 20 zone default found 2019-11-28T22:45:20.626 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.623+0000 7f10b8915ec0 20 started sync module instance, tier type = 2019-11-28T22:45:20.626 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:20.623+0000 7f10b8915ec0 20 started zone id=bd5ae442-b074-4d35-94cc-b1d71bd6ac02 (name=default) with tier type = 2019-11-28T22:45:21.045 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:21.043+0000 7f10b8915ec0 20 add_watcher() i=0 2019-11-28T22:45:21.045 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:21.043+0000 7f10b8915ec0 20 add_watcher() i=1 2019-11-28T22:45:21.045 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:21.043+0000 7f10b8915ec0 20 add_watcher() i=2 2019-11-28T22:45:21.045 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:21.043+0000 7f10b8915ec0 20 add_watcher() i=3 2019-11-28T22:45:21.046 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:21.043+0000 7f10b8915ec0 20 add_watcher() i=4 2019-11-28T22:45:21.046 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:21.043+0000 7f10b8915ec0 20 add_watcher() i=5 2019-11-28T22:45:21.046 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:21.043+0000 7f10b8915ec0 20 add_watcher() i=6 2019-11-28T22:45:21.082 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:21.080+0000 7f10b8915ec0 20 add_watcher() i=7 2019-11-28T22:45:21.082 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:21.080+0000 7f10b8915ec0 2 all 8 watchers are set, enabling cache 2019-11-28T22:45:21.082 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:21.080+0000 7f10767dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-28T22:45:21.089 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:21.085+0000 7f10a6343700 0 -- 172.21.15.74:0/3329846085 >> v1:172.21.15.74:6789/0 conn(0x55e2603856c0 legacy=0x55e260388cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-28T22:45:21.127 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:21.126+0000 7f10a5341700 0 -- 172.21.15.74:0/3494079897 >> [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] conn(0x55e26039dd00 msgr2=0x55e2603a0120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-28T22:45:22.988 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:22.986+0000 7f0fecff9700 20 reqs_thread_entry: start 2019-11-28T22:45:22.988 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:22.986+0000 7f0fe67fc700 20 reqs_thread_entry: start 2019-11-28T22:45:22.989 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:22.986+0000 7f10b8915ec0 20 init_complete bucket index max shards: 0 2019-11-28T22:45:22.989 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:22.987+0000 7f0fe4ff9700 20 reqs_thread_entry: start 2019-11-28T22:45:22.989 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:22.987+0000 7f10b8915ec0 20 get_system_obj_state: rctx=0x7ffcf30ce088 obj=default.rgw.meta:users.uid:testx$tenanteduser.client.0 state=0x55e2604074f0 s->prefetch_data=0 2019-11-28T22:45:22.989 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:22.987+0000 7f10b8915ec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2019-11-28T22:45:23.009 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:23.007+0000 7f10b8915ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x16 2019-11-28T22:45:23.009 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:23.007+0000 7f10b8915ec0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-28T22:45:23.010 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:23.007+0000 7f10b8915ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-28T22:45:23.010 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:23.007+0000 7f10b8915ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-28T22:45:23.010 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:23.007+0000 7f10b8915ec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-28T22:45:23.010 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:23.008+0000 7f10b8915ec0 20 rados->read ofs=0 len=0 2019-11-28T22:45:23.025 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:23.023+0000 7f10b8915ec0 20 rados_obj.operate() r=0 bl.length=491 2019-11-28T22:45:23.025 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:23.023+0000 7f10b8915ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x11 2019-11-28T22:45:23.025 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:23.023+0000 7f10b8915ec0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-28T22:45:23.184 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:23.182+0000 7f10b8915ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-11-28T22:45:23.185 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:23.182+0000 7f10b8915ec0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-28T22:45:23.185 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:23.182+0000 7f10b8915ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=705 2019-11-28T22:45:23.199 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:23.197+0000 7f1086ffd700 10 RGWWatcher::handle_notify() notify_id 592705486930 cookie 94430765221536 notifier 4942 bl.length()=705 2019-11-28T22:45:23.199 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:23.198+0000 7f1086ffd700 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-11-28T22:45:23.200 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:23.198+0000 7f1086ffd700 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-28T22:45:23.421 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:23.420+0000 7f10b8915ec0 20 remove_watcher() i=0 2019-11-28T22:45:23.422 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:23.420+0000 7f10b8915ec0 2 removed watcher, disabling cache 2019-11-28T22:45:23.463 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:23.462+0000 7f10b8915ec0 20 remove_watcher() i=1 2019-11-28T22:45:23.507 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:23.505+0000 7f10b8915ec0 20 remove_watcher() i=2 2019-11-28T22:45:23.543 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:23.541+0000 7f10b8915ec0 20 remove_watcher() i=3 2019-11-28T22:45:23.586 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:23.584+0000 7f10b8915ec0 20 remove_watcher() i=4 2019-11-28T22:45:23.629 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:23.627+0000 7f10b8915ec0 20 remove_watcher() i=5 2019-11-28T22:45:23.673 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:23.671+0000 7f10b8915ec0 20 remove_watcher() i=6 2019-11-28T22:45:23.723 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-28T22:45:23.721+0000 7f10b8915ec0 20 remove_watcher() i=7 2019-11-28T22:45:23.730 INFO:tasks.s3tests:Configuring s3-tests... 2019-11-28T22:45:23.730 INFO:teuthology.orchestra.run.smithi074:> cd /home/ubuntu/cephtest/s3-tests && ./bootstrap 2019-11-28T22:45:29.258 INFO:teuthology.orchestra.run.smithi074.stderr:./bootstrap: missing required RPM packages. Installing via sudo. 2019-11-28T22:45:29.409 INFO:teuthology.orchestra.run.smithi074.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-28T22:45:29.450 INFO:teuthology.orchestra.run.smithi074.stdout:Loading mirror speeds from cached hostfile 2019-11-28T22:45:29.452 INFO:teuthology.orchestra.run.smithi074.stdout: * base: mirror.cogentco.com 2019-11-28T22:45:29.452 INFO:teuthology.orchestra.run.smithi074.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-28T22:45:29.452 INFO:teuthology.orchestra.run.smithi074.stdout: * extras: mirror.linux.duke.edu 2019-11-28T22:45:29.453 INFO:teuthology.orchestra.run.smithi074.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-11-28T22:45:30.417 INFO:teuthology.orchestra.run.smithi074.stdout:7 packages excluded due to repository priority protections 2019-11-28T22:45:30.760 INFO:teuthology.orchestra.run.smithi074.stdout:Resolving Dependencies 2019-11-28T22:45:30.761 INFO:teuthology.orchestra.run.smithi074.stdout:--> Running transaction check 2019-11-28T22:45:30.761 INFO:teuthology.orchestra.run.smithi074.stdout:---> Package libffi-devel.x86_64 0:3.0.13-18.el7 will be installed 2019-11-28T22:45:31.150 INFO:teuthology.orchestra.run.smithi074.stdout:--> Finished Dependency Resolution 2019-11-28T22:45:31.386 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:45:31.386 INFO:teuthology.orchestra.run.smithi074.stdout:Dependencies Resolved 2019-11-28T22:45:31.387 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:45:31.387 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T22:45:31.387 INFO:teuthology.orchestra.run.smithi074.stdout: Package Arch Version Repository Size 2019-11-28T22:45:31.387 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T22:45:31.387 INFO:teuthology.orchestra.run.smithi074.stdout:Installing: 2019-11-28T22:45:31.387 INFO:teuthology.orchestra.run.smithi074.stdout: libffi-devel x86_64 3.0.13-18.el7 base 23 k 2019-11-28T22:45:31.387 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:45:31.388 INFO:teuthology.orchestra.run.smithi074.stdout:Transaction Summary 2019-11-28T22:45:31.388 INFO:teuthology.orchestra.run.smithi074.stdout:================================================================================ 2019-11-28T22:45:31.388 INFO:teuthology.orchestra.run.smithi074.stdout:Install 1 Package 2019-11-28T22:45:31.388 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:45:31.388 INFO:teuthology.orchestra.run.smithi074.stdout:Total download size: 23 k 2019-11-28T22:45:31.388 INFO:teuthology.orchestra.run.smithi074.stdout:Installed size: 27 k 2019-11-28T22:45:31.388 INFO:teuthology.orchestra.run.smithi074.stdout:Downloading packages: 2019-11-28T22:45:31.490 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction check 2019-11-28T22:45:31.493 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction test 2019-11-28T22:45:31.495 INFO:teuthology.orchestra.run.smithi074.stdout:Transaction test succeeded 2019-11-28T22:45:31.495 INFO:teuthology.orchestra.run.smithi074.stdout:Running transaction 2019-11-28T22:45:32.041 INFO:teuthology.orchestra.run.smithi074.stdout: Installing : libffi-devel-3.0.13-18.el7.x86_64 1/1 2019-11-28T22:45:32.417 INFO:teuthology.orchestra.run.smithi074.stdout: Verifying : libffi-devel-3.0.13-18.el7.x86_64 1/1 2019-11-28T22:45:32.417 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:45:32.417 INFO:teuthology.orchestra.run.smithi074.stdout:Installed: 2019-11-28T22:45:32.417 INFO:teuthology.orchestra.run.smithi074.stdout: libffi-devel.x86_64 0:3.0.13-18.el7 2019-11-28T22:45:32.417 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:45:32.418 INFO:teuthology.orchestra.run.smithi074.stdout:Complete! 2019-11-28T22:45:32.628 INFO:teuthology.orchestra.run.smithi074.stdout:New python executable in /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python 2019-11-28T22:45:33.854 INFO:teuthology.orchestra.run.smithi074.stdout:Installing setuptools, pip, wheel...done. 2019-11-28T22:45:34.109 INFO:teuthology.orchestra.run.smithi074.stderr:Cache entry deserialization failed, entry ignored 2019-11-28T22:45:34.227 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting pip 2019-11-28T22:45:34.303 INFO:teuthology.orchestra.run.smithi074.stdout: Using cached https://files.pythonhosted.org/packages/00/b6/9cfa56b4081ad13874b0c6f96af8ce16cfbc1cb06bedf8e9164ce5551ec1/pip-19.3.1-py2.py3-none-any.whl 2019-11-28T22:45:34.366 INFO:teuthology.orchestra.run.smithi074.stdout:Installing collected packages: pip 2019-11-28T22:45:34.367 INFO:teuthology.orchestra.run.smithi074.stdout: Found existing installation: pip 9.0.1 2019-11-28T22:45:34.425 INFO:teuthology.orchestra.run.smithi074.stdout: Uninstalling pip-9.0.1: 2019-11-28T22:45:34.466 INFO:teuthology.orchestra.run.smithi074.stdout: Successfully uninstalled pip-9.0.1 2019-11-28T22:45:35.034 INFO:teuthology.orchestra.run.smithi074.stdout:Successfully installed pip-19.3.1 2019-11-28T22:45:35.342 INFO:teuthology.orchestra.run.smithi074.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-28T22:45:35.835 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting setuptools==32.3.1 2019-11-28T22:45:35.838 INFO:teuthology.orchestra.run.smithi074.stdout: Using cached https://files.pythonhosted.org/packages/69/19/b1dff551058ce79d88b1e3688f1c735590d7ddf44d10681512133b35019f/setuptools-32.3.1-py2.py3-none-any.whl 2019-11-28T22:45:35.876 INFO:teuthology.orchestra.run.smithi074.stdout:Installing collected packages: setuptools 2019-11-28T22:45:35.877 INFO:teuthology.orchestra.run.smithi074.stdout: Found existing installation: setuptools 28.8.0 2019-11-28T22:45:35.891 INFO:teuthology.orchestra.run.smithi074.stdout: Uninstalling setuptools-28.8.0: 2019-11-28T22:45:35.900 INFO:teuthology.orchestra.run.smithi074.stdout: Successfully uninstalled setuptools-28.8.0 2019-11-28T22:45:36.022 INFO:teuthology.orchestra.run.smithi074.stdout:Successfully installed setuptools-32.3.1 2019-11-28T22:45:36.480 INFO:teuthology.orchestra.run.smithi074.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-28T22:45:36.688 INFO:teuthology.orchestra.run.smithi074.stdout:Processing /home/ubuntu/.cache/pip/wheels/d9/45/dd/65f0b38450c47cf7e5312883deb97d065e030c5cca0a365030/PyYAML-5.1.2-cp27-cp27mu-linux_x86_64.whl 2019-11-28T22:45:36.752 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting nose>=1.0.0 2019-11-28T22:45:36.755 INFO:teuthology.orchestra.run.smithi074.stdout: Using cached https://files.pythonhosted.org/packages/99/4f/13fb671119e65c4dce97c60e67d3fd9e6f7f809f2b307e2611f4701205cb/nose-1.3.7-py2-none-any.whl 2019-11-28T22:45:36.856 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting boto>=2.6.0 2019-11-28T22:45:36.864 INFO:teuthology.orchestra.run.smithi074.stdout: Using cached https://files.pythonhosted.org/packages/23/10/c0b78c27298029e4454a472a1919bde20cb182dab1662cec7f2ca1dcc523/boto-2.49.0-py2.py3-none-any.whl 2019-11-28T22:45:37.245 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:59:19.463 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:45:37.258 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:59:19.476 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:45:37.283 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:59:19.502 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:45:37.305 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:59:19.525 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:45:37.336 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:59:19.563 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:45:37.347 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:59:19.574 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:45:37.380 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:00:59:19.599 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:45:37.391 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:00:59:19.609 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:45:37.446 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:00:59:19.673 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:45:37.587 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting boto3>=1.0.0 2019-11-28T22:45:37.626 INFO:teuthology.orchestra.run.smithi074.stdout: Downloading https://files.pythonhosted.org/packages/67/17/567f679dac6ec93611ce05637094e9736afa40e41c9ed0aaefd90de6f7e8/boto3-1.10.28-py2.py3-none-any.whl (128kB) 2019-11-28T22:45:37.752 INFO:teuthology.orchestra.run.smithi074.stdout:Processing /home/ubuntu/.cache/pip/wheels/56/0f/19/fbbf81e5764e6d8b74501c4357a88c14c94466ec777c03734c/bunch-1.0.1-cp27-none-any.whl 2019-11-28T22:45:38.000 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting gevent>=1.0 2019-11-28T22:45:38.017 INFO:teuthology.orchestra.run.smithi074.stdout: Using cached https://files.pythonhosted.org/packages/e6/e9/3a693414f706e12abe60554cd73c5ae8f848b182ae58018f93d86c9eb418/gevent-1.4.0-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-28T22:45:38.367 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting isodate>=0.4.4 2019-11-28T22:45:38.378 INFO:teuthology.orchestra.run.smithi074.stdout: Downloading https://files.pythonhosted.org/packages/9b/9f/b36f7774ff5ea8e428fdcfc4bb332c39ee5b9362ddd3d40d9516a55221b2/isodate-0.6.0-py2.py3-none-any.whl (45kB) 2019-11-28T22:45:38.548 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting requests>=0.14.0 2019-11-28T22:45:38.558 INFO:teuthology.orchestra.run.smithi074.stdout: Downloading https://files.pythonhosted.org/packages/51/bd/23c926cd341ea6b7dd0b2a00aba99ae0f828be89d72b2190f27c11d4b7fb/requests-2.22.0-py2.py3-none-any.whl (57kB) 2019-11-28T22:45:38.905 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting pytz>=2011k 2019-11-28T22:45:38.915 INFO:teuthology.orchestra.run.smithi074.stdout: Downloading https://files.pythonhosted.org/packages/e7/f9/f0b53f88060247251bf481fa6ea62cd0d25bf1b11a87888e53ce5b7c8ad2/pytz-2019.3-py2.py3-none-any.whl (509kB) 2019-11-28T22:45:39.139 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting ordereddict 2019-11-28T22:45:39.149 INFO:teuthology.orchestra.run.smithi074.stdout: Downloading https://files.pythonhosted.org/packages/53/25/ef88e8e45db141faa9598fbf7ad0062df8f50f881a36ed6a0073e1572126/ordereddict-1.1.tar.gz 2019-11-28T22:45:39.471 INFO:teuthology.orchestra.run.smithi074.stdout:Processing /home/ubuntu/.cache/pip/wheels/51/ab/65/f318b4271019823cf7d7c178ac76a8ea4d6e6271fe9f5ba488/httplib2-0.14.0-cp27-none-any.whl 2019-11-28T22:45:39.854 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting lxml 2019-11-28T22:45:39.868 INFO:teuthology.orchestra.run.smithi074.stdout: Using cached https://files.pythonhosted.org/packages/25/73/730ad7249847f741c7e622f52b971daa5540f6fb87589bc92c717f5aafba/lxml-4.4.2-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-28T22:45:40.584 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting botocore<1.14.0,>=1.13.28 2019-11-28T22:45:40.594 INFO:teuthology.orchestra.run.smithi074.stdout: Downloading https://files.pythonhosted.org/packages/8e/b3/ab9044d3aa14208f5b6f69665d5f82ad9b028809666e4e70dac1ab0bfd3a/botocore-1.13.28-py2.py3-none-any.whl (5.7MB) 2019-11-28T22:45:41.188 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting jmespath<1.0.0,>=0.7.1 2019-11-28T22:45:41.200 INFO:teuthology.orchestra.run.smithi074.stdout: Downloading https://files.pythonhosted.org/packages/83/94/7179c3832a6d45b266ddb2aac329e101367fbdb11f425f13771d27f225bb/jmespath-0.9.4-py2.py3-none-any.whl 2019-11-28T22:45:41.295 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting s3transfer<0.3.0,>=0.2.0 2019-11-28T22:45:41.305 INFO:teuthology.orchestra.run.smithi074.stdout: Downloading https://files.pythonhosted.org/packages/16/8a/1fc3dba0c4923c2a76e1ff0d52b305c44606da63f718d14d3231e21c51b0/s3transfer-0.2.1-py2.py3-none-any.whl (70kB) 2019-11-28T22:45:41.519 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting greenlet>=0.4.14; platform_python_implementation == "CPython" 2019-11-28T22:45:41.521 INFO:teuthology.orchestra.run.smithi074.stdout: Using cached https://files.pythonhosted.org/packages/8b/6e/f2d25875713ad0885c8d3c69269697406652e6f64e1a6bd8264f7a609327/greenlet-0.4.15-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-28T22:45:41.593 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting six 2019-11-28T22:45:41.603 INFO:teuthology.orchestra.run.smithi074.stdout: Downloading https://files.pythonhosted.org/packages/65/26/32b8464df2a97e6dd1b656ed26b2c194606c16fe163c695a992b36c11cdf/six-1.13.0-py2.py3-none-any.whl 2019-11-28T22:45:41.683 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting chardet<3.1.0,>=3.0.2 2019-11-28T22:45:41.694 INFO:teuthology.orchestra.run.smithi074.stdout: Downloading https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl (133kB) 2019-11-28T22:45:41.775 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting idna<2.9,>=2.5 2019-11-28T22:45:41.784 INFO:teuthology.orchestra.run.smithi074.stdout: Downloading https://files.pythonhosted.org/packages/14/2c/cd551d81dbe15200be1cf41cd03869a46fe7226e7450af7a6545bfc474c9/idna-2.8-py2.py3-none-any.whl (58kB) 2019-11-28T22:45:41.902 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 2019-11-28T22:45:41.912 INFO:teuthology.orchestra.run.smithi074.stdout: Downloading https://files.pythonhosted.org/packages/b4/40/a9837291310ee1ccc242ceb6ebfd9eb21539649f193a7c8c86ba15b98539/urllib3-1.25.7-py2.py3-none-any.whl (125kB) 2019-11-28T22:45:42.012 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting certifi>=2017.4.17 2019-11-28T22:45:42.022 INFO:teuthology.orchestra.run.smithi074.stdout: Downloading https://files.pythonhosted.org/packages/b9/63/df50cac98ea0d5b006c55a399c3bf1db9da7b5a24de7890bc9cfd5dd9e99/certifi-2019.11.28-py2.py3-none-any.whl (156kB) 2019-11-28T22:45:42.132 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting docutils<0.16,>=0.10 2019-11-28T22:45:42.141 INFO:teuthology.orchestra.run.smithi074.stdout: Downloading https://files.pythonhosted.org/packages/3a/dc/bf2b15d1fa15a6f7a9e77a61b74ecbbae7258558fcda8ffc9a6638a6b327/docutils-0.15.2-py2-none-any.whl (548kB) 2019-11-28T22:45:42.353 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting python-dateutil<2.8.1,>=2.1; python_version >= "2.7" 2019-11-28T22:45:42.364 INFO:teuthology.orchestra.run.smithi074.stdout: Downloading https://files.pythonhosted.org/packages/41/17/c62faccbfbd163c7f57f3844689e3a78bae1f403648a6afb1d0866d87fbb/python_dateutil-2.8.0-py2.py3-none-any.whl (226kB) 2019-11-28T22:45:42.478 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting futures<4.0.0,>=2.2.0; python_version == "2.6" or python_version == "2.7" 2019-11-28T22:45:42.488 INFO:teuthology.orchestra.run.smithi074.stdout: Downloading https://files.pythonhosted.org/packages/d8/a6/f46ae3f1da0cd4361c344888f59ec2f5785e69c872e175a748ef6071cdb5/futures-3.3.0-py2-none-any.whl 2019-11-28T22:45:42.526 INFO:teuthology.orchestra.run.smithi074.stdout:Building wheels for collected packages: ordereddict 2019-11-28T22:45:42.526 INFO:teuthology.orchestra.run.smithi074.stdout: Building wheel for ordereddict (setup.py): started 2019-11-28T22:45:42.771 INFO:teuthology.orchestra.run.smithi074.stdout: Building wheel for ordereddict (setup.py): finished with status 'done' 2019-11-28T22:45:42.771 INFO:teuthology.orchestra.run.smithi074.stdout: Created wheel for ordereddict: filename=ordereddict-1.1-cp27-none-any.whl size=3327 sha256=10f3c0d08862b5a5ba057e7c8c90723a461e49664140a1a7a8a2f6f5edd71d6d 2019-11-28T22:45:42.772 INFO:teuthology.orchestra.run.smithi074.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/78/d3/a8/9f52c7a389a0ffba6f575a3886b5f7a55461fb6ec34aa5fd38 2019-11-28T22:45:42.773 INFO:teuthology.orchestra.run.smithi074.stdout:Successfully built ordereddict 2019-11-28T22:45:42.854 INFO:teuthology.orchestra.run.smithi074.stdout:Installing collected packages: PyYAML, nose, boto, jmespath, docutils, six, python-dateutil, urllib3, botocore, futures, s3transfer, boto3, bunch, greenlet, gevent, isodate, chardet, idna, certifi, requests, pytz, ordereddict, httplib2, lxml 2019-11-28T22:45:45.025 INFO:teuthology.orchestra.run.smithi074.stdout:Successfully installed PyYAML-5.1.2 boto-2.49.0 boto3-1.10.28 botocore-1.13.28 bunch-1.0.1 certifi-2019.11.28 chardet-3.0.4 docutils-0.15.2 futures-3.3.0 gevent-1.4.0 greenlet-0.4.15 httplib2-0.14.0 idna-2.8 isodate-0.6.0 jmespath-0.9.4 lxml-4.4.2 nose-1.3.7 ordereddict-1.1 python-dateutil-2.8.0 pytz-2019.3 requests-2.22.0 s3transfer-0.2.1 six-1.13.0 urllib3-1.25.7 2019-11-28T22:45:45.348 INFO:teuthology.orchestra.run.smithi074.stdout:running develop 2019-11-28T22:45:45.407 INFO:teuthology.orchestra.run.smithi074.stdout:running egg_info 2019-11-28T22:45:45.407 INFO:teuthology.orchestra.run.smithi074.stdout:creating s3tests.egg-info 2019-11-28T22:45:45.407 INFO:teuthology.orchestra.run.smithi074.stdout:writing requirements to s3tests.egg-info/requires.txt 2019-11-28T22:45:45.407 INFO:teuthology.orchestra.run.smithi074.stdout:writing s3tests.egg-info/PKG-INFO 2019-11-28T22:45:45.408 INFO:teuthology.orchestra.run.smithi074.stdout:writing top-level names to s3tests.egg-info/top_level.txt 2019-11-28T22:45:45.408 INFO:teuthology.orchestra.run.smithi074.stdout:writing dependency_links to s3tests.egg-info/dependency_links.txt 2019-11-28T22:45:45.409 INFO:teuthology.orchestra.run.smithi074.stdout:writing entry points to s3tests.egg-info/entry_points.txt 2019-11-28T22:45:45.409 INFO:teuthology.orchestra.run.smithi074.stdout:writing manifest file 's3tests.egg-info/SOURCES.txt' 2019-11-28T22:45:45.411 INFO:teuthology.orchestra.run.smithi074.stdout:reading manifest file 's3tests.egg-info/SOURCES.txt' 2019-11-28T22:45:45.412 INFO:teuthology.orchestra.run.smithi074.stdout:writing manifest file 's3tests.egg-info/SOURCES.txt' 2019-11-28T22:45:45.413 INFO:teuthology.orchestra.run.smithi074.stdout:running build_ext 2019-11-28T22:45:45.413 INFO:teuthology.orchestra.run.smithi074.stdout:Creating /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/s3tests.egg-link (link to .) 2019-11-28T22:45:45.413 INFO:teuthology.orchestra.run.smithi074.stdout:Adding s3tests 0.0.1 to easy-install.pth file 2019-11-28T22:45:45.416 INFO:teuthology.orchestra.run.smithi074.stdout:Installing s3tests-fuzz-headers script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-11-28T22:45:45.416 INFO:teuthology.orchestra.run.smithi074.stdout:Installing s3tests-generate-objects script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-11-28T22:45:45.416 INFO:teuthology.orchestra.run.smithi074.stdout:Installing s3tests-test-roundtrip script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-11-28T22:45:45.416 INFO:teuthology.orchestra.run.smithi074.stdout:Installing s3tests-analysis-rwstats script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-11-28T22:45:45.417 INFO:teuthology.orchestra.run.smithi074.stdout:Installing s3tests-test-readwrite script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-11-28T22:45:45.417 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:45:45.417 INFO:teuthology.orchestra.run.smithi074.stdout:Installed /home/ubuntu/cephtest/s3-tests 2019-11-28T22:45:45.417 INFO:teuthology.orchestra.run.smithi074.stdout:Processing dependencies for s3tests==0.0.1 2019-11-28T22:45:45.468 INFO:teuthology.orchestra.run.smithi074.stdout:Searching for isodate==0.6.0 2019-11-28T22:45:45.469 INFO:teuthology.orchestra.run.smithi074.stdout:Best match: isodate 0.6.0 2019-11-28T22:45:45.469 INFO:teuthology.orchestra.run.smithi074.stdout:Adding isodate 0.6.0 to easy-install.pth file 2019-11-28T22:45:45.469 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:45:45.470 INFO:teuthology.orchestra.run.smithi074.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-28T22:45:45.471 INFO:teuthology.orchestra.run.smithi074.stdout:Searching for gevent==1.4.0 2019-11-28T22:45:45.471 INFO:teuthology.orchestra.run.smithi074.stdout:Best match: gevent 1.4.0 2019-11-28T22:45:45.471 INFO:teuthology.orchestra.run.smithi074.stdout:Adding gevent 1.4.0 to easy-install.pth file 2019-11-28T22:45:45.471 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:45:45.471 INFO:teuthology.orchestra.run.smithi074.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-28T22:45:45.471 INFO:teuthology.orchestra.run.smithi074.stdout:Searching for bunch==1.0.1 2019-11-28T22:45:45.472 INFO:teuthology.orchestra.run.smithi074.stdout:Best match: bunch 1.0.1 2019-11-28T22:45:45.472 INFO:teuthology.orchestra.run.smithi074.stdout:Adding bunch 1.0.1 to easy-install.pth file 2019-11-28T22:45:45.477 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:45:45.477 INFO:teuthology.orchestra.run.smithi074.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-28T22:45:45.477 INFO:teuthology.orchestra.run.smithi074.stdout:Searching for PyYAML==5.1.2 2019-11-28T22:45:45.478 INFO:teuthology.orchestra.run.smithi074.stdout:Best match: PyYAML 5.1.2 2019-11-28T22:45:45.478 INFO:teuthology.orchestra.run.smithi074.stdout:Adding PyYAML 5.1.2 to easy-install.pth file 2019-11-28T22:45:45.478 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:45:45.478 INFO:teuthology.orchestra.run.smithi074.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-28T22:45:45.478 INFO:teuthology.orchestra.run.smithi074.stdout:Searching for boto3==1.10.28 2019-11-28T22:45:45.478 INFO:teuthology.orchestra.run.smithi074.stdout:Best match: boto3 1.10.28 2019-11-28T22:45:45.478 INFO:teuthology.orchestra.run.smithi074.stdout:Adding boto3 1.10.28 to easy-install.pth file 2019-11-28T22:45:45.479 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:45:45.479 INFO:teuthology.orchestra.run.smithi074.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-28T22:45:45.479 INFO:teuthology.orchestra.run.smithi074.stdout:Searching for boto==2.49.0 2019-11-28T22:45:45.479 INFO:teuthology.orchestra.run.smithi074.stdout:Best match: boto 2.49.0 2019-11-28T22:45:45.479 INFO:teuthology.orchestra.run.smithi074.stdout:Adding boto 2.49.0 to easy-install.pth file 2019-11-28T22:45:45.479 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:45:45.480 INFO:teuthology.orchestra.run.smithi074.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-28T22:45:45.480 INFO:teuthology.orchestra.run.smithi074.stdout:Searching for six==1.13.0 2019-11-28T22:45:45.480 INFO:teuthology.orchestra.run.smithi074.stdout:Best match: six 1.13.0 2019-11-28T22:45:45.480 INFO:teuthology.orchestra.run.smithi074.stdout:Adding six 1.13.0 to easy-install.pth file 2019-11-28T22:45:45.480 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:45:45.480 INFO:teuthology.orchestra.run.smithi074.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-28T22:45:45.480 INFO:teuthology.orchestra.run.smithi074.stdout:Searching for greenlet==0.4.15 2019-11-28T22:45:45.481 INFO:teuthology.orchestra.run.smithi074.stdout:Best match: greenlet 0.4.15 2019-11-28T22:45:45.481 INFO:teuthology.orchestra.run.smithi074.stdout:Adding greenlet 0.4.15 to easy-install.pth file 2019-11-28T22:45:45.481 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:45:45.481 INFO:teuthology.orchestra.run.smithi074.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-28T22:45:45.481 INFO:teuthology.orchestra.run.smithi074.stdout:Searching for s3transfer==0.2.1 2019-11-28T22:45:45.481 INFO:teuthology.orchestra.run.smithi074.stdout:Best match: s3transfer 0.2.1 2019-11-28T22:45:45.481 INFO:teuthology.orchestra.run.smithi074.stdout:Adding s3transfer 0.2.1 to easy-install.pth file 2019-11-28T22:45:45.482 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:45:45.482 INFO:teuthology.orchestra.run.smithi074.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-28T22:45:45.482 INFO:teuthology.orchestra.run.smithi074.stdout:Searching for jmespath==0.9.4 2019-11-28T22:45:45.482 INFO:teuthology.orchestra.run.smithi074.stdout:Best match: jmespath 0.9.4 2019-11-28T22:45:45.482 INFO:teuthology.orchestra.run.smithi074.stdout:Adding jmespath 0.9.4 to easy-install.pth file 2019-11-28T22:45:45.485 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:45:45.485 INFO:teuthology.orchestra.run.smithi074.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-28T22:45:45.485 INFO:teuthology.orchestra.run.smithi074.stdout:Searching for botocore==1.13.28 2019-11-28T22:45:45.485 INFO:teuthology.orchestra.run.smithi074.stdout:Best match: botocore 1.13.28 2019-11-28T22:45:45.485 INFO:teuthology.orchestra.run.smithi074.stdout:Adding botocore 1.13.28 to easy-install.pth file 2019-11-28T22:45:45.485 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:45:45.485 INFO:teuthology.orchestra.run.smithi074.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-28T22:45:45.486 INFO:teuthology.orchestra.run.smithi074.stdout:Searching for futures==3.3.0 2019-11-28T22:45:45.486 INFO:teuthology.orchestra.run.smithi074.stdout:Best match: futures 3.3.0 2019-11-28T22:45:45.486 INFO:teuthology.orchestra.run.smithi074.stdout:Adding futures 3.3.0 to easy-install.pth file 2019-11-28T22:45:45.486 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:45:45.486 INFO:teuthology.orchestra.run.smithi074.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-28T22:45:45.486 INFO:teuthology.orchestra.run.smithi074.stdout:Searching for urllib3==1.25.7 2019-11-28T22:45:45.486 INFO:teuthology.orchestra.run.smithi074.stdout:Best match: urllib3 1.25.7 2019-11-28T22:45:45.487 INFO:teuthology.orchestra.run.smithi074.stdout:Adding urllib3 1.25.7 to easy-install.pth file 2019-11-28T22:45:45.487 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:45:45.487 INFO:teuthology.orchestra.run.smithi074.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-28T22:45:45.487 INFO:teuthology.orchestra.run.smithi074.stdout:Searching for python-dateutil==2.8.0 2019-11-28T22:45:45.487 INFO:teuthology.orchestra.run.smithi074.stdout:Best match: python-dateutil 2.8.0 2019-11-28T22:45:45.487 INFO:teuthology.orchestra.run.smithi074.stdout:Adding python-dateutil 2.8.0 to easy-install.pth file 2019-11-28T22:45:45.487 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:45:45.488 INFO:teuthology.orchestra.run.smithi074.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-28T22:45:45.488 INFO:teuthology.orchestra.run.smithi074.stdout:Searching for docutils==0.15.2 2019-11-28T22:45:45.488 INFO:teuthology.orchestra.run.smithi074.stdout:Best match: docutils 0.15.2 2019-11-28T22:45:45.488 INFO:teuthology.orchestra.run.smithi074.stdout:Adding docutils 0.15.2 to easy-install.pth file 2019-11-28T22:45:45.488 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-28T22:45:45.488 INFO:teuthology.orchestra.run.smithi074.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-28T22:45:45.488 INFO:teuthology.orchestra.run.smithi074.stdout:Finished processing dependencies for s3tests==0.0.1 2019-11-28T22:45:45.493 INFO:teuthology.orchestra.run.smithi074:> cat > /home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2019-11-28T22:45:45.554 INFO:tasks.s3tests:Configuring boto... 2019-11-28T22:45:45.554 INFO:teuthology.orchestra.run.smithi074:> cat > /home/ubuntu/cephtest/boto.cfg 2019-11-28T22:45:45.681 INFO:teuthology.orchestra.run.smithi074:s3 tests against rgw> S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/nosetests -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!fails_strict_rfc2616,!fails_with_subdomain' 2019-11-28T22:45:51.953 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_object_create_bad_contentlength_none ... ok 2019-11-28T22:45:54.744 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_empty ... ok 2019-11-28T22:45:58.726 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_object_create_date_and_amz_date ... ok 2019-11-28T22:46:01.253 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_object_create_amz_date_and_no_date ... ok 2019-11-28T22:46:04.504 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_none ... ok 2019-11-28T22:46:07.383 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_bucket_create_contentlength_none ... ok 2019-11-28T22:46:13.129 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_object_acl_create_contentlength_none ... ok 2019-11-28T22:46:14.798 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_bucket_create_bad_contentlength_none ... ok 2019-11-28T22:46:14.989 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_bucket_create_bad_authorization_empty ... ok 2019-11-28T22:46:15.492 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_bucket_create_bad_authorization_none ... ok 2019-11-28T22:46:17.502 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_object_create_bad_contentlength_mismatch_below_aws2 ... ok 2019-11-28T22:46:21.098 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_incorrect_aws2 ... ok 2019-11-28T22:46:22.971 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_invalid_aws2 ... ok 2019-11-28T22:46:25.257 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_object_create_bad_date_none_aws2 ... ok 2019-11-28T22:46:25.376 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_bucket_create_bad_authorization_invalid_aws2 ... ok 2019-11-28T22:46:25.438 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_none_aws2 ... ok 2019-11-28T22:46:25.439 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_object_create_bad_md5_invalid_garbage_aws4 ... SKIP 2019-11-28T22:46:25.439 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_object_create_bad_contentlength_mismatch_below_aws4 ... SKIP 2019-11-28T22:46:25.439 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_incorrect_aws4 ... SKIP 2019-11-28T22:46:25.439 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_invalid_aws4 ... SKIP 2019-11-28T22:46:25.439 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_object_create_bad_ua_empty_aws4 ... SKIP 2019-11-28T22:46:25.439 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_object_create_bad_ua_none_aws4 ... SKIP 2019-11-28T22:46:25.440 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_object_create_bad_date_invalid_aws4 ... SKIP 2019-11-28T22:46:25.440 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_invalid_aws4 ... SKIP 2019-11-28T22:46:25.440 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_object_create_bad_date_empty_aws4 ... SKIP 2019-11-28T22:46:25.440 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_empty_aws4 ... SKIP 2019-11-28T22:46:25.440 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_object_create_bad_date_none_aws4 ... SKIP 2019-11-28T22:46:25.440 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_none_aws4 ... SKIP 2019-11-28T22:46:25.440 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_object_create_bad_date_before_today_aws4 ... SKIP 2019-11-28T22:46:25.441 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_before_today_aws4 ... SKIP 2019-11-28T22:46:25.441 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_object_create_bad_date_after_today_aws4 ... SKIP 2019-11-28T22:46:25.441 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_after_today_aws4 ... SKIP 2019-11-28T22:46:25.441 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_object_create_bad_date_before_epoch_aws4 ... SKIP 2019-11-28T22:46:25.441 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_before_epoch_aws4 ... SKIP 2019-11-28T22:46:25.441 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_object_create_bad_date_after_end_aws4 ... SKIP 2019-11-28T22:46:25.442 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_after_end_aws4 ... SKIP 2019-11-28T22:46:25.445 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_object_create_missing_signed_custom_header_aws4 ... SKIP 2019-11-28T22:46:25.445 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_object_create_missing_signed_header_aws4 ... SKIP 2019-11-28T22:46:25.445 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_bucket_create_bad_authorization_invalid_aws4 ... SKIP 2019-11-28T22:46:25.445 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_bucket_create_bad_ua_empty_aws4 ... SKIP 2019-11-28T22:46:25.445 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_bucket_create_bad_ua_none_aws4 ... SKIP 2019-11-28T22:46:25.446 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_invalid_aws4 ... SKIP 2019-11-28T22:46:25.446 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_invalid_aws4 ... SKIP 2019-11-28T22:46:25.446 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_empty_aws4 ... SKIP 2019-11-28T22:46:25.446 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_empty_aws4 ... SKIP 2019-11-28T22:46:25.446 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_none_aws4 ... SKIP 2019-11-28T22:46:25.446 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_none_aws4 ... SKIP 2019-11-28T22:46:25.446 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_before_today_aws4 ... SKIP 2019-11-28T22:46:25.447 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_before_today_aws4 ... SKIP 2019-11-28T22:46:25.447 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_after_today_aws4 ... SKIP 2019-11-28T22:46:25.447 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_after_today_aws4 ... SKIP 2019-11-28T22:46:25.447 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_before_epoch_aws4 ... SKIP 2019-11-28T22:46:25.447 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_before_epoch_aws4 ... SKIP 2019-11-28T22:46:31.402 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3.test_versioning_obj_read_not_exist_null ... ok 2019-11-28T22:46:31.402 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3.test_lifecycle_transition ... SKIP 2019-11-28T22:46:31.402 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3.test_lifecycle_transition_single_rule_multi_trans ... SKIP 2019-11-28T22:46:31.402 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3.test_lifecycle_set_noncurrent_transition ... SKIP 2019-11-28T22:46:31.402 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3.test_object_storage_class ... SKIP 2019-11-28T22:46:31.404 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3.test_object_storage_class_multipart ... SKIP 2019-11-28T22:46:31.404 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3.test_object_modify_storage_class ... SKIP 2019-11-28T22:46:31.404 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3.test_object_modify_storage_class_multipart ... SKIP 2019-11-28T22:46:31.404 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3.test_object_storage_class_copy ... SKIP 2019-11-28T22:46:31.404 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3.test_object_storage_class_copy_multipart ... SKIP 2019-11-28T22:46:36.974 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3.test_atomic_dual_conditional_write_1mb ... ok 2019-11-28T22:46:43.539 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3.test_atomic_write_bucket_gone ... ok 2019-11-28T22:46:54.938 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3.test_encryption_sse_c_multipart_invalid_chunks_1 ... ok 2019-11-28T22:46:58.602 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3.test_encryption_sse_c_multipart_invalid_chunks_2 ... ok 2019-11-28T22:47:03.715 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3.test_bucket_policy_set_condition_operator_end_with_IfExists ... ok 2019-11-28T22:47:06.866 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3.test_bucket_policy_put_obj_enc ... ok 2019-11-28T22:47:10.768 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3.test_bucket_policy_put_obj_request_obj_tag ... ok 2019-11-28T22:47:18.081 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3_website.check_can_test_website ... SKIP 2019-11-28T22:47:18.082 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3_website.test_website_nonexistant_bucket_rgw ... SKIP 2019-11-28T22:47:18.082 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_public_index ... SKIP 2019-11-28T22:47:18.082 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_public_index ... SKIP 2019-11-28T22:47:18.082 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_empty ... SKIP 2019-11-28T22:47:18.083 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_empty ... SKIP 2019-11-28T22:47:18.083 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_private_index ... SKIP 2019-11-28T22:47:18.083 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_private_index ... SKIP 2019-11-28T22:47:18.083 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_empty_missingerrordoc ... SKIP 2019-11-28T22:47:18.083 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_empty_missingerrordoc ... SKIP 2019-11-28T22:47:18.083 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_private_index_missingerrordoc ... SKIP 2019-11-28T22:47:18.084 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_private_index_missingerrordoc ... SKIP 2019-11-28T22:47:18.084 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_empty_blockederrordoc ... SKIP 2019-11-28T22:47:18.084 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_empty_blockederrordoc ... SKIP 2019-11-28T22:47:18.084 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_private_index_blockederrordoc ... SKIP 2019-11-28T22:47:18.084 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_private_index_blockederrordoc ... SKIP 2019-11-28T22:47:18.084 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_empty_gooderrordoc ... SKIP 2019-11-28T22:47:18.085 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_empty_gooderrordoc ... SKIP 2019-11-28T22:47:18.085 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_private_index_gooderrordoc ... SKIP 2019-11-28T22:47:18.085 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_private_index_gooderrordoc ... SKIP 2019-11-28T22:47:18.085 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3_website.test_website_bucket_private_redirectall_base ... SKIP 2019-11-28T22:47:18.085 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3_website.test_website_bucket_private_redirectall_path ... SKIP 2019-11-28T22:47:18.085 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3_website.test_website_bucket_private_redirectall_path_upgrade ... SKIP 2019-11-28T22:47:18.085 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3_website.test_website_xredirect_nonwebsite ... SKIP 2019-11-28T22:47:18.085 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3_website.test_website_xredirect_public_relative ... SKIP 2019-11-28T22:47:18.086 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3_website.test_website_xredirect_public_abs ... SKIP 2019-11-28T22:47:18.086 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3_website.test_website_xredirect_private_relative ... SKIP 2019-11-28T22:47:18.086 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_s3_website.test_website_xredirect_private_abs ... SKIP 2019-11-28T22:47:18.086 INFO:teuthology.orchestra.run.smithi074.stderr:SKIP 2019-11-28T22:47:18.089 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.functional.test_utils.test_generate ... ok 2019-11-28T22:48:43.017 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.fuzz.test.test_fuzzer.test_load_graph ... ok 2019-11-28T22:48:43.017 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_leaf_node ... ok 2019-11-28T22:48:43.018 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_node ... ok 2019-11-28T22:48:43.018 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_bad_node ... ok 2019-11-28T22:48:43.018 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_nonexistant_child ... ok 2019-11-28T22:48:43.018 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_printable ... ok 2019-11-28T22:48:43.018 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_binary ... ok 2019-11-28T22:48:43.412 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_printable_no_whitespace ... ok 2019-11-28T22:48:43.571 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_binary_no_whitespace ... ok 2019-11-28T22:48:43.925 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_no_args ... ok 2019-11-28T22:48:43.948 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_no_charset ... ok 2019-11-28T22:48:43.966 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_exact_length ... ok 2019-11-28T22:48:43.967 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_bad_charset ... ok 2019-11-28T22:48:43.967 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_missing_length ... ok 2019-11-28T22:48:43.967 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.fuzz.test.test_fuzzer.test_assemble_decision ... ok 2019-11-28T22:48:43.967 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_escape ... ok 2019-11-28T22:48:43.967 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_indirect ... ok 2019-11-28T22:48:43.967 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_indirect_double ... ok 2019-11-28T22:48:43.967 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_recursive ... ok 2019-11-28T22:48:43.968 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_recursive_mutual ... ok 2019-11-28T22:48:43.968 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_recursive_not_too_eager ... ok 2019-11-28T22:48:43.968 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.fuzz.test.test_fuzzer.test_make_choice_unweighted_with_space ... ok 2019-11-28T22:48:43.971 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.fuzz.test.test_fuzzer.test_weighted_choices ... ok 2019-11-28T22:48:43.972 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.fuzz.test.test_fuzzer.test_null_choices ... ok 2019-11-28T22:48:43.972 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.fuzz.test.test_fuzzer.test_weighted_null_choices ... ok 2019-11-28T22:48:43.972 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.fuzz.test.test_fuzzer.test_null_child ... ok 2019-11-28T22:48:43.976 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.fuzz.test.test_fuzzer.test_weighted_set ... ok 2019-11-28T22:48:43.977 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.fuzz.test.test_fuzzer.test_header_presence ... ok 2019-11-28T22:48:43.979 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.fuzz.test.test_fuzzer.test_duplicate_header ... ok 2019-11-28T22:48:43.979 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_headers ... ok 2019-11-28T22:48:44.001 INFO:teuthology.orchestra.run.smithi074.stderr:test_realistic.TestFileValidator.test_new_file_is_valid ... ok 2019-11-28T22:48:44.025 INFO:teuthology.orchestra.run.smithi074.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_on_several_calls ... ok 2019-11-28T22:48:44.025 INFO:teuthology.orchestra.run.smithi074.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_when_size_is_1 ... ok 2019-11-28T22:48:44.175 INFO:teuthology.orchestra.run.smithi074.stderr:test_realistic.TestFiles.test_random_file_valid ... ok 2019-11-28T22:48:47.373 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_invalid_short ... ok 2019-11-28T22:49:03.444 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_bad ... ok 2019-11-28T22:49:05.899 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_empty ... ok 2019-11-28T22:49:11.266 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_none ... ok 2019-11-28T22:49:15.518 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_expect_mismatch ... ok 2019-11-28T22:49:17.586 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:02:59.804 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:49:17.595 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:02:59.813 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:49:17.600 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:02:59.819 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:49:17.604 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:02:59.831 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:49:17.606 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:02:59.826 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:49:17.607 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:02:59.835 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:49:17.729 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:02:59.947 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:49:17.743 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:02:59.963 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:49:17.779 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:03:00.007 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:49:18.828 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_expect_empty ... ok 2019-11-28T22:49:22.866 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_expect_none ... ok 2019-11-28T22:49:24.449 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_contentlength_negative ... ok 2019-11-28T22:49:28.501 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_contenttype_invalid ... ok 2019-11-28T22:49:31.486 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_contenttype_empty ... ok 2019-11-28T22:49:33.448 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_contenttype_none ... ok 2019-11-28T22:49:35.646 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_headers.test_bucket_put_bad_canned_acl ... ok 2019-11-28T22:49:37.361 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_expect_mismatch ... ok 2019-11-28T22:49:39.980 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_expect_empty ... ok 2019-11-28T22:49:40.142 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_contentlength_negative ... ok 2019-11-28T22:49:41.981 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_invalid_garbage_aws2 ... ok 2019-11-28T22:49:47.210 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_ua_empty_aws2 ... ok 2019-11-28T22:49:52.923 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_ua_none_aws2 ... ok 2019-11-28T22:49:55.711 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_invalid_aws2 ... ok 2019-11-28T22:49:57.785 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_empty_aws2 ... ok 2019-11-28T22:49:59.600 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_before_today_aws2 ... ok 2019-11-28T22:50:01.307 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_before_epoch_aws2 ... ok 2019-11-28T22:50:03.848 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_after_end_aws2 ... ok 2019-11-28T22:50:06.018 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_ua_empty_aws2 ... ok 2019-11-28T22:50:09.490 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_ua_none_aws2 ... ok 2019-11-28T22:50:09.547 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_invalid_aws2 ... ok 2019-11-28T22:50:09.632 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_empty_aws2 ... ok 2019-11-28T22:50:09.679 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_before_today_aws2 ... ok 2019-11-28T22:50:09.923 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_after_today_aws2 ... ok 2019-11-28T22:50:10.085 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_before_epoch_aws2 ... ok 2019-11-28T22:50:13.499 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_empty ... ok 2019-11-28T22:50:19.813 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_distinct ... ok 2019-11-28T22:50:28.058 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_many ... ok 2019-11-28T22:50:32.608 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_many ... ok 2019-11-28T22:50:43.235 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_basic_key_count ... ok 2019-11-28T22:50:49.366 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_basic ... ok 2019-11-28T22:50:56.422 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_basic ... ok 2019-11-28T22:51:06.920 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_prefix ... ok 2019-11-28T22:51:19.240 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_prefix ... ok 2019-11-28T22:52:13.935 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_prefix_ends_with_delimiter ... ok 2019-11-28T22:52:13.935 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_prefix_ends_with_delimiter ... ok 2019-11-28T22:52:13.935 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_alt ... ok 2019-11-28T22:52:13.935 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_alt ... ok 2019-11-28T22:52:13.936 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_prefix_underscore ... ok 2019-11-28T22:52:13.936 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_prefix_underscore ... ok 2019-11-28T22:52:14.417 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_percentage ... ok 2019-11-28T22:52:21.796 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_percentage ... ok 2019-11-28T22:52:29.086 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_whitespace ... ok 2019-11-28T22:52:36.879 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_whitespace ... ok 2019-11-28T22:52:42.896 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_dot ... ok 2019-11-28T22:52:49.029 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_dot ... ok 2019-11-28T22:52:55.548 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_unreadable ... ok 2019-11-28T22:53:02.708 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_unreadable ... ok 2019-11-28T22:53:09.916 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_empty ... ok 2019-11-28T22:53:17.334 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_empty ... ok 2019-11-28T22:53:23.786 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_none ... ok 2019-11-28T22:53:29.615 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_none ... ok 2019-11-28T22:53:35.522 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_fetchowner_notempty ... ok 2019-11-28T22:53:42.543 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_fetchowner_defaultempty ... ok 2019-11-28T22:53:48.616 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_fetchowner_empty ... ok 2019-11-28T22:53:55.704 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_not_exist ... ok 2019-11-28T22:53:58.757 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:07:40.975 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:53:58.791 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:07:41.011 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:53:58.793 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:07:41.012 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:53:58.827 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:07:41.046 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:53:58.857 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:07:41.085 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:53:58.868 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:07:41.095 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:53:58.928 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:07:41.147 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:53:59.017 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:07:41.237 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:53:59.052 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:07:41.280 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:54:00.831 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_not_exist ... ok 2019-11-28T22:54:31.691 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:08:13.909 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:54:31.698 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:08:13.917 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:54:31.706 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:08:13.926 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:54:31.710 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:08:13.938 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:54:31.711 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:08:13.931 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:54:31.717 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:08:13.945 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:54:31.740 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:08:13.958 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:54:31.746 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:08:13.966 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:54:31.758 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:08:13.986 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:59:44.653 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:13:26.871 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:59:44.663 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:13:26.881 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:59:44.673 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:13:26.892 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:59:44.676 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:13:26.895 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:59:44.676 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:13:26.903 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:59:44.682 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:13:26.910 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T22:59:44.848 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:13:27.066 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T22:59:44.853 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:13:27.072 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T22:59:44.915 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:13:27.143 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:02:20.051 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:16:02.269 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:02:20.062 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:16:02.280 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:02:20.098 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:16:02.317 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:02:20.101 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:16:02.321 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:02:20.131 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:16:02.358 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:02:20.140 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:16:02.358 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:02:20.140 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:16:02.367 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:02:20.183 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:16:02.402 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:02:20.270 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:16:02.497 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:04:55.560 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:18:37.778 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:04:55.569 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:18:37.787 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:04:55.578 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:18:37.798 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:04:55.583 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:18:37.803 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:04:55.591 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:18:37.818 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:04:55.597 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:18:37.825 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:04:55.692 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:18:37.911 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:04:55.702 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:18:37.920 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:04:55.729 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:18:37.957 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:10:06.298 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:23:48.516 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:10:31.343 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:23:48.548 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:10:31.343 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:23:48.566 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:10:31.343 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:23:48.794 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:10:31.343 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:23:48.521 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:10:31.343 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:23:48.717 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:10:31.343 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:23:48.531 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:10:31.344 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:23:48.536 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:10:31.344 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:23:48.745 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:10:41.349 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:24:23.565 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:10:41.355 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:24:23.573 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:10:41.393 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:24:23.612 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:10:41.396 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:24:23.616 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:10:41.405 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:24:23.623 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:10:41.432 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:24:23.660 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:10:41.434 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:24:23.653 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:10:41.435 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:24:23.663 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:10:41.480 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:24:23.708 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:11:17.865 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_not_skip_special ... ok 2019-11-28T23:11:23.694 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_basic ... ok 2019-11-28T23:11:31.303 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_basic ... ok 2019-11-28T23:11:37.269 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_alt ... ok 2019-11-28T23:11:42.326 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_alt ... ok 2019-11-28T23:11:48.368 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_empty ... ok 2019-11-28T23:11:52.547 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_empty ... ok 2019-11-28T23:11:57.191 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_none ... ok 2019-11-28T23:12:03.702 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_none ... ok 2019-11-28T23:12:09.749 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_not_exist ... ok 2019-11-28T23:12:15.799 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_not_exist ... ok 2019-11-28T23:12:20.790 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_unreadable ... ok 2019-11-28T23:12:25.712 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_unreadable ... ok 2019-11-28T23:12:32.676 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_basic ... ok 2019-11-28T23:12:39.318 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_basic ... ok 2019-11-28T23:12:45.780 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_alt ... ok 2019-11-28T23:12:51.939 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_alt ... ok 2019-11-28T23:12:59.895 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_prefix_not_exist ... ok 2019-11-28T23:13:06.830 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_prefix_not_exist ... ok 2019-11-28T23:13:13.371 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_delimiter_not_exist ... ok 2019-11-28T23:13:19.621 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_delimiter_not_exist ... ok 2019-11-28T23:13:25.469 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist ... ok 2019-11-28T23:13:30.289 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist ... ok 2019-11-28T23:13:38.845 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_maxkeys_one ... ok 2019-11-28T23:13:47.196 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_maxkeys_one ... ok 2019-11-28T23:13:54.387 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_maxkeys_zero ... ok 2019-11-28T23:14:00.414 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_maxkeys_zero ... ok 2019-11-28T23:14:08.132 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_maxkeys_none ... ok 2019-11-28T23:14:15.805 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_maxkeys_none ... ok 2019-11-28T23:14:49.300 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_unordered ... ok 2019-11-28T23:15:17.048 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:28:59.266 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:15:17.053 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:28:59.271 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:15:17.068 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:28:59.288 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:15:17.073 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:28:59.301 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:15:17.075 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:28:59.294 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:15:17.080 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:28:59.308 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:15:17.081 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_unordered ... ok 2019-11-28T23:15:17.224 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:28:59.442 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:15:17.278 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:28:59.497 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:15:17.363 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:28:59.591 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:15:24.380 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_maxkeys_invalid ... ok 2019-11-28T23:15:33.163 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_none ... ok 2019-11-28T23:15:39.917 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_empty ... ok 2019-11-28T23:15:48.179 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_continuationtoken_empty ... ok 2019-11-28T23:15:53.692 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_unreadable ... ok 2019-11-28T23:16:00.176 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_startafter_unreadable ... ok 2019-11-28T23:16:07.715 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_not_in_list ... ok 2019-11-28T23:16:14.242 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_startafter_not_in_list ... ok 2019-11-28T23:16:21.997 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_after_list ... ok 2019-11-28T23:16:26.233 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_startafter_after_list ... ok 2019-11-28T23:16:34.196 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_return_data ... ok 2019-11-28T23:16:53.572 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_return_data_versioning ... ok 2019-11-28T23:16:57.253 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_objects_anonymous ... ok 2019-11-28T23:17:01.117 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_objects_anonymous ... ok 2019-11-28T23:17:03.619 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_objects_anonymous_fail ... ok 2019-11-28T23:17:05.350 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_objects_anonymous_fail ... ok 2019-11-28T23:17:05.972 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_notexist ... ok 2019-11-28T23:17:06.734 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucketv2_notexist ... ok 2019-11-28T23:17:07.007 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_delete_notexist ... ok 2019-11-28T23:17:11.483 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_delete_nonempty ... ok 2019-11-28T23:17:18.195 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_concurrent_set_canned_acl ... ok 2019-11-28T23:17:18.764 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_write_to_nonexist_bucket ... ok 2019-11-28T23:17:25.045 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_delete ... ok 2019-11-28T23:17:27.952 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_read_notexist ... ok 2019-11-28T23:17:30.172 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_requestid_matches_header_on_error ... ok 2019-11-28T23:17:42.442 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_multi_object_delete ... ok 2019-11-28T23:17:53.723 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_multi_objectv2_delete ... ok 2019-11-28T23:17:58.120 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_head_zero_bytes ... ok 2019-11-28T23:18:02.324 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_write_check_etag ... ok 2019-11-28T23:18:05.157 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_write_cache_control ... ok 2019-11-28T23:18:09.639 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_write_expires ... ok 2019-11-28T23:18:16.332 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_write_read_update_read_delete ... ok 2019-11-28T23:18:19.085 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_set_get_metadata_none_to_good ... ok 2019-11-28T23:18:22.295 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_set_get_metadata_none_to_empty ... ok 2019-11-28T23:18:27.036 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_set_get_metadata_overwrite_to_empty ... ok 2019-11-28T23:18:30.488 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_set_get_unicode_metadata ... ok 2019-11-28T23:18:34.540 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_metadata_replaced_on_put ... ok 2019-11-28T23:18:37.261 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_write_file ... ok 2019-11-28T23:18:40.709 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_post_object_anonymous_request ... ok 2019-11-28T23:18:44.469 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_post_object_authenticated_request ... ok 2019-11-28T23:18:47.175 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_post_object_authenticated_no_content_type ... ok 2019-11-28T23:18:49.404 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_post_object_authenticated_request_bad_access_key ... ok 2019-11-28T23:18:52.375 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_post_object_set_success_code ... ok 2019-11-28T23:18:55.509 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_post_object_set_invalid_success_code ... ok 2019-11-28T23:19:00.413 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_post_object_upload_larger_than_chunk ... ok 2019-11-28T23:19:02.546 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:32:44.764 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:19:02.576 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:32:44.804 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:19:02.580 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:32:44.798 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:19:02.595 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:32:44.824 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:19:02.605 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:32:44.824 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:19:02.606 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:32:44.825 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:19:02.692 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:32:44.908 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:19:02.701 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:32:44.929 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:19:02.705 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:32:44.924 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:19:03.091 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_post_object_set_key_from_filename ... ok 2019-11-28T23:19:04.455 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_post_object_ignored_header ... ok 2019-11-28T23:19:06.923 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_post_object_case_insensitive_condition_fields ... ok 2019-11-28T23:19:11.887 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_post_object_escaped_field_values ... ok 2019-11-28T23:19:16.254 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_post_object_success_redirect_action ... ok 2019-11-28T23:19:18.465 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_signature ... ok 2019-11-28T23:19:20.025 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_access_key ... ok 2019-11-28T23:19:21.793 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_date_format ... ok 2019-11-28T23:19:24.219 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_post_object_no_key_specified ... ok 2019-11-28T23:19:26.279 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_signature ... ok 2019-11-28T23:19:27.953 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_policy_condition ... ok 2019-11-28T23:19:32.335 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_post_object_user_specified_header ... ok 2019-11-28T23:19:34.057 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_post_object_request_missing_policy_specified_field ... ok 2019-11-28T23:19:35.420 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_post_object_condition_is_case_sensitive ... ok 2019-11-28T23:19:36.583 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_post_object_expires_is_case_sensitive ... ok 2019-11-28T23:19:38.933 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_post_object_expired_policy ... ok 2019-11-28T23:19:41.881 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_request_field_value ... ok 2019-11-28T23:19:43.727 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_expires_condition ... ok 2019-11-28T23:19:46.081 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_conditions_list ... ok 2019-11-28T23:19:47.766 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_post_object_upload_size_limit_exceeded ... ok 2019-11-28T23:19:50.802 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_content_length_argument ... ok 2019-11-28T23:19:52.912 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_content_length_argument ... ok 2019-11-28T23:19:55.486 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_post_object_upload_size_below_minimum ... ok 2019-11-28T23:19:58.480 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_post_object_empty_conditions ... ok 2019-11-28T23:20:02.447 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifmatch_good ... ok 2019-11-28T23:20:06.258 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifmatch_failed ... ok 2019-11-28T23:20:08.924 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifnonematch_good ... ok 2019-11-28T23:20:12.318 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifnonematch_failed ... ok 2019-11-28T23:20:16.648 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifmodifiedsince_good ... ok 2019-11-28T23:20:24.038 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifmodifiedsince_failed ... ok 2019-11-28T23:20:27.586 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifunmodifiedsince_good ... ok 2019-11-28T23:20:28.896 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:34:11.115 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:20:28.906 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:34:11.124 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:20:28.914 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:34:11.134 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:20:28.918 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:34:11.138 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:20:28.933 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:34:11.162 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:20:28.942 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:34:11.170 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:20:28.984 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:34:11.204 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:20:28.995 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:34:11.213 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:20:29.034 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:34:11.262 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:20:31.220 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifunmodifiedsince_failed ... ok 2019-11-28T23:20:35.711 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifmatch_good ... ok 2019-11-28T23:20:40.221 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifmatch_failed ... ok 2019-11-28T23:20:44.978 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifmatch_overwrite_existed_good ... ok 2019-11-28T23:20:48.820 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifmatch_nonexisted_failed ... ok 2019-11-28T23:20:54.904 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifnonmatch_good ... ok 2019-11-28T23:20:58.917 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifnonmatch_failed ... ok 2019-11-28T23:21:02.864 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifnonmatch_nonexisted_good ... ok 2019-11-28T23:21:10.181 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifnonmatch_overwrite_existed_failed ... ok 2019-11-28T23:21:13.874 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get ... ok 2019-11-28T23:21:22.906 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_bucket_gone ... ok 2019-11-28T23:21:29.560 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_delete_key_bucket_gone ... ok 2019-11-28T23:21:34.959 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_object_gone ... ok 2019-11-28T23:21:37.063 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_head ... ok 2019-11-28T23:21:46.033 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_head_extended ... ok 2019-11-28T23:21:50.521 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_bucket_acl ... ok 2019-11-28T23:21:55.138 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_object_acl ... ok 2019-11-28T23:21:58.779 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated ... ok 2019-11-28T23:22:02.784 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_raw_response_headers ... ok 2019-11-28T23:22:06.210 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated_bucket_acl ... ok 2019-11-28T23:22:11.307 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated_object_acl ... ok 2019-11-28T23:22:20.452 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated_bucket_gone ... ok 2019-11-28T23:22:25.681 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated_object_gone ... ok 2019-11-28T23:22:30.281 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_x_amz_expires_not_expired ... ok 2019-11-28T23:22:33.090 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_x_amz_expires_out_range_zero ... ok 2019-11-28T23:22:36.872 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_x_amz_expires_out_max_range ... ok 2019-11-28T23:22:40.826 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_x_amz_expires_out_positive_range ... ok 2019-11-28T23:22:44.806 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_anon_put ... ok 2019-11-28T23:22:49.347 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_anon_put_write_access ... ok 2019-11-28T23:22:52.968 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_put_authenticated ... ok 2019-11-28T23:22:55.342 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_raw_put_authenticated_expired ... ok 2019-11-28T23:22:56.056 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_bad_short_one ... ok 2019-11-28T23:22:56.850 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_bad_short_two ... ok 2019-11-28T23:22:57.308 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_bad_ip ... ok 2019-11-28T23:22:58.077 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_dns_underscore ... ok 2019-11-28T23:23:01.826 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_exists ... ok 2019-11-28T23:23:03.829 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_get_location ... ok 2019-11-28T23:23:08.454 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_exists_nonowner ... ok 2019-11-28T23:23:12.245 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_default ... ok 2019-11-28T23:23:15.241 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned_during_create ... ok 2019-11-28T23:23:17.896 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned ... ok 2019-11-28T23:23:19.454 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned_publicreadwrite ... ok 2019-11-28T23:23:21.715 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned_authenticatedread ... ok 2019-11-28T23:23:25.877 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_acl_default ... ok 2019-11-28T23:23:31.540 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_during_create ... ok 2019-11-28T23:23:36.681 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned ... ok 2019-11-28T23:23:40.725 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_publicreadwrite ... ok 2019-11-28T23:23:43.779 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_authenticatedread ... ok 2019-11-28T23:23:50.913 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_bucketownerread ... ok 2019-11-28T23:23:55.900 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_bucketownerfullcontrol ... ok 2019-11-28T23:24:03.075 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_acl_full_control_verify_owner ... ok 2019-11-28T23:24:08.241 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_acl_full_control_verify_attributes ... ok 2019-11-28T23:24:10.532 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned_private_to_private ... ok 2019-11-28T23:24:16.415 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_acl ... ok 2019-11-28T23:24:21.511 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_acl_write ... ok 2019-11-28T23:24:26.266 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_acl_writeacp ... ok 2019-11-28T23:24:33.258 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_acl_read ... ok 2019-11-28T23:24:38.221 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_acl_readacp ... ok 2019-11-28T23:24:44.462 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_fullcontrol ... ok 2019-11-28T23:24:50.096 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_read ... ok 2019-11-28T23:24:54.260 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_readacp ... ok 2019-11-28T23:24:58.116 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_write ... ok 2019-11-28T23:25:03.736 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_writeacp ... ok 2019-11-28T23:25:06.671 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_nonexist_user ... ok 2019-11-28T23:25:12.065 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_no_grants ... ok 2019-11-28T23:25:16.583 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_header_acl_grants ... ok 2019-11-28T23:25:23.214 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_header_acl_grants ... ok 2019-11-28T23:25:26.891 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_email ... ok 2019-11-28T23:25:29.112 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_email_notexist ... ok 2019-11-28T23:25:34.722 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_revoke_all ... ok 2019-11-28T23:25:42.665 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:39:24.883 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:25:42.672 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:39:24.890 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:25:42.682 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:39:24.911 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:25:42.685 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:39:24.913 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:25:42.685 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:39:24.905 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:25:42.690 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:39:24.910 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:25:42.877 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:39:25.106 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:25:42.887 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:39:25.106 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:25:42.897 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:39:25.115 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:25:42.907 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_object_private ... ok 2019-11-28T23:25:49.244 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_objectv2_private ... ok 2019-11-28T23:25:58.927 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_object_publicread ... ok 2019-11-28T23:26:07.487 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_objectv2_publicread ... ok 2019-11-28T23:26:14.697 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_object_publicreadwrite ... ok 2019-11-28T23:26:22.406 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_objectv2_publicreadwrite ... ok 2019-11-28T23:26:30.147 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicread_object_private ... ok 2019-11-28T23:26:36.269 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicread_object_publicread ... ok 2019-11-28T23:26:43.920 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:40:26.138 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:26:43.936 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:40:26.154 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:26:43.986 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:40:26.204 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:26:44.003 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:40:26.223 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:26:44.006 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:40:26.226 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:26:44.019 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:40:26.248 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:26:44.023 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:40:26.252 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:26:44.058 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:40:26.277 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:26:44.086 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:40:26.315 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:26:45.532 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicread_object_publicreadwrite ... ok 2019-11-28T23:26:56.659 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicreadwrite_object_private ... ok 2019-11-28T23:27:10.558 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicreadwrite_object_publicread ... ok 2019-11-28T23:27:20.932 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicreadwrite_object_publicreadwrite ... ok 2019-11-28T23:27:29.160 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:41:11.378 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:27:29.164 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:41:11.383 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:27:29.200 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:41:11.420 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:27:29.204 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:41:11.424 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:27:29.207 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:41:11.436 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:27:29.213 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:41:11.431 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:27:29.216 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:41:11.444 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:27:29.243 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:41:11.463 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:27:29.272 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:41:11.501 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:27:32.916 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_buckets_create_then_list ... ok 2019-11-28T23:27:33.708 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_list_buckets_anonymous ... ok 2019-11-28T23:27:34.038 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_list_buckets_invalid_auth ... ok 2019-11-28T23:27:34.127 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_list_buckets_bad_auth ... ok 2019-11-28T23:27:42.198 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_good_starts_alpha ... ok 2019-11-28T23:27:51.290 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_good_starts_digit ... ok 2019-11-28T23:27:52.835 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_good_contains_period ... ok 2019-11-28T23:27:55.405 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_good_contains_hyphen ... ok 2019-11-28T23:28:05.861 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_recreate_not_overriding ... ok 2019-11-28T23:28:35.502 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_special_key_names ... ok 2019-11-28T23:28:41.467 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_special_prefix ... ok 2019-11-28T23:28:49.066 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_copy_zero_size ... ok 2019-11-28T23:28:54.213 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_copy_same_bucket ... ok 2019-11-28T23:28:58.020 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_copy_verify_contenttype ... ok 2019-11-28T23:29:02.325 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_copy_to_itself ... ok 2019-11-28T23:29:06.714 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_copy_to_itself_with_metadata ... ok 2019-11-28T23:29:12.577 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_copy_diff_bucket ... ok 2019-11-28T23:29:17.264 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_copy_not_owned_bucket ... ok 2019-11-28T23:29:24.001 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_copy_not_owned_object_bucket ... ok 2019-11-28T23:29:29.750 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_copy_canned_acl ... ok 2019-11-28T23:29:40.598 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_copy_retaining_metadata ... ok 2019-11-28T23:29:50.540 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_copy_replacing_metadata ... ok 2019-11-28T23:29:53.806 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_copy_bucket_not_found ... ok 2019-11-28T23:29:57.802 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_copy_key_not_found ... ok 2019-11-28T23:30:32.137 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_copy_versioned_bucket ... ok 2019-11-28T23:30:43.208 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_copy_versioned_url_encoding ... ok 2019-11-28T23:30:52.806 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:44:35.024 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:30:52.815 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:44:35.034 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:30:52.822 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:44:35.042 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:30:52.826 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:44:35.046 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:30:52.830 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:44:35.058 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:30:52.843 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:44:35.071 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:30:52.943 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:44:35.162 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:30:52.962 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:44:35.182 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:30:52.982 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:44:35.210 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:32:11.913 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_copy_versioning_multipart_upload ... ok 2019-11-28T23:32:15.237 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_empty ... ok 2019-11-28T23:32:24.336 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_small ... ok 2019-11-28T23:32:42.963 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_small ... ok 2019-11-28T23:32:51.296 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_invalid_range ... ok 2019-11-28T23:33:07.073 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_without_range ... ok 2019-11-28T23:33:22.795 INFO:tasks.rgw.client.0.smithi074.stdout:2019-11-28T23:33:22.786+0000 3fa5e700 -1 handle_data failed with exit code -5 2019-11-28T23:33:49.607 INFO:tasks.rgw.client.0.smithi074.stdout:2019-11-28T23:33:49.575+0000 4025f700 -1 handle_data failed with exit code -5 2019-11-28T23:34:01.274 INFO:tasks.rgw.client.0.smithi074.stdout:2019-11-28T23:34:01.241+0000 4025f700 -1 handle_data failed with exit code -5 2019-11-28T23:34:01.703 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_special_names ... ok 2019-11-28T23:34:28.891 INFO:tasks.rgw.client.0.smithi074.stdout:2019-11-28T23:34:28.783+0000 4025f700 -1 handle_data failed with exit code -5 2019-11-28T23:34:51.336 INFO:tasks.rgw.client.0.smithi074.stdout:2019-11-28T23:34:51.193+0000 4025f700 -1 handle_data failed with exit code -5 2019-11-28T23:34:54.980 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload ... ok 2019-11-28T23:35:38.912 INFO:tasks.rgw.client.0.smithi074.stdout:2019-11-28T23:35:38.892+0000 4025f700 -1 handle_data failed with exit code -5 2019-11-28T23:35:54.863 INFO:tasks.rgw.client.0.smithi074.stdout:2019-11-28T23:35:54.855+0000 3fa5e700 -1 handle_data failed with exit code -5 2019-11-28T23:35:55.560 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:49:37.778 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:35:55.574 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:49:37.792 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:35:55.585 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:49:37.805 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:35:55.600 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:49:37.820 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:35:55.650 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:49:37.877 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:35:55.661 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:49:37.889 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:35:55.747 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:49:37.965 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:35:55.762 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:49:37.982 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:35:55.894 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:49:38.122 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:35:56.137 INFO:tasks.rgw.client.0.smithi074.stdout:2019-11-28T23:35:56.128+0000 3fa5e700 -1 handle_data failed with exit code -5 2019-11-28T23:36:04.016 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:49:46.234 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:36:04.023 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:49:46.241 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:36:04.027 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:49:46.247 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:36:04.035 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:49:46.255 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:36:04.039 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:49:46.266 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:36:04.051 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:49:46.279 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:36:04.056 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:49:46.274 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:36:04.062 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:49:46.282 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:36:04.138 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:49:46.366 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:36:12.892 INFO:tasks.rgw.client.0.smithi074.stdout:2019-11-28T23:36:12.745+0000 40a60700 -1 handle_data failed with exit code -5 2019-11-28T23:36:19.226 INFO:tasks.rgw.client.0.smithi074.stdout:2019-11-28T23:36:19.147+0000 3fa5e700 -1 handle_data failed with exit code -5 2019-11-28T23:36:20.472 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_versioned ... ok 2019-11-28T23:36:57.918 INFO:tasks.rgw.client.0.smithi074.stdout:2019-11-28T23:36:57.871+0000 4025f700 -1 handle_data failed with exit code -5 2019-11-28T23:37:27.179 INFO:tasks.rgw.client.0.smithi074.stdout:2019-11-28T23:37:27.143+0000 4025f700 -1 handle_data failed with exit code -5 2019-11-28T23:37:59.466 INFO:tasks.rgw.client.0.smithi074.stdout:2019-11-28T23:37:59.446+0000 4025f700 -1 handle_data failed with exit code -5 2019-11-28T23:38:23.180 INFO:tasks.rgw.client.0.smithi074.stdout:2019-11-28T23:38:23.173+0000 3fa5e700 -1 handle_data failed with exit code -5 2019-11-28T23:39:02.484 INFO:tasks.rgw.client.0.smithi074.stdout:2019-11-28T23:39:02.475+0000 3fa5e700 -1 handle_data failed with exit code -5 2019-11-28T23:39:28.557 INFO:tasks.rgw.client.0.smithi074.stdout:2019-11-28T23:39:28.473+0000 3fa5e700 -1 handle_data failed with exit code -5 2019-11-28T23:41:16.508 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:54:58.726 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:42:11.369 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:54:58.762 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:42:11.369 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:54:58.778 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:42:11.370 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:54:59.036 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:42:11.370 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:54:58.737 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:42:11.370 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:54:58.942 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:42:11.370 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:54:58.745 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:42:11.370 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:54:58.749 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:42:11.370 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:54:58.918 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:42:11.371 INFO:tasks.rgw.client.0.smithi074.stdout:2019-11-28T23:41:32.481+0000 4025f700 -1 handle_data failed with exit code -5 2019-11-28T23:42:11.371 INFO:tasks.rgw.client.0.smithi074.stdout:2019-11-28T23:42:00.253+0000 3fa5e700 -1 handle_data failed with exit code -5 2019-11-28T23:42:11.371 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_resend_part ... ok 2019-11-28T23:43:13.799 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_multiple_sizes ... ok 2019-11-28T23:43:33.528 INFO:tasks.rgw.client.0.smithi074.stdout:2019-11-28T23:43:33.457+0000 3fa5e700 -1 handle_data failed with exit code -5 2019-11-28T23:43:48.180 INFO:tasks.rgw.client.0.smithi074.stdout:2019-11-28T23:43:48.122+0000 3fa5e700 -1 handle_data failed with exit code -5 2019-11-28T23:44:05.068 INFO:tasks.rgw.client.0.smithi074.stdout:2019-11-28T23:44:05.008+0000 3fa5e700 -1 handle_data failed with exit code -5 2019-11-28T23:44:16.878 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:57:59.097 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:44:16.915 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:57:59.134 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:44:16.931 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:57:59.151 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:44:16.939 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:57:59.159 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:44:16.944 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:57:59.172 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:44:16.946 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:57:59.174 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:44:17.021 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:01:57:59.241 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:44:17.057 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:01:57:59.285 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:44:17.098 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:01:57:59.316 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:44:20.913 INFO:tasks.rgw.client.0.smithi074.stdout:2019-11-28T23:44:20.886+0000 3fa5e700 -1 handle_data failed with exit code -5 2019-11-28T23:44:42.032 INFO:tasks.rgw.client.0.smithi074.stdout:2019-11-28T23:44:41.986+0000 3fa5e700 -1 handle_data failed with exit code -5 2019-11-28T23:44:58.165 INFO:tasks.rgw.client.0.smithi074.stdout:2019-11-28T23:44:58.061+0000 4025f700 -1 handle_data failed with exit code -5 2019-11-28T23:44:59.752 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_multiple_sizes ... ok 2019-11-28T23:45:28.392 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_size_too_small ... ok 2019-11-28T23:45:46.870 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_contents ... ok 2019-11-28T23:46:05.206 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_overwrite_existing_object ... ok 2019-11-28T23:46:17.030 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_abort_multipart_upload ... ok 2019-11-28T23:46:20.792 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_abort_multipart_upload_not_found ... ok 2019-11-28T23:46:27.388 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:00:09.605 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:46:27.395 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:00:09.614 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:46:27.400 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:00:09.621 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:46:27.405 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:00:09.625 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:46:27.408 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:00:09.636 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:46:27.413 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:00:09.640 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:46:27.504 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:00:09.720 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:46:27.508 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:00:09.727 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:46:27.531 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:00:09.758 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:46:43.501 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_list_multipart_upload ... ok 2019-11-28T23:46:49.139 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_missing_part ... ok 2019-11-28T23:46:56.201 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_incorrect_etag ... ok 2019-11-28T23:47:01.079 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_100_continue ... ok 2019-11-28T23:47:04.881 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_set_cors ... ok 2019-11-28T23:47:29.868 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_cors_origin_response ... ok 2019-11-28T23:47:39.298 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_cors_origin_wildcard ... ok 2019-11-28T23:47:46.903 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_cors_header_option ... ok 2019-11-28T23:47:54.638 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_atomic_read_1mb ... ok 2019-11-28T23:48:03.263 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_atomic_read_4mb ... ok 2019-11-28T23:48:15.587 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_atomic_read_8mb ... ok 2019-11-28T23:48:24.069 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_atomic_write_1mb ... ok 2019-11-28T23:48:34.645 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_atomic_write_4mb ... ok 2019-11-28T23:48:48.718 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_atomic_write_8mb ... ok 2019-11-28T23:48:59.474 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_atomic_dual_write_1mb ... ok 2019-11-28T23:49:12.952 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_atomic_dual_write_4mb ... ok 2019-11-28T23:49:33.667 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_atomic_dual_write_8mb ... ok 2019-11-28T23:49:42.520 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_atomic_conditional_write_1mb ... ok 2019-11-28T23:49:48.475 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_atomic_multipart_upload_write ... ok 2019-11-28T23:50:03.180 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_multipart_resend_first_finishes_last ... ok 2019-11-28T23:50:08.308 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_response_code ... ok 2019-11-28T23:50:16.406 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_ranged_big_request_response_code ... ok 2019-11-28T23:50:21.262 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_skip_leading_bytes_response_code ... ok 2019-11-28T23:50:24.793 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_return_trailing_bytes_response_code ... ok 2019-11-28T23:50:28.448 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_invalid_range ... ok 2019-11-28T23:50:31.333 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_empty_object ... ok 2019-11-28T23:50:39.418 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_versioning_bucket_create_suspend ... ok 2019-11-28T23:51:39.453 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:05:21.672 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:51:39.457 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:05:21.676 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:51:39.463 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:05:21.684 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:51:39.466 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:05:21.687 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:51:39.472 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:05:21.699 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:51:39.478 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:05:21.706 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:51:39.636 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:05:21.854 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:51:39.677 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:05:21.905 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:51:39.693 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:05:21.914 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:52:38.277 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:06:20.496 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:52:38.325 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:06:20.544 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:52:38.326 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:06:20.546 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:52:38.330 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:06:20.558 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:52:38.331 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:06:20.551 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:52:38.345 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:06:20.561 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:52:38.369 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:06:20.586 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:52:38.371 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:06:20.591 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:52:38.416 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:06:20.643 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:55:05.838 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_read_remove ... ok 2019-11-28T23:55:51.617 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_read_remove_head ... ok 2019-11-28T23:56:00.827 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_plain_null_version_removal ... ok 2019-11-28T23:56:17.223 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_plain_null_version_overwrite ... ok 2019-11-28T23:56:30.711 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_plain_null_version_overwrite_suspended ... ok 2019-11-28T23:56:51.689 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:10:33.908 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:56:51.701 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:10:33.922 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:56:51.706 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:10:33.926 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:56:51.709 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:10:33.928 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:56:51.723 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:10:33.951 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:56:51.732 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:10:33.960 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:56:51.868 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:10:34.086 9121== Warning: unimplemented fcntl command: 1036 2019-11-28T23:56:52.020 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:10:34.214 8591== Warning: unimplemented fcntl command: 1036 2019-11-28T23:56:52.021 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:10:34.106 9123== Warning: unimplemented fcntl command: 1036 2019-11-28T23:58:16.346 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_suspend_versions ... ok 2019-11-28T23:59:51.637 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_versions_remove_all ... ok 2019-11-29T00:00:59.546 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:14:41.765 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:00:59.573 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:14:41.792 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:00:59.581 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:14:41.801 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:00:59.587 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:14:41.807 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:00:59.595 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:14:41.823 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:00:59.597 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:14:41.824 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:00:59.700 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:14:41.920 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:00:59.709 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:14:41.936 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:00:59.816 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:14:42.034 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:01:59.914 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:15:42.132 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:01:59.928 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:15:42.140 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:01:59.930 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:15:42.158 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:01:59.935 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:15:42.154 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:01:59.935 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:15:42.163 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:01:59.942 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:15:42.162 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:01:59.983 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:15:42.202 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:02:00.000 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:15:42.220 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:02:00.006 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:15:42.233 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:06:38.302 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_versions_remove_special_names ... ok 2019-11-29T00:07:13.866 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:20:56.084 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:07:13.871 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:20:56.089 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:07:13.881 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:20:56.099 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:07:13.884 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:20:56.103 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:07:13.889 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:20:56.116 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:07:13.897 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:20:56.125 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:07:14.065 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:20:56.283 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:07:14.068 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:20:56.288 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:07:14.118 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:20:56.346 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:07:45.974 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:21:28.192 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:07:46.007 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:21:28.225 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:07:46.030 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:21:28.250 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:07:46.042 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:21:28.261 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:07:46.048 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:21:28.266 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:07:46.058 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:21:28.285 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:07:46.062 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:21:28.289 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:07:46.079 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:21:28.298 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:07:46.106 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:21:28.334 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:08:06.150 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_overwrite_multipart ... ok 2019-11-29T00:08:40.616 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_list_marker ... ok 2019-11-29T00:09:15.735 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_versioning_copy_obj_version ... ok 2019-11-29T00:09:21.226 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:23:03.443 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:09:21.257 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:23:03.475 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:09:21.261 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:23:03.481 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:09:21.267 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:23:03.486 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:09:21.306 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:23:03.524 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:09:21.332 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:23:03.552 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:09:21.334 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:23:03.561 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:09:21.341 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:23:03.568 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:09:21.391 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:23:03.618 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:09:34.090 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_versioning_multi_object_delete ... ok 2019-11-29T00:09:59.011 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_versioning_multi_object_delete_with_marker ... ok 2019-11-29T00:10:05.298 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_versioning_multi_object_delete_with_marker_create ... ok 2019-11-29T00:10:23.421 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_versioned_object_acl ... ok 2019-11-29T00:10:42.569 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_versioned_object_acl_no_version_specified ... ok 2019-11-29T00:10:49.959 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_versioned_concurrent_object_create_concurrent_remove ... Exception in thread Thread-52: 2019-11-29T00:10:49.959 INFO:teuthology.orchestra.run.smithi074.stderr:Traceback (most recent call last): 2019-11-29T00:10:49.960 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T00:10:49.960 INFO:teuthology.orchestra.run.smithi074.stderr: self.run() 2019-11-29T00:10:49.960 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T00:10:49.960 INFO:teuthology.orchestra.run.smithi074.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T00:10:49.960 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T00:10:49.961 INFO:teuthology.orchestra.run.smithi074.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T00:10:49.961 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T00:10:49.961 INFO:teuthology.orchestra.run.smithi074.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T00:10:49.961 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T00:10:49.961 INFO:teuthology.orchestra.run.smithi074.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T00:10:49.961 INFO:teuthology.orchestra.run.smithi074.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T00:10:49.961 INFO:teuthology.orchestra.run.smithi074.stderr: 2019-11-29T00:10:50.328 INFO:teuthology.orchestra.run.smithi074.stderr:Exception in thread Thread-51: 2019-11-29T00:10:50.329 INFO:teuthology.orchestra.run.smithi074.stderr:Traceback (most recent call last): 2019-11-29T00:10:50.329 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T00:10:50.329 INFO:teuthology.orchestra.run.smithi074.stderr: self.run() 2019-11-29T00:10:50.329 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T00:10:50.329 INFO:teuthology.orchestra.run.smithi074.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T00:10:50.329 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T00:10:50.330 INFO:teuthology.orchestra.run.smithi074.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T00:10:50.330 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T00:10:50.330 INFO:teuthology.orchestra.run.smithi074.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T00:10:50.330 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T00:10:50.330 INFO:teuthology.orchestra.run.smithi074.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T00:10:50.330 INFO:teuthology.orchestra.run.smithi074.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T00:10:50.330 INFO:teuthology.orchestra.run.smithi074.stderr: 2019-11-29T00:10:50.464 INFO:teuthology.orchestra.run.smithi074.stderr:Exception in thread Thread-54: 2019-11-29T00:10:50.464 INFO:teuthology.orchestra.run.smithi074.stderr:Traceback (most recent call last): 2019-11-29T00:10:50.465 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T00:10:50.465 INFO:teuthology.orchestra.run.smithi074.stderr: self.run() 2019-11-29T00:10:50.465 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T00:10:50.465 INFO:teuthology.orchestra.run.smithi074.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T00:10:50.465 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T00:10:50.465 INFO:teuthology.orchestra.run.smithi074.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T00:10:50.465 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T00:10:50.466 INFO:teuthology.orchestra.run.smithi074.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T00:10:50.466 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T00:10:50.466 INFO:teuthology.orchestra.run.smithi074.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T00:10:50.466 INFO:teuthology.orchestra.run.smithi074.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T00:10:50.466 INFO:teuthology.orchestra.run.smithi074.stderr: 2019-11-29T00:10:50.737 INFO:teuthology.orchestra.run.smithi074.stderr:Exception in thread Thread-55: 2019-11-29T00:10:50.737 INFO:teuthology.orchestra.run.smithi074.stderr:Traceback (most recent call last): 2019-11-29T00:10:50.737 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T00:10:50.737 INFO:teuthology.orchestra.run.smithi074.stderr: self.run() 2019-11-29T00:10:50.737 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T00:10:50.737 INFO:teuthology.orchestra.run.smithi074.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T00:10:50.738 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T00:10:50.738 INFO:teuthology.orchestra.run.smithi074.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T00:10:50.738 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T00:10:50.738 INFO:teuthology.orchestra.run.smithi074.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T00:10:50.738 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T00:10:50.738 INFO:teuthology.orchestra.run.smithi074.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T00:10:50.738 INFO:teuthology.orchestra.run.smithi074.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T00:10:50.739 INFO:teuthology.orchestra.run.smithi074.stderr: 2019-11-29T00:11:03.164 INFO:teuthology.orchestra.run.smithi074.stderr:Exception in thread Thread-65: 2019-11-29T00:11:03.164 INFO:teuthology.orchestra.run.smithi074.stderr:Traceback (most recent call last): 2019-11-29T00:11:03.164 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T00:11:03.164 INFO:teuthology.orchestra.run.smithi074.stderr: self.run() 2019-11-29T00:11:03.164 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T00:11:03.164 INFO:teuthology.orchestra.run.smithi074.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T00:11:03.165 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T00:11:03.165 INFO:teuthology.orchestra.run.smithi074.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T00:11:03.165 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T00:11:03.165 INFO:teuthology.orchestra.run.smithi074.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T00:11:03.165 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T00:11:03.165 INFO:teuthology.orchestra.run.smithi074.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T00:11:03.165 INFO:teuthology.orchestra.run.smithi074.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T00:11:03.166 INFO:teuthology.orchestra.run.smithi074.stderr: 2019-11-29T00:11:03.345 INFO:teuthology.orchestra.run.smithi074.stderr:Exception in thread Thread-62: 2019-11-29T00:11:03.346 INFO:teuthology.orchestra.run.smithi074.stderr:Traceback (most recent call last): 2019-11-29T00:11:03.346 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T00:11:03.346 INFO:teuthology.orchestra.run.smithi074.stderr: self.run() 2019-11-29T00:11:03.346 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T00:11:03.346 INFO:teuthology.orchestra.run.smithi074.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T00:11:03.346 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T00:11:03.346 INFO:teuthology.orchestra.run.smithi074.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T00:11:03.347 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T00:11:03.347 INFO:teuthology.orchestra.run.smithi074.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T00:11:03.347 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T00:11:03.347 INFO:teuthology.orchestra.run.smithi074.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T00:11:03.347 INFO:teuthology.orchestra.run.smithi074.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T00:11:03.347 INFO:teuthology.orchestra.run.smithi074.stderr: 2019-11-29T00:11:03.348 INFO:teuthology.orchestra.run.smithi074.stderr:Exception in thread Thread-64: 2019-11-29T00:11:03.348 INFO:teuthology.orchestra.run.smithi074.stderr:Traceback (most recent call last): 2019-11-29T00:11:03.348 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T00:11:03.348 INFO:teuthology.orchestra.run.smithi074.stderr: self.run() 2019-11-29T00:11:03.348 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T00:11:03.348 INFO:teuthology.orchestra.run.smithi074.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T00:11:03.349 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T00:11:03.349 INFO:teuthology.orchestra.run.smithi074.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T00:11:03.349 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T00:11:03.349 INFO:teuthology.orchestra.run.smithi074.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T00:11:03.349 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T00:11:03.349 INFO:teuthology.orchestra.run.smithi074.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T00:11:03.349 INFO:teuthology.orchestra.run.smithi074.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T00:11:03.349 INFO:teuthology.orchestra.run.smithi074.stderr: 2019-11-29T00:11:03.639 INFO:teuthology.orchestra.run.smithi074.stderr:Exception in thread Thread-63: 2019-11-29T00:11:03.639 INFO:teuthology.orchestra.run.smithi074.stderr:Traceback (most recent call last): 2019-11-29T00:11:03.639 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T00:11:03.639 INFO:teuthology.orchestra.run.smithi074.stderr: self.run() 2019-11-29T00:11:03.640 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T00:11:03.640 INFO:teuthology.orchestra.run.smithi074.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T00:11:03.640 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T00:11:03.640 INFO:teuthology.orchestra.run.smithi074.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T00:11:03.640 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T00:11:03.640 INFO:teuthology.orchestra.run.smithi074.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T00:11:03.641 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T00:11:03.641 INFO:teuthology.orchestra.run.smithi074.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T00:11:03.641 INFO:teuthology.orchestra.run.smithi074.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T00:11:03.641 INFO:teuthology.orchestra.run.smithi074.stderr: 2019-11-29T00:11:13.999 INFO:teuthology.orchestra.run.smithi074.stderr:Exception in thread Thread-73: 2019-11-29T00:11:13.999 INFO:teuthology.orchestra.run.smithi074.stderr:Traceback (most recent call last): 2019-11-29T00:11:13.999 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T00:11:13.999 INFO:teuthology.orchestra.run.smithi074.stderr: self.run() 2019-11-29T00:11:13.999 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T00:11:14.000 INFO:teuthology.orchestra.run.smithi074.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T00:11:14.000 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T00:11:14.000 INFO:teuthology.orchestra.run.smithi074.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T00:11:14.000 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T00:11:14.000 INFO:teuthology.orchestra.run.smithi074.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T00:11:14.000 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T00:11:14.001 INFO:teuthology.orchestra.run.smithi074.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T00:11:14.001 INFO:teuthology.orchestra.run.smithi074.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T00:11:14.001 INFO:teuthology.orchestra.run.smithi074.stderr: 2019-11-29T00:11:14.269 INFO:teuthology.orchestra.run.smithi074.stderr:Exception in thread Thread-72: 2019-11-29T00:11:14.269 INFO:teuthology.orchestra.run.smithi074.stderr:Traceback (most recent call last): 2019-11-29T00:11:14.269 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T00:11:14.269 INFO:teuthology.orchestra.run.smithi074.stderr: self.run() 2019-11-29T00:11:14.270 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T00:11:14.270 INFO:teuthology.orchestra.run.smithi074.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T00:11:14.270 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T00:11:14.270 INFO:teuthology.orchestra.run.smithi074.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T00:11:14.270 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T00:11:14.270 INFO:teuthology.orchestra.run.smithi074.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T00:11:14.270 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T00:11:14.271 INFO:teuthology.orchestra.run.smithi074.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T00:11:14.271 INFO:teuthology.orchestra.run.smithi074.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T00:11:14.271 INFO:teuthology.orchestra.run.smithi074.stderr: 2019-11-29T00:11:14.352 INFO:teuthology.orchestra.run.smithi074.stderr:Exception in thread Thread-74: 2019-11-29T00:11:14.352 INFO:teuthology.orchestra.run.smithi074.stderr:Traceback (most recent call last): 2019-11-29T00:11:14.352 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T00:11:14.353 INFO:teuthology.orchestra.run.smithi074.stderr: self.run() 2019-11-29T00:11:14.353 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T00:11:14.353 INFO:teuthology.orchestra.run.smithi074.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T00:11:14.353 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T00:11:14.353 INFO:teuthology.orchestra.run.smithi074.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T00:11:14.353 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T00:11:14.353 INFO:teuthology.orchestra.run.smithi074.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T00:11:14.354 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T00:11:14.354 INFO:teuthology.orchestra.run.smithi074.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T00:11:14.354 INFO:teuthology.orchestra.run.smithi074.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T00:11:14.354 INFO:teuthology.orchestra.run.smithi074.stderr: 2019-11-29T00:11:14.691 INFO:teuthology.orchestra.run.smithi074.stderr:Exception in thread Thread-75: 2019-11-29T00:11:14.691 INFO:teuthology.orchestra.run.smithi074.stderr:Traceback (most recent call last): 2019-11-29T00:11:14.691 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T00:11:14.691 INFO:teuthology.orchestra.run.smithi074.stderr: self.run() 2019-11-29T00:11:14.691 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T00:11:14.691 INFO:teuthology.orchestra.run.smithi074.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T00:11:14.692 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T00:11:14.692 INFO:teuthology.orchestra.run.smithi074.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T00:11:14.692 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T00:11:14.692 INFO:teuthology.orchestra.run.smithi074.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T00:11:14.692 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T00:11:14.692 INFO:teuthology.orchestra.run.smithi074.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T00:11:14.693 INFO:teuthology.orchestra.run.smithi074.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T00:11:14.693 INFO:teuthology.orchestra.run.smithi074.stderr: 2019-11-29T00:11:25.468 INFO:teuthology.orchestra.run.smithi074.stderr:Exception in thread Thread-85: 2019-11-29T00:11:25.468 INFO:teuthology.orchestra.run.smithi074.stderr:Traceback (most recent call last): 2019-11-29T00:11:25.468 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T00:11:25.468 INFO:teuthology.orchestra.run.smithi074.stderr: self.run() 2019-11-29T00:11:25.469 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T00:11:25.469 INFO:teuthology.orchestra.run.smithi074.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T00:11:25.469 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T00:11:25.469 INFO:teuthology.orchestra.run.smithi074.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T00:11:25.469 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T00:11:25.469 INFO:teuthology.orchestra.run.smithi074.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T00:11:25.469 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T00:11:25.470 INFO:teuthology.orchestra.run.smithi074.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T00:11:25.470 INFO:teuthology.orchestra.run.smithi074.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T00:11:25.470 INFO:teuthology.orchestra.run.smithi074.stderr: 2019-11-29T00:11:26.053 INFO:teuthology.orchestra.run.smithi074.stderr:Exception in thread Thread-84: 2019-11-29T00:11:26.053 INFO:teuthology.orchestra.run.smithi074.stderr:Traceback (most recent call last): 2019-11-29T00:11:26.053 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T00:11:26.053 INFO:teuthology.orchestra.run.smithi074.stderr: self.run() 2019-11-29T00:11:26.054 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T00:11:26.054 INFO:teuthology.orchestra.run.smithi074.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T00:11:26.054 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T00:11:26.054 INFO:teuthology.orchestra.run.smithi074.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T00:11:26.054 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T00:11:26.054 INFO:teuthology.orchestra.run.smithi074.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T00:11:26.054 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T00:11:26.055 INFO:teuthology.orchestra.run.smithi074.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T00:11:26.055 INFO:teuthology.orchestra.run.smithi074.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T00:11:26.055 INFO:teuthology.orchestra.run.smithi074.stderr: 2019-11-29T00:11:26.386 INFO:teuthology.orchestra.run.smithi074.stderr:Exception in thread Thread-81: 2019-11-29T00:11:26.386 INFO:teuthology.orchestra.run.smithi074.stderr:Traceback (most recent call last): 2019-11-29T00:11:26.387 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T00:11:26.387 INFO:teuthology.orchestra.run.smithi074.stderr: self.run() 2019-11-29T00:11:26.387 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T00:11:26.387 INFO:teuthology.orchestra.run.smithi074.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T00:11:26.387 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T00:11:26.387 INFO:teuthology.orchestra.run.smithi074.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T00:11:26.387 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T00:11:26.388 INFO:teuthology.orchestra.run.smithi074.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T00:11:26.388 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T00:11:26.388 INFO:teuthology.orchestra.run.smithi074.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T00:11:26.388 INFO:teuthology.orchestra.run.smithi074.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T00:11:26.388 INFO:teuthology.orchestra.run.smithi074.stderr: 2019-11-29T00:11:26.407 INFO:teuthology.orchestra.run.smithi074.stderr:Exception in thread Thread-82: 2019-11-29T00:11:26.407 INFO:teuthology.orchestra.run.smithi074.stderr:Traceback (most recent call last): 2019-11-29T00:11:26.407 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T00:11:26.407 INFO:teuthology.orchestra.run.smithi074.stderr: self.run() 2019-11-29T00:11:26.407 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T00:11:26.407 INFO:teuthology.orchestra.run.smithi074.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T00:11:26.407 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T00:11:26.408 INFO:teuthology.orchestra.run.smithi074.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T00:11:26.408 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T00:11:26.408 INFO:teuthology.orchestra.run.smithi074.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T00:11:26.408 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T00:11:26.408 INFO:teuthology.orchestra.run.smithi074.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T00:11:26.408 INFO:teuthology.orchestra.run.smithi074.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T00:11:26.408 INFO:teuthology.orchestra.run.smithi074.stderr: 2019-11-29T00:11:37.985 INFO:teuthology.orchestra.run.smithi074.stderr:Exception in thread Thread-95: 2019-11-29T00:11:37.986 INFO:teuthology.orchestra.run.smithi074.stderr:Traceback (most recent call last): 2019-11-29T00:11:37.986 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T00:11:37.986 INFO:teuthology.orchestra.run.smithi074.stderr: self.run() 2019-11-29T00:11:37.986 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T00:11:37.986 INFO:teuthology.orchestra.run.smithi074.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T00:11:37.986 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T00:11:37.986 INFO:teuthology.orchestra.run.smithi074.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T00:11:37.987 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T00:11:37.987 INFO:teuthology.orchestra.run.smithi074.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T00:11:37.987 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T00:11:37.987 INFO:teuthology.orchestra.run.smithi074.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T00:11:37.987 INFO:teuthology.orchestra.run.smithi074.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T00:11:37.987 INFO:teuthology.orchestra.run.smithi074.stderr: 2019-11-29T00:11:38.004 INFO:teuthology.orchestra.run.smithi074.stderr:Exception in thread Thread-93: 2019-11-29T00:11:38.004 INFO:teuthology.orchestra.run.smithi074.stderr:Traceback (most recent call last): 2019-11-29T00:11:38.004 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T00:11:38.004 INFO:teuthology.orchestra.run.smithi074.stderr: self.run() 2019-11-29T00:11:38.005 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T00:11:38.005 INFO:teuthology.orchestra.run.smithi074.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T00:11:38.005 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T00:11:38.005 INFO:teuthology.orchestra.run.smithi074.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T00:11:38.005 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T00:11:38.005 INFO:teuthology.orchestra.run.smithi074.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T00:11:38.005 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T00:11:38.006 INFO:teuthology.orchestra.run.smithi074.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T00:11:38.006 INFO:teuthology.orchestra.run.smithi074.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T00:11:38.006 INFO:teuthology.orchestra.run.smithi074.stderr: 2019-11-29T00:11:38.160 INFO:teuthology.orchestra.run.smithi074.stderr:Exception in thread Thread-94: 2019-11-29T00:11:38.160 INFO:teuthology.orchestra.run.smithi074.stderr:Traceback (most recent call last): 2019-11-29T00:11:38.160 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T00:11:38.160 INFO:teuthology.orchestra.run.smithi074.stderr: self.run() 2019-11-29T00:11:38.160 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T00:11:38.161 INFO:teuthology.orchestra.run.smithi074.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T00:11:38.161 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T00:11:38.161 INFO:teuthology.orchestra.run.smithi074.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T00:11:38.161 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T00:11:38.161 INFO:teuthology.orchestra.run.smithi074.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T00:11:38.161 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T00:11:38.161 INFO:teuthology.orchestra.run.smithi074.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T00:11:38.161 INFO:teuthology.orchestra.run.smithi074.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T00:11:38.162 INFO:teuthology.orchestra.run.smithi074.stderr: 2019-11-29T00:11:38.210 INFO:teuthology.orchestra.run.smithi074.stderr:Exception in thread Thread-91: 2019-11-29T00:11:38.210 INFO:teuthology.orchestra.run.smithi074.stderr:Traceback (most recent call last): 2019-11-29T00:11:38.210 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T00:11:38.210 INFO:teuthology.orchestra.run.smithi074.stderr: self.run() 2019-11-29T00:11:38.211 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T00:11:38.211 INFO:teuthology.orchestra.run.smithi074.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T00:11:38.211 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T00:11:38.211 INFO:teuthology.orchestra.run.smithi074.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T00:11:38.211 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T00:11:38.211 INFO:teuthology.orchestra.run.smithi074.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T00:11:38.211 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T00:11:38.212 INFO:teuthology.orchestra.run.smithi074.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T00:11:38.212 INFO:teuthology.orchestra.run.smithi074.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T00:11:38.212 INFO:teuthology.orchestra.run.smithi074.stderr: 2019-11-29T00:11:45.443 INFO:teuthology.orchestra.run.smithi074.stderr:ok 2019-11-29T00:11:53.223 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_versioned_concurrent_object_create_and_remove ... Exception in thread Thread-102: 2019-11-29T00:11:53.223 INFO:teuthology.orchestra.run.smithi074.stderr:Traceback (most recent call last): 2019-11-29T00:11:53.223 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T00:11:53.224 INFO:teuthology.orchestra.run.smithi074.stderr: self.run() 2019-11-29T00:11:53.224 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T00:11:53.224 INFO:teuthology.orchestra.run.smithi074.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T00:11:53.224 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T00:11:53.224 INFO:teuthology.orchestra.run.smithi074.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T00:11:53.224 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T00:11:53.224 INFO:teuthology.orchestra.run.smithi074.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T00:11:53.225 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T00:11:53.225 INFO:teuthology.orchestra.run.smithi074.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T00:11:53.225 INFO:teuthology.orchestra.run.smithi074.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T00:11:53.225 INFO:teuthology.orchestra.run.smithi074.stderr: 2019-11-29T00:11:53.277 INFO:teuthology.orchestra.run.smithi074.stderr:Exception in thread Thread-104: 2019-11-29T00:11:53.277 INFO:teuthology.orchestra.run.smithi074.stderr:Traceback (most recent call last): 2019-11-29T00:11:53.277 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T00:11:53.277 INFO:teuthology.orchestra.run.smithi074.stderr: self.run() 2019-11-29T00:11:53.278 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T00:11:53.278 INFO:teuthology.orchestra.run.smithi074.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T00:11:53.278 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T00:11:53.278 INFO:teuthology.orchestra.run.smithi074.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T00:11:53.278 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T00:11:53.278 INFO:teuthology.orchestra.run.smithi074.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T00:11:53.279 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T00:11:53.279 INFO:teuthology.orchestra.run.smithi074.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T00:11:53.279 INFO:teuthology.orchestra.run.smithi074.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T00:11:53.279 INFO:teuthology.orchestra.run.smithi074.stderr: 2019-11-29T00:11:53.990 INFO:teuthology.orchestra.run.smithi074.stderr:Exception in thread Thread-103: 2019-11-29T00:11:53.990 INFO:teuthology.orchestra.run.smithi074.stderr:Traceback (most recent call last): 2019-11-29T00:11:53.990 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T00:11:53.990 INFO:teuthology.orchestra.run.smithi074.stderr: self.run() 2019-11-29T00:11:53.991 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T00:11:53.991 INFO:teuthology.orchestra.run.smithi074.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T00:11:53.991 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T00:11:53.991 INFO:teuthology.orchestra.run.smithi074.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T00:11:53.991 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T00:11:53.991 INFO:teuthology.orchestra.run.smithi074.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T00:11:53.991 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T00:11:53.992 INFO:teuthology.orchestra.run.smithi074.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T00:11:53.992 INFO:teuthology.orchestra.run.smithi074.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T00:11:53.992 INFO:teuthology.orchestra.run.smithi074.stderr: 2019-11-29T00:11:53.992 INFO:teuthology.orchestra.run.smithi074.stderr:Exception in thread Thread-105: 2019-11-29T00:11:53.992 INFO:teuthology.orchestra.run.smithi074.stderr:Traceback (most recent call last): 2019-11-29T00:11:53.992 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T00:11:53.993 INFO:teuthology.orchestra.run.smithi074.stderr: self.run() 2019-11-29T00:11:53.993 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T00:11:53.993 INFO:teuthology.orchestra.run.smithi074.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T00:11:53.993 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T00:11:53.993 INFO:teuthology.orchestra.run.smithi074.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T00:11:53.993 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T00:11:53.993 INFO:teuthology.orchestra.run.smithi074.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T00:11:53.994 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T00:11:53.994 INFO:teuthology.orchestra.run.smithi074.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T00:11:53.994 INFO:teuthology.orchestra.run.smithi074.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T00:11:53.994 INFO:teuthology.orchestra.run.smithi074.stderr: 2019-11-29T00:11:54.317 INFO:teuthology.orchestra.run.smithi074.stderr:Exception in thread Thread-109: 2019-11-29T00:11:54.317 INFO:teuthology.orchestra.run.smithi074.stderr:Traceback (most recent call last): 2019-11-29T00:11:54.317 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T00:11:54.317 INFO:teuthology.orchestra.run.smithi074.stderr: self.run() 2019-11-29T00:11:54.317 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T00:11:54.318 INFO:teuthology.orchestra.run.smithi074.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T00:11:54.318 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T00:11:54.318 INFO:teuthology.orchestra.run.smithi074.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T00:11:54.318 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T00:11:54.318 INFO:teuthology.orchestra.run.smithi074.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T00:11:54.318 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T00:11:54.318 INFO:teuthology.orchestra.run.smithi074.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T00:11:54.319 INFO:teuthology.orchestra.run.smithi074.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T00:11:54.319 INFO:teuthology.orchestra.run.smithi074.stderr: 2019-11-29T00:11:54.319 INFO:teuthology.orchestra.run.smithi074.stderr:Exception in thread Thread-107: 2019-11-29T00:11:54.319 INFO:teuthology.orchestra.run.smithi074.stderr:Traceback (most recent call last): 2019-11-29T00:11:54.319 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T00:11:54.320 INFO:teuthology.orchestra.run.smithi074.stderr: self.run() 2019-11-29T00:11:54.320 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T00:11:54.320 INFO:teuthology.orchestra.run.smithi074.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T00:11:54.320 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T00:11:54.320 INFO:teuthology.orchestra.run.smithi074.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T00:11:54.320 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T00:11:54.321 INFO:teuthology.orchestra.run.smithi074.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T00:11:54.321 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T00:11:54.321 INFO:teuthology.orchestra.run.smithi074.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T00:11:54.321 INFO:teuthology.orchestra.run.smithi074.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T00:11:54.321 INFO:teuthology.orchestra.run.smithi074.stderr: 2019-11-29T00:11:54.324 INFO:teuthology.orchestra.run.smithi074.stderr:Exception in thread Thread-106: 2019-11-29T00:11:54.324 INFO:teuthology.orchestra.run.smithi074.stderr:Traceback (most recent call last): 2019-11-29T00:11:54.324 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T00:11:54.324 INFO:teuthology.orchestra.run.smithi074.stderr: self.run() 2019-11-29T00:11:54.325 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T00:11:54.325 INFO:teuthology.orchestra.run.smithi074.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T00:11:54.325 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T00:11:54.325 INFO:teuthology.orchestra.run.smithi074.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T00:11:54.325 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T00:11:54.325 INFO:teuthology.orchestra.run.smithi074.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T00:11:54.325 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T00:11:54.326 INFO:teuthology.orchestra.run.smithi074.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T00:11:54.326 INFO:teuthology.orchestra.run.smithi074.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T00:11:54.326 INFO:teuthology.orchestra.run.smithi074.stderr: 2019-11-29T00:11:54.328 INFO:teuthology.orchestra.run.smithi074.stderr:Exception in thread Thread-108: 2019-11-29T00:11:54.329 INFO:teuthology.orchestra.run.smithi074.stderr:Traceback (most recent call last): 2019-11-29T00:11:54.329 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T00:11:54.329 INFO:teuthology.orchestra.run.smithi074.stderr: self.run() 2019-11-29T00:11:54.329 INFO:teuthology.orchestra.run.smithi074.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T00:11:54.329 INFO:teuthology.orchestra.run.smithi074.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T00:11:54.330 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T00:11:54.330 INFO:teuthology.orchestra.run.smithi074.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T00:11:54.330 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T00:11:54.330 INFO:teuthology.orchestra.run.smithi074.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T00:11:54.330 INFO:teuthology.orchestra.run.smithi074.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T00:11:54.330 INFO:teuthology.orchestra.run.smithi074.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T00:11:54.331 INFO:teuthology.orchestra.run.smithi074.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T00:11:54.331 INFO:teuthology.orchestra.run.smithi074.stderr: 2019-11-29T00:12:09.459 INFO:teuthology.orchestra.run.smithi074.stderr:ok 2019-11-29T00:12:19.204 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set ... ok 2019-11-29T00:12:23.765 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:26:05.980 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:12:23.770 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:26:05.988 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:12:23.776 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:26:06.003 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:12:23.779 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:26:06.007 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:12:23.780 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:26:05.999 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:12:23.784 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:26:06.003 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:12:23.881 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:26:06.099 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:12:23.900 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:26:06.118 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:12:23.906 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:26:06.132 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:12:24.038 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_get ... ok 2019-11-29T00:12:28.360 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_get_no_id ... ok 2019-11-29T00:12:30.429 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_id_too_long ... ok 2019-11-29T00:12:32.792 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_same_id ... ok 2019-11-29T00:12:35.667 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_invalid_status ... ok 2019-11-29T00:12:39.177 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_date ... ok 2019-11-29T00:12:41.344 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_invalid_date ... ok 2019-11-29T00:12:46.461 INFO:teuthology.orchestra.run.smithi074.stderr:Check for valid x-amz-expiration header after PUT ... ok 2019-11-29T00:12:53.951 INFO:teuthology.orchestra.run.smithi074.stderr:Check for valid x-amz-expiration header on HEAD request ... ok 2019-11-29T00:13:00.539 INFO:teuthology.orchestra.run.smithi074.stderr:Check for valid x-amz-expiration header on GET request ... ok 2019-11-29T00:13:10.736 INFO:teuthology.orchestra.run.smithi074.stderr:Check x-amz-expiration-header object tags interaction ... ok 2019-11-29T00:13:16.011 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_noncurrent ... ok 2019-11-29T00:13:19.440 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_deletemarker ... ok 2019-11-29T00:13:23.748 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_filter ... ok 2019-11-29T00:13:28.520 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_empty_filter ... ok 2019-11-29T00:13:32.116 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_multipart ... ok 2019-11-29T00:13:36.108 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_encrypted_transfer_1b ... ok 2019-11-29T00:13:40.811 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_encrypted_transfer_1kb ... ok 2019-11-29T00:13:44.647 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_encrypted_transfer_1MB ... ok 2019-11-29T00:13:49.001 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_encrypted_transfer_13b ... ok 2019-11-29T00:13:52.803 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_method_head ... ok 2019-11-29T00:13:56.877 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_present ... ok 2019-11-29T00:14:00.105 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_other_key ... ok 2019-11-29T00:14:02.980 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_invalid_md5 ... ok 2019-11-29T00:14:06.092 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_no_md5 ... ok 2019-11-29T00:14:07.849 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_no_key ... ok 2019-11-29T00:14:11.796 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_encryption_key_no_sse_c ... ok 2019-11-29T00:15:32.740 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_multipart_upload ... ok 2019-11-29T00:16:09.815 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_multipart_bad_download ... ok 2019-11-29T00:16:15.026 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_post_object_authenticated_request ... ok 2019-11-29T00:16:19.384 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_method_head ... ok 2019-11-29T00:16:23.789 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_present ... ok 2019-11-29T00:16:26.061 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_no_key ... ok 2019-11-29T00:16:28.779 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_not_declared ... ok 2019-11-29T00:17:34.850 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:31:17.068 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:17:34.858 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:31:17.076 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:17:34.866 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:31:17.085 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:17:34.870 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:31:17.090 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:17:34.887 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:31:17.115 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:17:34.903 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:31:17.131 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:17:35.047 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:31:17.264 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:17:35.069 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:31:17.288 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:17:35.159 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:31:17.386 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:17:42.590 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:31:24.807 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:17:42.595 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:31:24.813 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:17:42.630 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:31:24.849 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:17:42.632 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:31:24.851 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:17:42.656 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:31:24.875 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:17:42.658 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:31:24.886 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:17:42.660 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:31:24.888 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:17:42.671 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:31:24.889 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:17:42.689 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:31:24.917 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:17:52.665 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_multipart_upload ... ok 2019-11-29T00:18:23.760 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_multipart_invalid_chunks_1 ... ok 2019-11-29T00:18:52.940 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_multipart_invalid_chunks_2 ... ok 2019-11-29T00:18:56.062 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_post_object_authenticated_request ... ok 2019-11-29T00:18:59.268 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_transfer_1b ... ok 2019-11-29T00:19:02.252 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_transfer_1kb ... ok 2019-11-29T00:19:06.065 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_transfer_1MB ... ok 2019-11-29T00:19:09.630 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_transfer_13b ... ok 2019-11-29T00:19:12.418 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_read_declare ... ok 2019-11-29T00:19:18.402 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy ... ok 2019-11-29T00:19:22.131 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucketv2_policy ... ok 2019-11-29T00:19:28.564 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_acl ... ok 2019-11-29T00:19:36.756 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucketv2_policy_acl ... ok 2019-11-29T00:19:44.012 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_another_bucket ... ok 2019-11-29T00:19:52.221 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucketv2_policy_another_bucket ... ok 2019-11-29T00:19:57.385 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_get_obj_tagging ... ok 2019-11-29T00:20:03.823 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_get_obj_head_tagging ... ok 2019-11-29T00:20:11.313 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_put_max_tags ... ok 2019-11-29T00:20:19.289 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_put_excess_tags ... ok 2019-11-29T00:20:26.425 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_put_max_kvsize_tags ... ok 2019-11-29T00:20:32.258 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_put_excess_key_tags ... ok 2019-11-29T00:20:37.717 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_put_excess_val_tags ... ok 2019-11-29T00:20:45.353 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_put_modify_tags ... ok 2019-11-29T00:20:54.225 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_put_delete_tags ... ok 2019-11-29T00:20:58.071 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_post_object_tags_anonymous_request ... ok 2019-11-29T00:21:01.520 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_post_object_tags_authenticated_request ... ok 2019-11-29T00:21:07.089 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_put_obj_with_tags ... ok 2019-11-29T00:21:15.106 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_get_tags_acl_public ... ok 2019-11-29T00:21:23.363 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_put_tags_acl_public ... ok 2019-11-29T00:21:31.586 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_delete_tags_obj_public ... ok 2019-11-29T00:21:45.313 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_versioning_bucket_atomic_upload_return_version_id ... ok 2019-11-29T00:22:46.450 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:36:28.667 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:22:46.458 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:36:28.676 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:22:46.466 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:36:28.685 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:22:46.470 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:36:28.689 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:22:46.477 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:36:28.705 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:22:46.485 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:36:28.712 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:22:46.641 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:36:28.858 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:22:46.677 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:36:28.905 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:22:46.699 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:36:28.918 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:23:14.570 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_versioning_bucket_multipart_upload_return_version_id ... ok 2019-11-29T00:23:24.006 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_get_obj_existing_tag ... ok 2019-11-29T00:23:36.454 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_get_obj_tagging_existing_tag ... ok 2019-11-29T00:23:50.823 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_tagging_existing_tag ... ok 2019-11-29T00:24:04.692 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_copy_source ... ok 2019-11-29T00:24:15.191 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_copy_source_meta ... ok 2019-11-29T00:24:19.759 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_acl ... ok 2019-11-29T00:24:29.541 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_grant ... ok 2019-11-29T00:24:39.889 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_get_obj_acl_existing_tag ... ok 2019-11-29T00:24:44.125 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock ... ok 2019-11-29T00:24:45.958 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_invalid_bucket ... ok 2019-11-29T00:24:48.828 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_with_days_and_years ... ok 2019-11-29T00:24:51.726 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_invalid_days ... ok 2019-11-29T00:24:54.680 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_invalid_years ... ok 2019-11-29T00:24:56.524 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_invalid_status ... ok 2019-11-29T00:24:58.553 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_lock_suspend_versioning ... ok 2019-11-29T00:25:02.088 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_lock ... ok 2019-11-29T00:25:05.679 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_lock_invalid_bucket ... ok 2019-11-29T00:25:15.393 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention ... ok 2019-11-29T00:25:18.999 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_invalid_bucket ... ok 2019-11-29T00:25:28.782 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_invalid_mode ... ok 2019-11-29T00:25:43.002 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_retention ... ok 2019-11-29T00:25:46.547 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_retention_invalid_bucket ... ok 2019-11-29T00:25:59.622 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_versionid ... ok 2019-11-29T00:26:03.899 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:39:46.117 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:26:03.920 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:39:46.138 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:26:03.944 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:39:46.172 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:26:03.948 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:39:46.176 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:26:03.963 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:39:46.182 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:26:03.966 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:39:46.186 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:26:04.030 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:39:46.248 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:26:04.061 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:39:46.280 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:26:04.074 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:39:46.301 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:26:12.557 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_override_default_retention ... ok 2019-11-29T00:26:23.855 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_increase_period ... ok 2019-11-29T00:26:36.395 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_shorten_period ... ok 2019-11-29T00:26:47.937 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_shorten_period_bypass ... ok 2019-11-29T00:26:58.503 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_lock_delete_object_with_retention ... ok 2019-11-29T00:27:05.650 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_legal_hold ... ok 2019-11-29T00:27:10.157 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_legal_hold_invalid_bucket ... ok 2019-11-29T00:27:16.166 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_legal_hold_invalid_status ... ok 2019-11-29T00:27:26.050 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_legal_hold ... ok 2019-11-29T00:27:30.468 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_legal_hold_invalid_bucket ... ok 2019-11-29T00:27:39.813 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_lock_delete_object_with_legal_hold_on ... ok 2019-11-29T00:27:51.139 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_lock_delete_object_with_legal_hold_off ... ok 2019-11-29T00:27:56.589 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:41:38.807 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:27:56.596 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:41:38.814 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:27:56.604 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:41:38.823 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:27:56.614 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:41:38.829 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:27:56.623 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:41:38.851 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:27:56.637 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:41:38.865 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:27:56.692 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:41:38.910 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:27:56.694 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:41:38.913 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:27:56.765 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:41:38.993 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:28:02.336 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_metadata ... ok 2019-11-29T00:28:14.728 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_s3.test_object_lock_uploading_obj ... ok 2019-11-29T00:28:14.744 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.functional.test_utils.test_generate ... ok 2019-11-29T00:33:10.051 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:46:52.269 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:33:10.057 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:46:52.275 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:33:10.062 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:46:52.281 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:33:10.064 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:46:52.284 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:33:10.065 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:46:52.293 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:33:10.068 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:46:52.296 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:33:10.274 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:46:52.493 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:33:10.274 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:46:52.492 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:33:10.287 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:46:52.515 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:34:25.210 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:48:07.427 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:34:25.254 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:48:07.472 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:34:25.264 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:48:07.483 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:34:25.283 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:48:07.503 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:34:25.293 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:48:07.521 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:34:25.296 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:48:07.523 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:34:25.320 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:48:07.538 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:34:25.346 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:48:07.573 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:34:25.351 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:48:07.571 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:38:23.406 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:52:05.624 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:38:23.410 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:52:05.628 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:38:23.417 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:52:05.644 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:38:23.417 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:52:05.636 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:38:23.420 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:52:05.640 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:38:23.421 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:52:05.649 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:38:23.561 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:52:05.779 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:38:23.574 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:52:05.801 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:38:23.585 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:52:05.804 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:42:46.474 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:56:28.691 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:42:46.487 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:56:28.700 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:42:46.518 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:56:28.737 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:42:46.520 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:56:28.739 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:42:46.535 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:56:28.762 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:42:46.544 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:56:28.772 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:42:46.613 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:56:28.830 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:42:46.640 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:56:28.859 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:42:46.669 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:56:28.896 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:43:33.579 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:57:15.797 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:43:33.585 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:57:15.803 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:43:33.596 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:57:15.816 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:43:33.601 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:57:15.820 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:43:33.605 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:57:15.833 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:43:33.610 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:57:15.837 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:43:33.645 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:02:57:15.863 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:43:33.657 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:02:57:15.877 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:43:33.672 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:02:57:15.900 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:48:37.706 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:02:19.923 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:48:37.713 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:02:19.925 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:48:37.734 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:02:19.962 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:48:37.754 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:02:19.973 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:48:37.757 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:02:19.976 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:48:37.766 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:02:19.994 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:48:37.942 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:02:20.161 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:48:37.994 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:02:20.212 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:48:38.038 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:02:20.266 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:48:43.684 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:02:25.902 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:48:43.692 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:02:25.909 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:48:43.699 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:02:25.918 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:48:43.704 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:02:25.923 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:48:43.714 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:02:25.935 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:48:43.715 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:02:25.933 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:48:43.718 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:02:25.946 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:48:43.726 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:02:25.945 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:48:43.756 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:02:25.984 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:51:08.071 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:04:50.289 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:51:08.116 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:04:50.335 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:51:08.118 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:04:50.336 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:51:08.120 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:04:50.340 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:51:08.126 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:04:50.354 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:51:08.166 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:04:50.393 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:51:08.198 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:04:50.416 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:51:08.230 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:04:50.448 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:51:08.237 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:04:50.465 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:53:54.697 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:07:36.914 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:53:54.705 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:07:36.923 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:53:54.713 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:07:36.932 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:53:54.716 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:07:36.935 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:53:54.727 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:07:36.955 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:53:54.755 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:07:36.983 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:53:54.872 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:07:37.089 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:53:54.876 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:07:37.095 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:53:54.930 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:07:37.157 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:59:08.073 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:12:50.290 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:59:08.081 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:12:50.298 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:59:08.092 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:12:50.320 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:59:08.095 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:12:50.314 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:59:08.098 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:12:50.326 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:59:08.102 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:12:50.321 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:59:08.272 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:12:50.489 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:59:08.304 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:12:50.532 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:59:08.344 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:12:50.562 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:59:29.409 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:13:11.626 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:59:29.440 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:13:11.657 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:59:29.467 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:13:11.685 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T00:59:29.470 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:13:11.698 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:59:29.471 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:13:11.689 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:59:29.477 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:13:11.705 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T00:59:29.477 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:13:11.695 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:59:29.504 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:13:11.722 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T00:59:29.523 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:13:11.751 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:04:18.239 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:18:00.455 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:04:18.262 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:18:00.459 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:04:18.262 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:18:00.469 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:04:18.262 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:18:00.474 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:04:18.268 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:18:00.496 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:04:18.275 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:18:00.503 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:04:18.434 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:18:00.650 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:04:18.446 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:18:00.674 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:04:18.484 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:18:00.702 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:07:50.849 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:21:33.066 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:07:50.869 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:21:33.086 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:07:50.899 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:21:33.117 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:07:50.906 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:21:33.124 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:07:50.913 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:21:33.141 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:07:50.915 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:21:33.143 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:07:50.993 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:21:33.210 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:07:51.018 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:21:33.236 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:07:51.030 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:21:33.258 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:09:30.414 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:23:12.631 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:09:30.426 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:23:12.643 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:09:30.452 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:23:12.671 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:09:30.458 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:23:12.686 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:09:30.461 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:23:12.689 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:09:30.469 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:23:12.687 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:09:30.491 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:23:12.708 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:09:30.532 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:23:12.750 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:09:30.546 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:23:12.774 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:14:43.080 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:28:25.296 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:14:43.114 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:28:25.330 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:14:43.143 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:28:25.362 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:14:43.146 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:28:25.365 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:14:43.149 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:28:25.377 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:14:43.157 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:28:25.385 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:14:43.283 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:28:25.500 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:14:43.342 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:28:25.560 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:14:43.400 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:28:25.628 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:16:12.246 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:29:54.462 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:16:12.256 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:29:54.473 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:16:12.310 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:29:54.528 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:16:12.312 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:29:54.530 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:16:12.323 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:29:54.551 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:16:12.325 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:29:54.553 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:16:12.381 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:29:54.599 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:16:12.398 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:29:54.626 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:16:12.418 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:29:54.635 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:24:33.660 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:38:15.876 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:24:33.698 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:38:15.925 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:24:33.698 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:38:15.907 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:24:33.712 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:38:15.928 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:24:33.723 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:38:15.941 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:24:33.747 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:38:15.975 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:24:33.920 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:38:16.138 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:24:33.976 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:38:16.203 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:24:33.986 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:38:16.202 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:25:05.018 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:38:47.235 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:25:05.032 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:38:47.247 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:25:05.052 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:38:47.278 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:25:05.056 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:38:47.273 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:25:05.078 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:38:47.286 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:25:05.084 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:38:47.281 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:25:05.099 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:38:47.302 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:25:05.118 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:38:47.332 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:25:05.118 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:38:47.322 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:30:16.969 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:43:59.186 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:30:16.998 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:43:59.225 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:30:16.998 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:43:59.192 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:30:16.998 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:43:59.201 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:30:16.999 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:43:59.206 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:30:17.006 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:43:59.234 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:30:17.160 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:43:59.377 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:30:17.235 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:43:59.462 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:30:17.275 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:43:59.493 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:32:55.298 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:46:37.515 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:32:55.341 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:46:37.557 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:32:55.368 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:46:37.586 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:32:55.369 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:46:37.587 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:32:55.383 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:46:37.611 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:32:55.386 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:46:37.614 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:32:55.430 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:46:37.647 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:32:55.448 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:46:37.666 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:32:55.468 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:46:37.696 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:35:29.163 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:49:11.380 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:35:29.175 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:49:11.387 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:35:29.179 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:49:11.397 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:35:29.181 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:49:11.409 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:35:29.183 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:49:11.401 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:35:29.184 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:49:11.412 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:35:29.282 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:49:11.498 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:35:29.282 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:49:11.500 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:35:29.291 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:49:11.519 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:40:41.348 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:54:23.565 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:40:41.378 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:54:23.591 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:40:41.378 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:54:23.597 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:40:41.378 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:54:23.570 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:40:41.378 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:54:23.583 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:40:41.378 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:54:23.588 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:40:41.547 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:54:23.775 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:40:41.576 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:54:23.793 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:40:41.583 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:54:23.802 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:41:16.995 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:54:59.212 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:41:16.999 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:54:59.216 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:41:17.033 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:54:59.252 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:41:17.035 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:54:59.253 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:41:17.045 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:54:59.261 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:41:17.046 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:54:59.274 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:41:17.053 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:54:59.281 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:41:17.065 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:54:59.283 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:41:17.084 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:54:59.313 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:45:53.710 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:59:35.927 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:45:53.805 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:59:35.961 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:45:53.805 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:59:35.971 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:45:53.806 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:59:35.935 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:45:53.806 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:59:35.948 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:45:53.806 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:59:35.952 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:45:53.876 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:03:59:36.093 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:45:53.898 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:03:59:36.117 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:45:53.944 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:03:59:36.173 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:49:38.251 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:03:20.468 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:49:38.450 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:03:20.533 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:49:38.451 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:03:20.541 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:49:38.451 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:03:20.676 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:49:38.451 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:03:20.488 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:49:38.451 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:03:20.584 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:49:38.451 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:03:20.528 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:49:38.451 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:03:20.530 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:49:38.451 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:03:20.664 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:51:03.722 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:04:45.939 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:51:03.748 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:04:45.947 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:51:03.749 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:04:45.956 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:51:03.749 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:04:45.962 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:51:03.749 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:04:45.976 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:51:03.754 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:04:45.983 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:51:03.812 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:04:46.029 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:51:03.832 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:04:46.051 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:51:03.859 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:04:46.088 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:56:15.906 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:09:58.123 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:56:16.001 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:09:58.158 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:56:16.002 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:09:58.167 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:56:16.002 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:09:58.132 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:56:16.002 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:09:58.140 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:56:16.002 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:09:58.146 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:56:16.111 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:09:58.328 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:56:16.121 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:09:58.340 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:56:16.143 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:09:58.369 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:56:36.756 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_load_graph ... ok 2019-11-29T01:56:36.763 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_descend_leaf_node ... ok 2019-11-29T01:56:36.763 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_descend_node ... ok 2019-11-29T01:56:36.763 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_descend_bad_node ... ok 2019-11-29T01:56:36.763 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_descend_nonexistant_child ... ok 2019-11-29T01:56:36.763 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_printable ... ok 2019-11-29T01:56:36.763 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_binary ... ok 2019-11-29T01:56:37.128 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_printable_no_whitespace ... ok 2019-11-29T01:56:37.290 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_binary_no_whitespace ... ok 2019-11-29T01:56:37.625 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_no_args ... ok 2019-11-29T01:56:37.649 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_no_charset ... ok 2019-11-29T01:56:37.668 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_exact_length ... ok 2019-11-29T01:56:37.669 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_bad_charset ... ok 2019-11-29T01:56:37.669 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_missing_length ... ok 2019-11-29T01:56:37.669 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_assemble_decision ... ok 2019-11-29T01:56:37.669 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_escape ... ok 2019-11-29T01:56:37.669 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_indirect ... ok 2019-11-29T01:56:37.669 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_indirect_double ... ok 2019-11-29T01:56:37.669 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_recursive ... ok 2019-11-29T01:56:37.670 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_recursive_mutual ... ok 2019-11-29T01:56:37.670 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_recursive_not_too_eager ... ok 2019-11-29T01:56:37.670 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_make_choice_unweighted_with_space ... ok 2019-11-29T01:56:37.674 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_weighted_choices ... ok 2019-11-29T01:56:37.674 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_null_choices ... ok 2019-11-29T01:56:37.675 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_weighted_null_choices ... ok 2019-11-29T01:56:37.675 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_null_child ... ok 2019-11-29T01:56:37.680 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_weighted_set ... ok 2019-11-29T01:56:37.680 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_header_presence ... ok 2019-11-29T01:56:37.681 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_duplicate_header ... ok 2019-11-29T01:56:37.681 INFO:teuthology.orchestra.run.smithi074.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_headers ... ok 2019-11-29T01:56:37.700 INFO:teuthology.orchestra.run.smithi074.stderr:test_realistic.TestFileValidator.test_new_file_is_valid ... ok 2019-11-29T01:56:37.722 INFO:teuthology.orchestra.run.smithi074.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_on_several_calls ... ok 2019-11-29T01:56:37.722 INFO:teuthology.orchestra.run.smithi074.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_when_size_is_1 ... ok 2019-11-29T01:56:37.866 INFO:teuthology.orchestra.run.smithi074.stderr:test_realistic.TestFiles.test_random_file_valid ... ok 2019-11-29T01:56:37.866 INFO:teuthology.orchestra.run.smithi074.stderr: 2019-11-29T01:56:37.867 INFO:teuthology.orchestra.run.smithi074.stderr:---------------------------------------------------------------------- 2019-11-29T01:56:37.867 INFO:teuthology.orchestra.run.smithi074.stderr:Ran 611 tests in 11451.884s 2019-11-29T01:56:37.867 INFO:teuthology.orchestra.run.smithi074.stderr: 2019-11-29T01:56:37.867 INFO:teuthology.orchestra.run.smithi074.stderr:OK (SKIP=75) 2019-11-29T01:56:37.914 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2019-11-29T01:56:37.915 INFO:teuthology.orchestra.run.smithi074:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2019-11-29T01:56:38.033 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-11-29T01:56:38.034 INFO:tasks.s3tests:Cleaning up boto... 2019-11-29T01:56:38.034 INFO:teuthology.orchestra.run.smithi074:> rm /home/ubuntu/cephtest/boto.cfg 2019-11-29T01:56:38.084 INFO:teuthology.orchestra.run.smithi074:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid bar.client.0 --purge-data --cluster ceph 2019-11-29T01:56:38.197 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.194+0000 7f076aa49ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:38.236 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.234+0000 7f076aa49ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T01:56:38.237 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.234+0000 7f076aa49ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:38.254 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.251+0000 7f076aa49ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T01:56:38.254 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.251+0000 7f076aa49ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:38.269 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.266+0000 7f076aa49ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T01:56:38.269 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.266+0000 7f076aa49ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:38.289 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.286+0000 7f076aa49ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T01:56:38.620 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.617+0000 7f076aa49ec0 20 RGWRados::pool_iterate: got zonegroup_info.cb1773b4-411c-4317-a760-df89ca0f54fc 2019-11-29T01:56:38.621 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.617+0000 7f076aa49ec0 20 RGWRados::pool_iterate: got zone_info.bd5ae442-b074-4d35-94cc-b1d71bd6ac02 2019-11-29T01:56:38.621 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.617+0000 7f076aa49ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T01:56:38.621 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.617+0000 7f076aa49ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T01:56:38.621 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.617+0000 7f076aa49ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:38.639 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.636+0000 7f076aa49ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T01:56:38.639 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.636+0000 7f076aa49ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:38.656 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.652+0000 7f076aa49ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T01:56:38.656 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.652+0000 7f076aa49ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:38.674 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.671+0000 7f076aa49ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T01:56:38.674 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.671+0000 7f076aa49ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:38.687 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.683+0000 7f076aa49ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T01:56:38.687 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.683+0000 7f076aa49ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:38.705 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.702+0000 7f076aa49ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T01:56:38.705 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.702+0000 7f076aa49ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T01:56:38.705 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.702+0000 7f076aa49ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:38.717 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.712+0000 7f076aa49ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T01:56:38.718 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.712+0000 7f076aa49ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:38.733 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.725+0000 7f076aa49ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T01:56:38.733 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.725+0000 7f076aa49ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:38.759 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.756+0000 7f076aa49ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T01:56:38.759 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.756+0000 7f076aa49ec0 20 zonegroup default 2019-11-29T01:56:38.760 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.756+0000 7f076aa49ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:38.780 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.777+0000 7f076aa49ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T01:56:38.781 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.777+0000 7f076aa49ec0 10 Cannot find current period zone using local zone 2019-11-29T01:56:38.781 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.777+0000 7f076aa49ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:38.805 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.801+0000 7f076aa49ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T01:56:38.805 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.801+0000 7f076aa49ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:38.819 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.813+0000 7f076aa49ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T01:56:38.819 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.813+0000 7f076aa49ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:38.829 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.825+0000 7f076aa49ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T01:56:38.829 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.825+0000 7f076aa49ec0 20 zone default found 2019-11-29T01:56:38.829 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.825+0000 7f076aa49ec0 20 started sync module instance, tier type = 2019-11-29T01:56:38.829 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:38.825+0000 7f076aa49ec0 20 started zone id=bd5ae442-b074-4d35-94cc-b1d71bd6ac02 (name=default) with tier type = 2019-11-29T01:56:39.214 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:39.211+0000 7f076aa49ec0 20 add_watcher() i=0 2019-11-29T01:56:39.214 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:39.211+0000 7f076aa49ec0 20 add_watcher() i=1 2019-11-29T01:56:39.214 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:39.211+0000 7f076aa49ec0 20 add_watcher() i=2 2019-11-29T01:56:39.214 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:39.211+0000 7f076aa49ec0 20 add_watcher() i=3 2019-11-29T01:56:39.214 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:39.211+0000 7f076aa49ec0 20 add_watcher() i=4 2019-11-29T01:56:39.215 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:39.211+0000 7f076aa49ec0 20 add_watcher() i=5 2019-11-29T01:56:39.223 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:39.220+0000 7f076aa49ec0 20 add_watcher() i=6 2019-11-29T01:56:39.257 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:39.254+0000 7f076aa49ec0 20 add_watcher() i=7 2019-11-29T01:56:39.258 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:39.254+0000 7f076aa49ec0 2 all 8 watchers are set, enabling cache 2019-11-29T01:56:39.258 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:39.254+0000 7f06abfff700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T01:56:39.264 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:39.261+0000 7f0757c76700 0 -- 172.21.15.74:0/2346000019 >> [v2:172.21.15.74:3300/0,v1:172.21.15.74:6789/0] conn(0x55c2edd86870 msgr2=0x55c2edd8d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-29T01:56:39.353 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:39.351+0000 7f0757475700 0 -- 172.21.15.74:0/3506379482 >> [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] conn(0x55c2edd9e990 msgr2=0x55c2edda0db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T01:56:41.269 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:41.266+0000 7f06967fc700 20 reqs_thread_entry: start 2019-11-29T01:56:41.270 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:41.267+0000 7f068ffff700 20 reqs_thread_entry: start 2019-11-29T01:56:41.270 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:41.267+0000 7f076aa49ec0 20 init_complete bucket index max shards: 0 2019-11-29T01:56:41.270 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:41.268+0000 7f068e7fc700 20 reqs_thread_entry: start 2019-11-29T01:56:41.271 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:41.268+0000 7f076aa49ec0 20 get_system_obj_state: rctx=0x7fff945bbe18 obj=default.rgw.meta:users.uid:bar.client.0 state=0x55c2ede08070 s->prefetch_data=0 2019-11-29T01:56:41.271 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:41.268+0000 7f076aa49ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2019-11-29T01:56:41.286 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:41.282+0000 7f076aa49ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x16 2019-11-29T01:56:41.286 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:41.282+0000 7f076aa49ec0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-29T01:56:41.286 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:41.282+0000 7f076aa49ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T01:56:41.286 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:41.282+0000 7f076aa49ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T01:56:41.286 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:41.282+0000 7f076aa49ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-29T01:56:41.286 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:41.283+0000 7f076aa49ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:41.298 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:41.296+0000 7f076aa49ec0 20 rados_obj.operate() r=0 bl.length=446 2019-11-29T01:56:41.299 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:41.296+0000 7f076aa49ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x11 2019-11-29T01:56:41.299 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:41.296+0000 7f076aa49ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-29T01:56:41.321 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:41.318+0000 7f076aa49ec0 10 removing key index: LQSDDOYHNPOJYWCWYTWN 2019-11-29T01:56:41.321 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:41.318+0000 7f076aa49ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=170 2019-11-29T01:56:41.336 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:41.333+0000 7f073d7fa700 10 RGWWatcher::handle_notify() notify_id 592705486946 cookie 94295702334432 notifier 4971 bl.length()=170 2019-11-29T01:56:41.486 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:41.483+0000 7f076aa49ec0 10 removing email index: bar.client.0+test@test.test 2019-11-29T01:56:41.486 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:41.483+0000 7f076aa49ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=178 2019-11-29T01:56:41.497 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:41.493+0000 7f073d7fa700 10 RGWWatcher::handle_notify() notify_id 592705486947 cookie 94295702334432 notifier 4971 bl.length()=178 2019-11-29T01:56:41.706 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:41.703+0000 7f076aa49ec0 10 removing user buckets index 2019-11-29T01:56:41.706 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:41.703+0000 7f076aa49ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=169 2019-11-29T01:56:41.717 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:41.715+0000 7f073d7fa700 10 RGWWatcher::handle_notify() notify_id 592705487421 cookie 94295702336640 notifier 4971 bl.length()=169 2019-11-29T01:56:41.893 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:41.890+0000 7f076aa49ec0 10 removing user index: bar.client.0 2019-11-29T01:56:41.893 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:41.890+0000 7f076aa49ec0 10 removing default.rgw.meta+users.uid+bar.client.0 from cache 2019-11-29T01:56:41.893 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:41.890+0000 7f076aa49ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=161 2019-11-29T01:56:41.908 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:41.905+0000 7f073d7fa700 10 RGWWatcher::handle_notify() notify_id 592705486948 cookie 94295702334432 notifier 4971 bl.length()=161 2019-11-29T01:56:42.151 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:42.148+0000 7f076aa49ec0 20 remove_watcher() i=0 2019-11-29T01:56:42.151 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:42.148+0000 7f076aa49ec0 2 removed watcher, disabling cache 2019-11-29T01:56:42.209 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:42.206+0000 7f076aa49ec0 20 remove_watcher() i=1 2019-11-29T01:56:42.277 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:42.275+0000 7f076aa49ec0 20 remove_watcher() i=2 2019-11-29T01:56:42.318 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:42.315+0000 7f076aa49ec0 20 remove_watcher() i=3 2019-11-29T01:56:42.379 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:42.376+0000 7f076aa49ec0 20 remove_watcher() i=4 2019-11-29T01:56:42.434 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:42.431+0000 7f076aa49ec0 20 remove_watcher() i=5 2019-11-29T01:56:42.470 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:42.467+0000 7f076aa49ec0 20 remove_watcher() i=6 2019-11-29T01:56:42.508 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:42.505+0000 7f076aa49ec0 20 remove_watcher() i=7 2019-11-29T01:56:42.516 INFO:teuthology.orchestra.run.smithi074:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid foo.client.0 --purge-data --cluster ceph 2019-11-29T01:56:42.630 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:42.627+0000 7fe4c9c72ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:42.660 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:42.657+0000 7fe4c9c72ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T01:56:42.660 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:42.657+0000 7fe4c9c72ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:42.674 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:42.671+0000 7fe4c9c72ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T01:56:42.674 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:42.671+0000 7fe4c9c72ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:42.688 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:42.686+0000 7fe4c9c72ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T01:56:42.689 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:42.686+0000 7fe4c9c72ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:42.705 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:42.702+0000 7fe4c9c72ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T01:56:42.959 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:42.956+0000 7fe4c9c72ec0 20 RGWRados::pool_iterate: got zonegroup_info.cb1773b4-411c-4317-a760-df89ca0f54fc 2019-11-29T01:56:42.959 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:42.956+0000 7fe4c9c72ec0 20 RGWRados::pool_iterate: got zone_info.bd5ae442-b074-4d35-94cc-b1d71bd6ac02 2019-11-29T01:56:42.959 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:42.956+0000 7fe4c9c72ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T01:56:42.960 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:42.956+0000 7fe4c9c72ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T01:56:42.960 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:42.956+0000 7fe4c9c72ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:42.973 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:42.970+0000 7fe4c9c72ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T01:56:42.973 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:42.970+0000 7fe4c9c72ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:42.985 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:42.982+0000 7fe4c9c72ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T01:56:42.985 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:42.982+0000 7fe4c9c72ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:42.997 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:42.994+0000 7fe4c9c72ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T01:56:42.997 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:42.994+0000 7fe4c9c72ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:43.009 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:43.006+0000 7fe4c9c72ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T01:56:43.009 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:43.006+0000 7fe4c9c72ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:43.020 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:43.017+0000 7fe4c9c72ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T01:56:43.020 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:43.017+0000 7fe4c9c72ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T01:56:43.020 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:43.017+0000 7fe4c9c72ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:43.031 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:43.028+0000 7fe4c9c72ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T01:56:43.031 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:43.028+0000 7fe4c9c72ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:43.047 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:43.044+0000 7fe4c9c72ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T01:56:43.047 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:43.044+0000 7fe4c9c72ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:43.057 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:43.055+0000 7fe4c9c72ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T01:56:43.057 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:43.055+0000 7fe4c9c72ec0 20 zonegroup default 2019-11-29T01:56:43.058 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:43.055+0000 7fe4c9c72ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:43.075 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:43.071+0000 7fe4c9c72ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T01:56:43.075 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:43.071+0000 7fe4c9c72ec0 10 Cannot find current period zone using local zone 2019-11-29T01:56:43.075 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:43.071+0000 7fe4c9c72ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:43.089 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:43.086+0000 7fe4c9c72ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T01:56:43.089 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:43.086+0000 7fe4c9c72ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:43.098 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:43.095+0000 7fe4c9c72ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T01:56:43.098 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:43.095+0000 7fe4c9c72ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:43.109 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:43.106+0000 7fe4c9c72ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T01:56:43.109 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:43.106+0000 7fe4c9c72ec0 20 zone default found 2019-11-29T01:56:43.109 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:43.106+0000 7fe4c9c72ec0 20 started sync module instance, tier type = 2019-11-29T01:56:43.109 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:43.106+0000 7fe4c9c72ec0 20 started zone id=bd5ae442-b074-4d35-94cc-b1d71bd6ac02 (name=default) with tier type = 2019-11-29T01:56:43.465 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:43.462+0000 7fe4c9c72ec0 20 add_watcher() i=0 2019-11-29T01:56:43.465 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:43.462+0000 7fe4c9c72ec0 20 add_watcher() i=1 2019-11-29T01:56:43.465 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:43.462+0000 7fe4c9c72ec0 20 add_watcher() i=2 2019-11-29T01:56:43.465 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:43.462+0000 7fe4c9c72ec0 20 add_watcher() i=3 2019-11-29T01:56:43.466 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:43.462+0000 7fe4c9c72ec0 20 add_watcher() i=4 2019-11-29T01:56:43.466 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:43.462+0000 7fe4c9c72ec0 20 add_watcher() i=5 2019-11-29T01:56:43.469 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:43.467+0000 7fe4c9c72ec0 20 add_watcher() i=6 2019-11-29T01:56:43.494 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:43.491+0000 7fe4c9c72ec0 20 add_watcher() i=7 2019-11-29T01:56:43.494 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:43.491+0000 7fe4c9c72ec0 2 all 8 watchers are set, enabling cache 2019-11-29T01:56:43.494 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:43.491+0000 7fe4867ec700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T01:56:43.495 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:43.493+0000 7fe4b6e9f700 0 -- 172.21.15.74:0/1058577903 >> v1:172.21.15.74:6789/0 conn(0x55bfc5615bf0 legacy=0x55bfc5618010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T01:56:43.551 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:43.548+0000 7fe4b6e9f700 0 -- 172.21.15.74:0/2572774885 >> [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] conn(0x55bfc562bea0 msgr2=0x55bfc562e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T01:56:45.545 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:45.542+0000 7fe3fcff9700 20 reqs_thread_entry: start 2019-11-29T01:56:45.545 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:45.543+0000 7fe3f67fc700 20 reqs_thread_entry: start 2019-11-29T01:56:45.546 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:45.543+0000 7fe4c9c72ec0 20 init_complete bucket index max shards: 0 2019-11-29T01:56:45.546 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:45.543+0000 7fe3f4ff9700 20 reqs_thread_entry: start 2019-11-29T01:56:45.546 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:45.543+0000 7fe4c9c72ec0 20 get_system_obj_state: rctx=0x7ffedbce76a8 obj=default.rgw.meta:users.uid:foo.client.0 state=0x55bfc56956e0 s->prefetch_data=0 2019-11-29T01:56:45.547 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:45.543+0000 7fe4c9c72ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2019-11-29T01:56:45.562 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:45.559+0000 7fe4c9c72ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x16 2019-11-29T01:56:45.563 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:45.559+0000 7fe4c9c72ec0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-29T01:56:45.563 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:45.559+0000 7fe4c9c72ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T01:56:45.563 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:45.559+0000 7fe4c9c72ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T01:56:45.563 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:45.559+0000 7fe4c9c72ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-29T01:56:45.563 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:45.560+0000 7fe4c9c72ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:45.577 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:45.574+0000 7fe4c9c72ec0 20 rados_obj.operate() r=0 bl.length=446 2019-11-29T01:56:45.577 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:45.574+0000 7fe4c9c72ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x11 2019-11-29T01:56:45.578 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:45.574+0000 7fe4c9c72ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-29T01:56:45.622 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:45.619+0000 7fe4c9c72ec0 10 removing key index: XGODGXWUWCDXEYUTJVUP 2019-11-29T01:56:45.622 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:45.619+0000 7fe4c9c72ec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=170 2019-11-29T01:56:45.630 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:45.628+0000 7fe4a7fff700 10 RGWWatcher::handle_notify() notify_id 592705486922 cookie 94282138540208 notifier 4637 bl.length()=170 2019-11-29T01:56:45.924 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:45.921+0000 7fe4c9c72ec0 10 removing email index: foo.client.0+test@test.test 2019-11-29T01:56:45.924 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:45.921+0000 7fe4c9c72ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=178 2019-11-29T01:56:45.931 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:45.928+0000 7fe4a7fff700 10 RGWWatcher::handle_notify() notify_id 592705486973 cookie 94282138537440 notifier 4637 bl.length()=178 2019-11-29T01:56:46.696 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:46.693+0000 7fe4c9c72ec0 10 removing user buckets index 2019-11-29T01:56:46.734 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:46.693+0000 7fe4c9c72ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=169 2019-11-29T01:56:46.735 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:46.705+0000 7fe4a7fff700 10 RGWWatcher::handle_notify() notify_id 592705486949 cookie 94282138523712 notifier 4637 bl.length()=169 2019-11-29T01:56:47.055 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:47.053+0000 7fe4c9c72ec0 10 removing user index: foo.client.0 2019-11-29T01:56:47.055 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:47.053+0000 7fe4c9c72ec0 10 removing default.rgw.meta+users.uid+foo.client.0 from cache 2019-11-29T01:56:47.056 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:47.053+0000 7fe4c9c72ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=161 2019-11-29T01:56:47.066 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:47.064+0000 7fe4a7fff700 10 RGWWatcher::handle_notify() notify_id 592705486923 cookie 94282138521728 notifier 4637 bl.length()=161 2019-11-29T01:56:47.357 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:47.354+0000 7fe4c9c72ec0 20 remove_watcher() i=0 2019-11-29T01:56:47.357 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:47.354+0000 7fe4c9c72ec0 2 removed watcher, disabling cache 2019-11-29T01:56:47.409 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:47.407+0000 7fe4c9c72ec0 20 remove_watcher() i=1 2019-11-29T01:56:47.460 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:47.457+0000 7fe4c9c72ec0 20 remove_watcher() i=2 2019-11-29T01:56:47.506 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:47.503+0000 7fe4c9c72ec0 20 remove_watcher() i=3 2019-11-29T01:56:47.541 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:47.538+0000 7fe4c9c72ec0 20 remove_watcher() i=4 2019-11-29T01:56:47.578 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:47.576+0000 7fe4c9c72ec0 20 remove_watcher() i=5 2019-11-29T01:56:47.628 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:47.625+0000 7fe4c9c72ec0 20 remove_watcher() i=6 2019-11-29T01:56:47.674 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:47.672+0000 7fe4c9c72ec0 20 remove_watcher() i=7 2019-11-29T01:56:47.683 INFO:teuthology.orchestra.run.smithi074:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid 'testx$tenanteduser.client.0' --purge-data --cluster ceph 2019-11-29T01:56:47.870 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:47.867+0000 7ff5fcbdeec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:47.897 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:47.895+0000 7ff5fcbdeec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T01:56:47.898 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:47.895+0000 7ff5fcbdeec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:47.908 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:47.905+0000 7ff5fcbdeec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T01:56:47.908 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:47.905+0000 7ff5fcbdeec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:47.926 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:47.923+0000 7ff5fcbdeec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T01:56:47.926 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:47.923+0000 7ff5fcbdeec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:47.944 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:47.941+0000 7ff5fcbdeec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T01:56:48.221 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.218+0000 7ff5fcbdeec0 20 RGWRados::pool_iterate: got zonegroup_info.cb1773b4-411c-4317-a760-df89ca0f54fc 2019-11-29T01:56:48.221 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.218+0000 7ff5fcbdeec0 20 RGWRados::pool_iterate: got zone_info.bd5ae442-b074-4d35-94cc-b1d71bd6ac02 2019-11-29T01:56:48.221 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.218+0000 7ff5fcbdeec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T01:56:48.221 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.218+0000 7ff5fcbdeec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T01:56:48.222 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.218+0000 7ff5fcbdeec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:48.241 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.238+0000 7ff5fcbdeec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T01:56:48.241 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.238+0000 7ff5fcbdeec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:48.258 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.255+0000 7ff5fcbdeec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T01:56:48.259 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.255+0000 7ff5fcbdeec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:48.274 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.271+0000 7ff5fcbdeec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T01:56:48.274 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.271+0000 7ff5fcbdeec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:48.290 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.287+0000 7ff5fcbdeec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T01:56:48.290 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.287+0000 7ff5fcbdeec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:48.315 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.310+0000 7ff5fcbdeec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T01:56:48.315 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.310+0000 7ff5fcbdeec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T01:56:48.315 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.310+0000 7ff5fcbdeec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:48.331 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.328+0000 7ff5fcbdeec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T01:56:48.331 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.328+0000 7ff5fcbdeec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:48.345 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.341+0000 7ff5fcbdeec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T01:56:48.345 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.341+0000 7ff5fcbdeec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:48.364 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.361+0000 7ff5fcbdeec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T01:56:48.365 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.361+0000 7ff5fcbdeec0 20 zonegroup default 2019-11-29T01:56:48.365 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.361+0000 7ff5fcbdeec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:48.377 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.375+0000 7ff5fcbdeec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T01:56:48.377 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.375+0000 7ff5fcbdeec0 10 Cannot find current period zone using local zone 2019-11-29T01:56:48.378 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.375+0000 7ff5fcbdeec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:48.398 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.395+0000 7ff5fcbdeec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T01:56:48.398 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.395+0000 7ff5fcbdeec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:48.414 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.411+0000 7ff5fcbdeec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T01:56:48.414 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.411+0000 7ff5fcbdeec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:48.428 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.425+0000 7ff5fcbdeec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T01:56:48.429 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.425+0000 7ff5fcbdeec0 20 zone default found 2019-11-29T01:56:48.429 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.425+0000 7ff5fcbdeec0 20 started sync module instance, tier type = 2019-11-29T01:56:48.429 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.425+0000 7ff5fcbdeec0 20 started zone id=bd5ae442-b074-4d35-94cc-b1d71bd6ac02 (name=default) with tier type = 2019-11-29T01:56:48.779 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.776+0000 7ff5fcbdeec0 20 add_watcher() i=0 2019-11-29T01:56:48.779 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.776+0000 7ff5fcbdeec0 20 add_watcher() i=1 2019-11-29T01:56:48.780 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.776+0000 7ff5fcbdeec0 20 add_watcher() i=2 2019-11-29T01:56:48.780 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.776+0000 7ff5fcbdeec0 20 add_watcher() i=3 2019-11-29T01:56:48.780 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.776+0000 7ff5fcbdeec0 20 add_watcher() i=4 2019-11-29T01:56:48.780 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.776+0000 7ff5fcbdeec0 20 add_watcher() i=5 2019-11-29T01:56:48.780 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.776+0000 7ff5fcbdeec0 20 add_watcher() i=6 2019-11-29T01:56:48.815 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.812+0000 7ff5fcbdeec0 20 add_watcher() i=7 2019-11-29T01:56:48.815 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.812+0000 7ff5fcbdeec0 2 all 8 watchers are set, enabling cache 2019-11-29T01:56:48.816 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.813+0000 7ff5ba7dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T01:56:48.821 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:48.818+0000 7ff5e9e0b700 0 -- 172.21.15.74:0/1624589179 >> [v2:172.21.15.74:3301/0,v1:172.21.15.74:6790/0] conn(0x55a0eb5aa960 msgr2=0x55a0eb5b1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-29T01:56:49.023 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:49.020+0000 7ff5e9e0b700 0 --2- 172.21.15.74:0/1624589179 >> [v2:172.21.15.74:3301/0,v1:172.21.15.74:6790/0] conn(0x55a0eb5aa960 0x55a0eb5b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-29T01:56:49.066 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:49.063+0000 7ff5ea60c700 0 -- 172.21.15.74:0/1500617936 >> [v2:172.21.15.74:3300/0,v1:172.21.15.74:6789/0] conn(0x55a0eb5b0450 msgr2=0x55a0eb5b0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T01:56:50.496 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:50.493+0000 7ff530ff9700 20 reqs_thread_entry: start 2019-11-29T01:56:50.496 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:50.493+0000 7ff52a7fc700 20 reqs_thread_entry: start 2019-11-29T01:56:50.496 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:50.493+0000 7ff5fcbdeec0 20 init_complete bucket index max shards: 0 2019-11-29T01:56:50.497 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:50.494+0000 7ff528ff9700 20 reqs_thread_entry: start 2019-11-29T01:56:50.497 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:50.494+0000 7ff5fcbdeec0 20 get_system_obj_state: rctx=0x7ffccf4d9a38 obj=default.rgw.meta:users.uid:testx$tenanteduser.client.0 state=0x55a0eb6295f0 s->prefetch_data=0 2019-11-29T01:56:50.497 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:50.494+0000 7ff5fcbdeec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2019-11-29T01:56:50.509 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:50.506+0000 7ff5fcbdeec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x16 2019-11-29T01:56:50.509 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:50.506+0000 7ff5fcbdeec0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-29T01:56:50.509 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:50.506+0000 7ff5fcbdeec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T01:56:50.509 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:50.506+0000 7ff5fcbdeec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T01:56:50.509 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:50.506+0000 7ff5fcbdeec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-29T01:56:50.509 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:50.506+0000 7ff5fcbdeec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:50.529 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:50.526+0000 7ff5fcbdeec0 20 rados_obj.operate() r=0 bl.length=505 2019-11-29T01:56:50.529 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:50.526+0000 7ff5fcbdeec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x11 2019-11-29T01:56:50.529 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:50.526+0000 7ff5fcbdeec0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-29T01:56:50.545 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:50.542+0000 7ff5fcbdeec0 10 removing key index: USROIVIPJVLEJSLOBVRG 2019-11-29T01:56:50.545 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:50.542+0000 7ff5fcbdeec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=170 2019-11-29T01:56:50.555 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:50.552+0000 7ff5caffd700 10 RGWWatcher::handle_notify() notify_id 592705487422 cookie 94149631653808 notifier 5001 bl.length()=170 2019-11-29T01:56:51.065 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:51.062+0000 7ff5fcbdeec0 10 removing email index: testx$tenanteduser.client.0+test@test.test 2019-11-29T01:56:51.066 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:51.063+0000 7ff5fcbdeec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=193 2019-11-29T01:56:51.077 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:51.074+0000 7ff5caffd700 10 RGWWatcher::handle_notify() notify_id 592705486924 cookie 94149631665584 notifier 5001 bl.length()=193 2019-11-29T01:56:51.341 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:51.338+0000 7ff5fcbdeec0 10 removing user buckets index 2019-11-29T01:56:51.341 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:51.338+0000 7ff5fcbdeec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=184 2019-11-29T01:56:51.354 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:51.351+0000 7ff5caffd700 10 RGWWatcher::handle_notify() notify_id 592705486974 cookie 94149631663760 notifier 5001 bl.length()=184 2019-11-29T01:56:51.632 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:51.630+0000 7ff5fcbdeec0 10 removing user index: testx$tenanteduser.client.0 2019-11-29T01:56:51.633 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:51.630+0000 7ff5fcbdeec0 10 removing default.rgw.meta+users.uid+testx$tenanteduser.client.0 from cache 2019-11-29T01:56:51.633 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:51.630+0000 7ff5fcbdeec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=176 2019-11-29T01:56:51.648 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:51.646+0000 7ff5caffd700 10 RGWWatcher::handle_notify() notify_id 592705486950 cookie 94149631660256 notifier 5001 bl.length()=176 2019-11-29T01:56:51.998 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:51.995+0000 7ff5fcbdeec0 20 remove_watcher() i=0 2019-11-29T01:56:51.998 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:51.995+0000 7ff5fcbdeec0 2 removed watcher, disabling cache 2019-11-29T01:56:52.059 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:52.056+0000 7ff5fcbdeec0 20 remove_watcher() i=1 2019-11-29T01:56:52.116 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:52.112+0000 7ff5fcbdeec0 20 remove_watcher() i=2 2019-11-29T01:56:52.166 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:52.163+0000 7ff5fcbdeec0 20 remove_watcher() i=3 2019-11-29T01:56:52.222 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:52.219+0000 7ff5fcbdeec0 20 remove_watcher() i=4 2019-11-29T01:56:52.269 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:52.267+0000 7ff5fcbdeec0 20 remove_watcher() i=5 2019-11-29T01:56:52.329 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:52.326+0000 7ff5fcbdeec0 20 remove_watcher() i=6 2019-11-29T01:56:52.375 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:52.372+0000 7ff5fcbdeec0 20 remove_watcher() i=7 2019-11-29T01:56:52.383 INFO:tasks.s3tests:Removing s3-tests... 2019-11-29T01:56:52.383 INFO:teuthology.orchestra.run.smithi074:> rm -rf /home/ubuntu/cephtest/s3-tests 2019-11-29T01:56:52.519 INFO:teuthology.run_tasks:Running task swift... 2019-11-29T01:56:52.559 INFO:tasks.swift:clients=['client.0'] 2019-11-29T01:56:52.559 INFO:tasks.swift:Downloading swift... 2019-11-29T01:56:52.559 INFO:teuthology.orchestra.run.smithi074:> git clone -b ceph-master git://git.ceph.com/git/swift.git /home/ubuntu/cephtest/swift 2019-11-29T01:56:52.663 INFO:teuthology.orchestra.run.smithi074.stdout:Cloning into '/home/ubuntu/cephtest/swift'... 2019-11-29T01:56:53.070 INFO:tasks.swift:Creating rgw users... 2019-11-29T01:56:53.071 INFO:teuthology.orchestra.run.smithi074:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph user create --subuser foo.client.0:foo --display-name 'Mr. foo.client.0 foo' --secret L2S6FyPk7Vu7GrABiU1lL5M+frrzOfndzwWlec6FFo9ZGYjzSarhvw== --email foo.client.0+test@test.test --key-type swift --access full 2019-11-29T01:56:53.198 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.195+0000 7fd4b5dd8ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:53.238 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.235+0000 7fd4b5dd8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T01:56:53.238 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.235+0000 7fd4b5dd8ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:53.252 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.249+0000 7fd4b5dd8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T01:56:53.252 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.249+0000 7fd4b5dd8ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:53.268 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.266+0000 7fd4b5dd8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T01:56:53.268 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.266+0000 7fd4b5dd8ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:53.287 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.285+0000 7fd4b5dd8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T01:56:53.602 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.599+0000 7fd4b5dd8ec0 20 RGWRados::pool_iterate: got zonegroup_info.cb1773b4-411c-4317-a760-df89ca0f54fc 2019-11-29T01:56:53.602 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.599+0000 7fd4b5dd8ec0 20 RGWRados::pool_iterate: got zone_info.bd5ae442-b074-4d35-94cc-b1d71bd6ac02 2019-11-29T01:56:53.602 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.599+0000 7fd4b5dd8ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T01:56:53.602 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.599+0000 7fd4b5dd8ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T01:56:53.602 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.599+0000 7fd4b5dd8ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:53.618 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.615+0000 7fd4b5dd8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T01:56:53.618 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.615+0000 7fd4b5dd8ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:53.629 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.626+0000 7fd4b5dd8ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T01:56:53.629 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.626+0000 7fd4b5dd8ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:53.643 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.640+0000 7fd4b5dd8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T01:56:53.643 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.640+0000 7fd4b5dd8ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:53.655 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.653+0000 7fd4b5dd8ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T01:56:53.656 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.653+0000 7fd4b5dd8ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:53.669 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.666+0000 7fd4b5dd8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T01:56:53.669 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.666+0000 7fd4b5dd8ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T01:56:53.669 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.666+0000 7fd4b5dd8ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:53.682 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.674+0000 7fd4b5dd8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T01:56:53.682 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.674+0000 7fd4b5dd8ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:53.686 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.684+0000 7fd4b5dd8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T01:56:53.686 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.684+0000 7fd4b5dd8ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:53.696 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.694+0000 7fd4b5dd8ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T01:56:53.697 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.694+0000 7fd4b5dd8ec0 20 zonegroup default 2019-11-29T01:56:53.697 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.694+0000 7fd4b5dd8ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:53.705 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.702+0000 7fd4b5dd8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T01:56:53.705 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.702+0000 7fd4b5dd8ec0 10 Cannot find current period zone using local zone 2019-11-29T01:56:53.705 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.702+0000 7fd4b5dd8ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:53.716 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.714+0000 7fd4b5dd8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T01:56:53.717 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.714+0000 7fd4b5dd8ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:53.727 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.725+0000 7fd4b5dd8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T01:56:53.727 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.725+0000 7fd4b5dd8ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:53.749 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.746+0000 7fd4b5dd8ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T01:56:53.750 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.747+0000 7fd4b5dd8ec0 20 zone default found 2019-11-29T01:56:53.750 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.747+0000 7fd4b5dd8ec0 20 started sync module instance, tier type = 2019-11-29T01:56:53.750 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:53.747+0000 7fd4b5dd8ec0 20 started zone id=bd5ae442-b074-4d35-94cc-b1d71bd6ac02 (name=default) with tier type = 2019-11-29T01:56:54.089 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:54.086+0000 7fd4b5dd8ec0 20 add_watcher() i=0 2019-11-29T01:56:54.089 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:54.086+0000 7fd4b5dd8ec0 20 add_watcher() i=1 2019-11-29T01:56:54.089 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:54.086+0000 7fd4b5dd8ec0 20 add_watcher() i=2 2019-11-29T01:56:54.089 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:54.086+0000 7fd4b5dd8ec0 20 add_watcher() i=3 2019-11-29T01:56:54.089 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:54.086+0000 7fd4b5dd8ec0 20 add_watcher() i=4 2019-11-29T01:56:54.090 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:54.086+0000 7fd4b5dd8ec0 20 add_watcher() i=5 2019-11-29T01:56:54.090 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:54.086+0000 7fd4b5dd8ec0 20 add_watcher() i=6 2019-11-29T01:56:54.126 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:54.124+0000 7fd4b5dd8ec0 20 add_watcher() i=7 2019-11-29T01:56:54.127 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:54.124+0000 7fd4b5dd8ec0 2 all 8 watchers are set, enabling cache 2019-11-29T01:56:54.127 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:54.124+0000 7fd473fdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T01:56:54.127 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:54.124+0000 7fd4a3806700 0 -- >> v1:172.21.15.141:6789/0 conn(0x55a67cd0c160 legacy=0x55a67cd0f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-29T01:56:54.161 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:54.159+0000 7fd4a3005700 0 -- 172.21.15.74:0/4065265650 >> [v2:172.21.15.74:6800/9122,v1:172.21.15.74:6801/9122] conn(0x7fd3e4017580 msgr2=0x7fd3e4019a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-29T01:56:55.862 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:55.858+0000 7fd3e27fc700 20 reqs_thread_entry: start 2019-11-29T01:56:55.862 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:55.859+0000 7fd3dbfff700 20 reqs_thread_entry: start 2019-11-29T01:56:55.862 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:55.859+0000 7fd4b5dd8ec0 20 init_complete bucket index max shards: 0 2019-11-29T01:56:55.862 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:55.859+0000 7fd3da7fc700 20 reqs_thread_entry: start 2019-11-29T01:56:55.863 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:55.859+0000 7fd4b5dd8ec0 20 get_system_obj_state: rctx=0x7ffee17a60c8 obj=default.rgw.meta:users.uid:foo.client.0 state=0x55a67cd8f320 s->prefetch_data=0 2019-11-29T01:56:55.863 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:55.859+0000 7fd4b5dd8ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2019-11-29T01:56:55.868 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:55.865+0000 7fd4b5dd8ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2019-11-29T01:56:55.868 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:55.865+0000 7fd4b5dd8ec0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-29T01:56:55.868 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:55.865+0000 7fd4b5dd8ec0 20 get_system_obj_state: rctx=0x7ffee17a60d8 obj=default.rgw.meta:users.email:foo.client.0+test@test.test state=0x55a67cd910b0 s->prefetch_data=0 2019-11-29T01:56:55.868 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:55.865+0000 7fd4b5dd8ec0 10 cache get: name=default.rgw.meta+users.email+foo.client.0+test@test.test : miss 2019-11-29T01:56:55.910 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:55.907+0000 7fd4b5dd8ec0 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x0 2019-11-29T01:56:55.910 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:55.907+0000 7fd4b5dd8ec0 10 adding default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-11-29T01:56:55.910 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:55.907+0000 7fd4b5dd8ec0 20 get_system_obj_state: rctx=0x7ffee17a5ce8 obj=default.rgw.meta:users.swift:foo.client.0:foo state=0x55a67cd910b0 s->prefetch_data=0 2019-11-29T01:56:55.910 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:55.907+0000 7fd4b5dd8ec0 10 cache get: name=default.rgw.meta+users.swift+foo.client.0:foo : miss 2019-11-29T01:56:55.925 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:55.922+0000 7fd4b5dd8ec0 10 cache put: name=default.rgw.meta+users.swift+foo.client.0:foo info.flags=0x0 2019-11-29T01:56:55.925 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:55.922+0000 7fd4b5dd8ec0 10 adding default.rgw.meta+users.swift+foo.client.0:foo to cache LRU end 2019-11-29T01:56:55.926 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:55.922+0000 7fd4b5dd8ec0 20 get_system_obj_state: rctx=0x7ffee17a5e68 obj=default.rgw.meta:users.swift:foo.client.0:foo state=0x55a67cd91360 s->prefetch_data=0 2019-11-29T01:56:55.926 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:55.922+0000 7fd4b5dd8ec0 10 cache get: name=default.rgw.meta+users.swift+foo.client.0:foo : type miss (requested=0x6, cached=0x0) 2019-11-29T01:56:55.935 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:55.933+0000 7fd4b5dd8ec0 10 cache put: name=default.rgw.meta+users.swift+foo.client.0:foo info.flags=0x0 2019-11-29T01:56:55.935 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:55.933+0000 7fd4b5dd8ec0 10 moving default.rgw.meta+users.swift+foo.client.0:foo to cache LRU end 2019-11-29T01:56:55.983 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:55.980+0000 7fd4b5dd8ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-29T01:56:55.983 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:55.980+0000 7fd4b5dd8ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-29T01:56:55.983 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:55.980+0000 7fd4b5dd8ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=612 2019-11-29T01:56:55.989 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:55.986+0000 7fd498ff9700 10 RGWWatcher::handle_notify() notify_id 592705486925 cookie 94173546921040 notifier 4658 bl.length()=612 2019-11-29T01:56:55.989 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:55.986+0000 7fd498ff9700 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-29T01:56:55.989 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:55.986+0000 7fd498ff9700 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-29T01:56:56.293 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:56.290+0000 7fd4b5dd8ec0 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2019-11-29T01:56:56.293 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:56.290+0000 7fd4b5dd8ec0 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-11-29T01:56:56.293 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:56.290+0000 7fd4b5dd8ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=194 2019-11-29T01:56:56.310 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:56.308+0000 7fd498ff9700 10 RGWWatcher::handle_notify() notify_id 592705486975 cookie 94173546934640 notifier 4658 bl.length()=194 2019-11-29T01:56:56.310 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:56.308+0000 7fd498ff9700 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2019-11-29T01:56:56.311 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:56.308+0000 7fd498ff9700 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-11-29T01:56:56.718 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:56.716+0000 7fd4b5dd8ec0 10 cache put: name=default.rgw.meta+users.swift+foo.client.0:foo info.flags=0x7 2019-11-29T01:56:56.719 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:56.716+0000 7fd4b5dd8ec0 10 moving default.rgw.meta+users.swift+foo.client.0:foo to cache LRU end 2019-11-29T01:56:56.719 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:56.716+0000 7fd4b5dd8ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=183 2019-11-29T01:56:56.729 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:56.726+0000 7fd498ff9700 10 RGWWatcher::handle_notify() notify_id 592705486951 cookie 94173546924416 notifier 4658 bl.length()=183 2019-11-29T01:56:56.729 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:56.726+0000 7fd498ff9700 10 cache put: name=default.rgw.meta+users.swift+foo.client.0:foo info.flags=0x7 2019-11-29T01:56:56.729 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:56.726+0000 7fd498ff9700 10 moving default.rgw.meta+users.swift+foo.client.0:foo to cache LRU end 2019-11-29T01:56:57.197 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:57.194+0000 7fd4b5dd8ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-29T01:56:57.197 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:57.194+0000 7fd4b5dd8ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-29T01:56:57.197 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:57.194+0000 7fd4b5dd8ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=636 2019-11-29T01:56:57.209 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:57.206+0000 7fd498ff9700 10 RGWWatcher::handle_notify() notify_id 592705486926 cookie 94173546921040 notifier 4658 bl.length()=636 2019-11-29T01:56:57.209 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:57.206+0000 7fd498ff9700 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-29T01:56:57.210 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:57.206+0000 7fd498ff9700 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-29T01:56:57.437 INFO:teuthology.orchestra.run.smithi074.stdout:{ 2019-11-29T01:56:57.438 INFO:teuthology.orchestra.run.smithi074.stdout: "user_id": "foo.client.0", 2019-11-29T01:56:57.438 INFO:teuthology.orchestra.run.smithi074.stdout: "display_name": "Mr. foo.client.0 foo", 2019-11-29T01:56:57.438 INFO:teuthology.orchestra.run.smithi074.stdout: "email": "foo.client.0+test@test.test", 2019-11-29T01:56:57.438 INFO:teuthology.orchestra.run.smithi074.stdout: "suspended": 0, 2019-11-29T01:56:57.438 INFO:teuthology.orchestra.run.smithi074.stdout: "max_buckets": 1000, 2019-11-29T01:56:57.439 INFO:teuthology.orchestra.run.smithi074.stdout: "subusers": [ 2019-11-29T01:56:57.439 INFO:teuthology.orchestra.run.smithi074.stdout: { 2019-11-29T01:56:57.439 INFO:teuthology.orchestra.run.smithi074.stdout: "id": "foo.client.0:foo", 2019-11-29T01:56:57.439 INFO:teuthology.orchestra.run.smithi074.stdout: "permissions": "full-control" 2019-11-29T01:56:57.439 INFO:teuthology.orchestra.run.smithi074.stdout: } 2019-11-29T01:56:57.439 INFO:teuthology.orchestra.run.smithi074.stdout: ], 2019-11-29T01:56:57.439 INFO:teuthology.orchestra.run.smithi074.stdout: "keys": [], 2019-11-29T01:56:57.440 INFO:teuthology.orchestra.run.smithi074.stdout: "swift_keys": [ 2019-11-29T01:56:57.440 INFO:teuthology.orchestra.run.smithi074.stdout: { 2019-11-29T01:56:57.440 INFO:teuthology.orchestra.run.smithi074.stdout: "user": "foo.client.0:foo", 2019-11-29T01:56:57.440 INFO:teuthology.orchestra.run.smithi074.stdout: "secret_key": "L2S6FyPk7Vu7GrABiU1lL5M+frrzOfndzwWlec6FFo9ZGYjzSarhvw==" 2019-11-29T01:56:57.440 INFO:teuthology.orchestra.run.smithi074.stdout: } 2019-11-29T01:56:57.440 INFO:teuthology.orchestra.run.smithi074.stdout: ], 2019-11-29T01:56:57.440 INFO:teuthology.orchestra.run.smithi074.stdout: "caps": [], 2019-11-29T01:56:57.441 INFO:teuthology.orchestra.run.smithi074.stdout: "op_mask": "read, write, delete", 2019-11-29T01:56:57.441 INFO:teuthology.orchestra.run.smithi074.stdout: "default_placement": "", 2019-11-29T01:56:57.441 INFO:teuthology.orchestra.run.smithi074.stdout: "default_storage_class": "", 2019-11-29T01:56:57.441 INFO:teuthology.orchestra.run.smithi074.stdout: "placement_tags": [], 2019-11-29T01:56:57.441 INFO:teuthology.orchestra.run.smithi074.stdout: "bucket_quota": { 2019-11-29T01:56:57.441 INFO:teuthology.orchestra.run.smithi074.stdout: "enabled": false, 2019-11-29T01:56:57.441 INFO:teuthology.orchestra.run.smithi074.stdout: "check_on_raw": false, 2019-11-29T01:56:57.441 INFO:teuthology.orchestra.run.smithi074.stdout: "max_size": -1, 2019-11-29T01:56:57.442 INFO:teuthology.orchestra.run.smithi074.stdout: "max_size_kb": 0, 2019-11-29T01:56:57.442 INFO:teuthology.orchestra.run.smithi074.stdout: "max_objects": -1 2019-11-29T01:56:57.442 INFO:teuthology.orchestra.run.smithi074.stdout: }, 2019-11-29T01:56:57.442 INFO:teuthology.orchestra.run.smithi074.stdout: "user_quota": { 2019-11-29T01:56:57.442 INFO:teuthology.orchestra.run.smithi074.stdout: "enabled": false, 2019-11-29T01:56:57.442 INFO:teuthology.orchestra.run.smithi074.stdout: "check_on_raw": false, 2019-11-29T01:56:57.442 INFO:teuthology.orchestra.run.smithi074.stdout: "max_size": -1, 2019-11-29T01:56:57.443 INFO:teuthology.orchestra.run.smithi074.stdout: "max_size_kb": 0, 2019-11-29T01:56:57.443 INFO:teuthology.orchestra.run.smithi074.stdout: "max_objects": -1 2019-11-29T01:56:57.443 INFO:teuthology.orchestra.run.smithi074.stdout: }, 2019-11-29T01:56:57.443 INFO:teuthology.orchestra.run.smithi074.stdout: "temp_url_keys": [], 2019-11-29T01:56:57.443 INFO:teuthology.orchestra.run.smithi074.stdout: "type": "rgw", 2019-11-29T01:56:57.443 INFO:teuthology.orchestra.run.smithi074.stdout: "mfa_ids": [] 2019-11-29T01:56:57.443 INFO:teuthology.orchestra.run.smithi074.stdout:} 2019-11-29T01:56:57.443 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-29T01:56:57.470 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:57.467+0000 7fd4b5dd8ec0 20 remove_watcher() i=0 2019-11-29T01:56:57.470 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:57.467+0000 7fd4b5dd8ec0 2 removed watcher, disabling cache 2019-11-29T01:56:57.524 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:57.521+0000 7fd4b5dd8ec0 20 remove_watcher() i=1 2019-11-29T01:56:57.573 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:57.570+0000 7fd4b5dd8ec0 20 remove_watcher() i=2 2019-11-29T01:56:57.632 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:57.629+0000 7fd4b5dd8ec0 20 remove_watcher() i=3 2019-11-29T01:56:57.688 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:57.686+0000 7fd4b5dd8ec0 20 remove_watcher() i=4 2019-11-29T01:56:57.753 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:57.750+0000 7fd4b5dd8ec0 20 remove_watcher() i=5 2019-11-29T01:56:57.798 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:57.795+0000 7fd4b5dd8ec0 20 remove_watcher() i=6 2019-11-29T01:56:57.828 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:57.824+0000 7fd4b5dd8ec0 20 remove_watcher() i=7 2019-11-29T01:56:57.833 INFO:teuthology.orchestra.run.smithi074:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph user create --subuser bar.client.0:bar --display-name 'Mr. bar.client.0 bar' --secret B6XspQflWQxWZGJ+UTVULhdRlhHxPOMdtPFOMwr/uOGYppOMnlkiTw== --email bar.client.0+test@test.test --key-type swift --access full 2019-11-29T01:56:57.951 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:57.948+0000 7efcfe3d9ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:57.975 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:57.972+0000 7efcfe3d9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T01:56:57.975 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:57.972+0000 7efcfe3d9ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:57.985 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:57.982+0000 7efcfe3d9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T01:56:57.985 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:57.982+0000 7efcfe3d9ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:58.001 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:57.999+0000 7efcfe3d9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T01:56:58.001 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:57.999+0000 7efcfe3d9ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:58.023 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.020+0000 7efcfe3d9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T01:56:58.305 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.301+0000 7efcfe3d9ec0 20 RGWRados::pool_iterate: got zonegroup_info.cb1773b4-411c-4317-a760-df89ca0f54fc 2019-11-29T01:56:58.339 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.301+0000 7efcfe3d9ec0 20 RGWRados::pool_iterate: got zone_info.bd5ae442-b074-4d35-94cc-b1d71bd6ac02 2019-11-29T01:56:58.340 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.301+0000 7efcfe3d9ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T01:56:58.340 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.301+0000 7efcfe3d9ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T01:56:58.340 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.301+0000 7efcfe3d9ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:58.342 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.339+0000 7efcfe3d9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T01:56:58.342 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.339+0000 7efcfe3d9ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:58.356 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.353+0000 7efcfe3d9ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T01:56:58.356 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.353+0000 7efcfe3d9ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:58.367 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.365+0000 7efcfe3d9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T01:56:58.367 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.365+0000 7efcfe3d9ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:58.382 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.379+0000 7efcfe3d9ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T01:56:58.382 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.379+0000 7efcfe3d9ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:58.399 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.396+0000 7efcfe3d9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T01:56:58.399 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.396+0000 7efcfe3d9ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T01:56:58.399 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.396+0000 7efcfe3d9ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:58.408 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.406+0000 7efcfe3d9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T01:56:58.409 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.406+0000 7efcfe3d9ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:58.420 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.417+0000 7efcfe3d9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T01:56:58.420 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.417+0000 7efcfe3d9ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:58.431 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.429+0000 7efcfe3d9ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T01:56:58.431 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.429+0000 7efcfe3d9ec0 20 zonegroup default 2019-11-29T01:56:58.432 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.429+0000 7efcfe3d9ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:58.440 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.438+0000 7efcfe3d9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T01:56:58.440 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.438+0000 7efcfe3d9ec0 10 Cannot find current period zone using local zone 2019-11-29T01:56:58.441 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.438+0000 7efcfe3d9ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:58.481 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.478+0000 7efcfe3d9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T01:56:58.481 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.478+0000 7efcfe3d9ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:58.490 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.487+0000 7efcfe3d9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T01:56:58.490 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.487+0000 7efcfe3d9ec0 20 rados->read ofs=0 len=0 2019-11-29T01:56:58.499 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.496+0000 7efcfe3d9ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T01:56:58.499 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.496+0000 7efcfe3d9ec0 20 zone default found 2019-11-29T01:56:58.499 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.496+0000 7efcfe3d9ec0 20 started sync module instance, tier type = 2019-11-29T01:56:58.499 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.496+0000 7efcfe3d9ec0 20 started zone id=bd5ae442-b074-4d35-94cc-b1d71bd6ac02 (name=default) with tier type = 2019-11-29T01:56:58.795 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.792+0000 7efcfe3d9ec0 20 add_watcher() i=0 2019-11-29T01:56:58.795 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.792+0000 7efcfe3d9ec0 20 add_watcher() i=1 2019-11-29T01:56:58.795 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.792+0000 7efcfe3d9ec0 20 add_watcher() i=2 2019-11-29T01:56:58.795 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.792+0000 7efcfe3d9ec0 20 add_watcher() i=3 2019-11-29T01:56:58.795 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.792+0000 7efcfe3d9ec0 20 add_watcher() i=4 2019-11-29T01:56:58.795 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.792+0000 7efcfe3d9ec0 20 add_watcher() i=5 2019-11-29T01:56:58.796 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.792+0000 7efcfe3d9ec0 20 add_watcher() i=6 2019-11-29T01:56:58.830 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.823+0000 7efceb606700 0 -- 172.21.15.74:0/3794915471 >> [v2:172.21.15.74:6804/10097,v1:172.21.15.74:6805/10097] conn(0x7efcd400f040 msgr2=0x7efcd4011460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T01:56:58.831 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.823+0000 7efcfe3d9ec0 20 add_watcher() i=7 2019-11-29T01:56:58.831 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.823+0000 7efcfe3d9ec0 2 all 8 watchers are set, enabling cache 2019-11-29T01:56:58.831 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.824+0000 7efcbbfdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T01:56:58.850 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:58.848+0000 7efceb606700 0 -- 172.21.15.74:0/3385824736 >> v2:172.21.15.141:3300/0 conn(0x563ec854c9a0 msgr2=0x563ec8551450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T01:56:59.054 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:56:59.051+0000 7efceb606700 0 --2- 172.21.15.74:0/3385824736 >> v2:172.21.15.141:3300/0 conn(0x563ec854c9a0 0x563ec8551450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-29T01:57:00.354 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:00.351+0000 7efc2a7fc700 20 reqs_thread_entry: start 2019-11-29T01:57:00.354 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:00.351+0000 7efc23fff700 20 reqs_thread_entry: start 2019-11-29T01:57:00.354 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:00.351+0000 7efcfe3d9ec0 20 init_complete bucket index max shards: 0 2019-11-29T01:57:00.355 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:00.352+0000 7efc227fc700 20 reqs_thread_entry: start 2019-11-29T01:57:00.355 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:00.352+0000 7efcfe3d9ec0 20 get_system_obj_state: rctx=0x7ffc1b63f648 obj=default.rgw.meta:users.uid:bar.client.0 state=0x563ec85c76b0 s->prefetch_data=0 2019-11-29T01:57:00.355 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:00.352+0000 7efcfe3d9ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2019-11-29T01:57:00.360 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:00.357+0000 7efcfe3d9ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2019-11-29T01:57:00.360 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:00.357+0000 7efcfe3d9ec0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-29T01:57:00.360 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:00.357+0000 7efcfe3d9ec0 20 get_system_obj_state: rctx=0x7ffc1b63f658 obj=default.rgw.meta:users.email:bar.client.0+test@test.test state=0x563ec85c9440 s->prefetch_data=0 2019-11-29T01:57:00.360 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:00.357+0000 7efcfe3d9ec0 10 cache get: name=default.rgw.meta+users.email+bar.client.0+test@test.test : miss 2019-11-29T01:57:00.365 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:00.363+0000 7efcfe3d9ec0 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x0 2019-11-29T01:57:00.366 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:00.363+0000 7efcfe3d9ec0 10 adding default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-11-29T01:57:00.366 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:00.363+0000 7efcfe3d9ec0 20 get_system_obj_state: rctx=0x7ffc1b63f268 obj=default.rgw.meta:users.swift:bar.client.0:bar state=0x563ec85c9440 s->prefetch_data=0 2019-11-29T01:57:00.366 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:00.363+0000 7efcfe3d9ec0 10 cache get: name=default.rgw.meta+users.swift+bar.client.0:bar : miss 2019-11-29T01:57:00.374 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:00.372+0000 7efcfe3d9ec0 10 cache put: name=default.rgw.meta+users.swift+bar.client.0:bar info.flags=0x0 2019-11-29T01:57:00.375 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:00.372+0000 7efcfe3d9ec0 10 adding default.rgw.meta+users.swift+bar.client.0:bar to cache LRU end 2019-11-29T01:57:00.375 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:00.372+0000 7efcfe3d9ec0 20 get_system_obj_state: rctx=0x7ffc1b63f3e8 obj=default.rgw.meta:users.swift:bar.client.0:bar state=0x563ec85c96f0 s->prefetch_data=0 2019-11-29T01:57:00.375 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:00.372+0000 7efcfe3d9ec0 10 cache get: name=default.rgw.meta+users.swift+bar.client.0:bar : type miss (requested=0x6, cached=0x0) 2019-11-29T01:57:00.383 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:00.380+0000 7efcfe3d9ec0 10 cache put: name=default.rgw.meta+users.swift+bar.client.0:bar info.flags=0x0 2019-11-29T01:57:00.383 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:00.380+0000 7efcfe3d9ec0 10 moving default.rgw.meta+users.swift+bar.client.0:bar to cache LRU end 2019-11-29T01:57:00.421 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:00.418+0000 7efcfe3d9ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-29T01:57:00.422 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:00.418+0000 7efcfe3d9ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-29T01:57:00.422 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:00.418+0000 7efcfe3d9ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=612 2019-11-29T01:57:00.431 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:00.428+0000 7efce0ff9700 10 RGWWatcher::handle_notify() notify_id 592705486952 cookie 94827648836096 notifier 4673 bl.length()=612 2019-11-29T01:57:00.431 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:00.428+0000 7efce0ff9700 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-29T01:57:00.431 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:00.428+0000 7efce0ff9700 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-29T01:57:01.052 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:01.049+0000 7efcfe3d9ec0 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2019-11-29T01:57:01.053 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:01.049+0000 7efcfe3d9ec0 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-11-29T01:57:01.053 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:01.050+0000 7efcfe3d9ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=194 2019-11-29T01:57:01.066 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:01.064+0000 7efce0ff9700 10 RGWWatcher::handle_notify() notify_id 592705486953 cookie 94827648836096 notifier 4673 bl.length()=194 2019-11-29T01:57:01.067 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:01.064+0000 7efce0ff9700 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2019-11-29T01:57:01.067 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:01.064+0000 7efce0ff9700 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-11-29T01:57:01.428 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:01.425+0000 7efcfe3d9ec0 10 cache put: name=default.rgw.meta+users.swift+bar.client.0:bar info.flags=0x7 2019-11-29T01:57:01.428 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:01.425+0000 7efcfe3d9ec0 10 moving default.rgw.meta+users.swift+bar.client.0:bar to cache LRU end 2019-11-29T01:57:01.428 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:01.425+0000 7efcfe3d9ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=183 2019-11-29T01:57:01.443 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:01.440+0000 7efce0ff9700 10 RGWWatcher::handle_notify() notify_id 592705486954 cookie 94827648879136 notifier 4673 bl.length()=183 2019-11-29T01:57:01.443 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:01.441+0000 7efce0ff9700 10 cache put: name=default.rgw.meta+users.swift+bar.client.0:bar info.flags=0x7 2019-11-29T01:57:01.443 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:01.441+0000 7efce0ff9700 10 moving default.rgw.meta+users.swift+bar.client.0:bar to cache LRU end 2019-11-29T01:57:01.777 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:01.774+0000 7efcfe3d9ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-29T01:57:01.777 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:01.774+0000 7efcfe3d9ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-29T01:57:01.777 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:01.774+0000 7efcfe3d9ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=636 2019-11-29T01:57:01.811 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:01.808+0000 7efce0ff9700 10 RGWWatcher::handle_notify() notify_id 592705486955 cookie 94827648836096 notifier 4673 bl.length()=636 2019-11-29T01:57:01.811 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:01.808+0000 7efce0ff9700 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-29T01:57:01.811 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:01.808+0000 7efce0ff9700 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-29T01:57:02.315 INFO:teuthology.orchestra.run.smithi074.stdout:{ 2019-11-29T01:57:02.315 INFO:teuthology.orchestra.run.smithi074.stdout: "user_id": "bar.client.0", 2019-11-29T01:57:02.315 INFO:teuthology.orchestra.run.smithi074.stdout: "display_name": "Mr. bar.client.0 bar", 2019-11-29T01:57:02.316 INFO:teuthology.orchestra.run.smithi074.stdout: "email": "bar.client.0+test@test.test", 2019-11-29T01:57:02.316 INFO:teuthology.orchestra.run.smithi074.stdout: "suspended": 0, 2019-11-29T01:57:02.316 INFO:teuthology.orchestra.run.smithi074.stdout: "max_buckets": 1000, 2019-11-29T01:57:02.316 INFO:teuthology.orchestra.run.smithi074.stdout: "subusers": [ 2019-11-29T01:57:02.316 INFO:teuthology.orchestra.run.smithi074.stdout: { 2019-11-29T01:57:02.316 INFO:teuthology.orchestra.run.smithi074.stdout: "id": "bar.client.0:bar", 2019-11-29T01:57:02.316 INFO:teuthology.orchestra.run.smithi074.stdout: "permissions": "full-control" 2019-11-29T01:57:02.317 INFO:teuthology.orchestra.run.smithi074.stdout: } 2019-11-29T01:57:02.317 INFO:teuthology.orchestra.run.smithi074.stdout: ], 2019-11-29T01:57:02.317 INFO:teuthology.orchestra.run.smithi074.stdout: "keys": [], 2019-11-29T01:57:02.317 INFO:teuthology.orchestra.run.smithi074.stdout: "swift_keys": [ 2019-11-29T01:57:02.317 INFO:teuthology.orchestra.run.smithi074.stdout: { 2019-11-29T01:57:02.317 INFO:teuthology.orchestra.run.smithi074.stdout: "user": "bar.client.0:bar", 2019-11-29T01:57:02.317 INFO:teuthology.orchestra.run.smithi074.stdout: "secret_key": "B6XspQflWQxWZGJ+UTVULhdRlhHxPOMdtPFOMwr/uOGYppOMnlkiTw==" 2019-11-29T01:57:02.318 INFO:teuthology.orchestra.run.smithi074.stdout: } 2019-11-29T01:57:02.318 INFO:teuthology.orchestra.run.smithi074.stdout: ], 2019-11-29T01:57:02.318 INFO:teuthology.orchestra.run.smithi074.stdout: "caps": [], 2019-11-29T01:57:02.318 INFO:teuthology.orchestra.run.smithi074.stdout: "op_mask": "read, write, delete", 2019-11-29T01:57:02.318 INFO:teuthology.orchestra.run.smithi074.stdout: "default_placement": "", 2019-11-29T01:57:02.318 INFO:teuthology.orchestra.run.smithi074.stdout: "default_storage_class": "", 2019-11-29T01:57:02.318 INFO:teuthology.orchestra.run.smithi074.stdout: "placement_tags": [], 2019-11-29T01:57:02.318 INFO:teuthology.orchestra.run.smithi074.stdout: "bucket_quota": { 2019-11-29T01:57:02.319 INFO:teuthology.orchestra.run.smithi074.stdout: "enabled": false, 2019-11-29T01:57:02.319 INFO:teuthology.orchestra.run.smithi074.stdout: "check_on_raw": false, 2019-11-29T01:57:02.319 INFO:teuthology.orchestra.run.smithi074.stdout: "max_size": -1, 2019-11-29T01:57:02.319 INFO:teuthology.orchestra.run.smithi074.stdout: "max_size_kb": 0, 2019-11-29T01:57:02.319 INFO:teuthology.orchestra.run.smithi074.stdout: "max_objects": -1 2019-11-29T01:57:02.319 INFO:teuthology.orchestra.run.smithi074.stdout: }, 2019-11-29T01:57:02.319 INFO:teuthology.orchestra.run.smithi074.stdout: "user_quota": { 2019-11-29T01:57:02.320 INFO:teuthology.orchestra.run.smithi074.stdout: "enabled": false, 2019-11-29T01:57:02.320 INFO:teuthology.orchestra.run.smithi074.stdout: "check_on_raw": false, 2019-11-29T01:57:02.320 INFO:teuthology.orchestra.run.smithi074.stdout: "max_size": -1, 2019-11-29T01:57:02.320 INFO:teuthology.orchestra.run.smithi074.stdout: "max_size_kb": 0, 2019-11-29T01:57:02.320 INFO:teuthology.orchestra.run.smithi074.stdout: "max_objects": -1 2019-11-29T01:57:02.320 INFO:teuthology.orchestra.run.smithi074.stdout: }, 2019-11-29T01:57:02.321 INFO:teuthology.orchestra.run.smithi074.stdout: "temp_url_keys": [], 2019-11-29T01:57:02.321 INFO:teuthology.orchestra.run.smithi074.stdout: "type": "rgw", 2019-11-29T01:57:02.321 INFO:teuthology.orchestra.run.smithi074.stdout: "mfa_ids": [] 2019-11-29T01:57:02.321 INFO:teuthology.orchestra.run.smithi074.stdout:} 2019-11-29T01:57:02.321 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-29T01:57:02.369 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:02.366+0000 7efcfe3d9ec0 20 remove_watcher() i=0 2019-11-29T01:57:02.369 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:02.366+0000 7efcfe3d9ec0 2 removed watcher, disabling cache 2019-11-29T01:57:02.427 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:02.424+0000 7efcfe3d9ec0 20 remove_watcher() i=1 2019-11-29T01:57:02.490 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:02.488+0000 7efcfe3d9ec0 20 remove_watcher() i=2 2019-11-29T01:57:02.530 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:02.528+0000 7efcfe3d9ec0 20 remove_watcher() i=3 2019-11-29T01:57:02.577 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:02.574+0000 7efcfe3d9ec0 20 remove_watcher() i=4 2019-11-29T01:57:02.626 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:02.623+0000 7efcfe3d9ec0 20 remove_watcher() i=5 2019-11-29T01:57:02.682 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:02.680+0000 7efcfe3d9ec0 20 remove_watcher() i=6 2019-11-29T01:57:02.746 INFO:teuthology.orchestra.run.smithi074.stderr:2019-11-29T01:57:02.743+0000 7efcfe3d9ec0 20 remove_watcher() i=7 2019-11-29T01:57:02.756 INFO:tasks.swift:Configuring testswift... 2019-11-29T01:57:02.756 INFO:teuthology.orchestra.run.smithi074:> cd /home/ubuntu/cephtest/swift && ./bootstrap 2019-11-29T01:57:05.231 INFO:teuthology.orchestra.run.smithi074.stdout:New python executable in /home/ubuntu/cephtest/swift/virtualenv/bin/python 2019-11-29T01:57:06.492 INFO:teuthology.orchestra.run.smithi074.stdout:Installing setuptools, pip, wheel...done. 2019-11-29T01:57:06.769 INFO:teuthology.orchestra.run.smithi074.stderr:Cache entry deserialization failed, entry ignored 2019-11-29T01:57:06.965 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting pip 2019-11-29T01:57:07.043 INFO:teuthology.orchestra.run.smithi074.stdout: Using cached https://files.pythonhosted.org/packages/00/b6/9cfa56b4081ad13874b0c6f96af8ce16cfbc1cb06bedf8e9164ce5551ec1/pip-19.3.1-py2.py3-none-any.whl 2019-11-29T01:57:07.106 INFO:teuthology.orchestra.run.smithi074.stdout:Installing collected packages: pip 2019-11-29T01:57:07.106 INFO:teuthology.orchestra.run.smithi074.stdout: Found existing installation: pip 9.0.1 2019-11-29T01:57:07.165 INFO:teuthology.orchestra.run.smithi074.stdout: Uninstalling pip-9.0.1: 2019-11-29T01:57:07.205 INFO:teuthology.orchestra.run.smithi074.stdout: Successfully uninstalled pip-9.0.1 2019-11-29T01:57:07.802 INFO:teuthology.orchestra.run.smithi074.stdout:Successfully installed pip-19.3.1 2019-11-29T01:57:08.087 INFO:teuthology.orchestra.run.smithi074.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-29T01:57:08.576 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting setuptools==32.3.1 2019-11-29T01:57:08.576 INFO:teuthology.orchestra.run.smithi074.stdout: Using cached https://files.pythonhosted.org/packages/69/19/b1dff551058ce79d88b1e3688f1c735590d7ddf44d10681512133b35019f/setuptools-32.3.1-py2.py3-none-any.whl 2019-11-29T01:57:08.619 INFO:teuthology.orchestra.run.smithi074.stdout:Installing collected packages: setuptools 2019-11-29T01:57:08.619 INFO:teuthology.orchestra.run.smithi074.stdout: Found existing installation: setuptools 28.8.0 2019-11-29T01:57:08.634 INFO:teuthology.orchestra.run.smithi074.stdout: Uninstalling setuptools-28.8.0: 2019-11-29T01:57:08.643 INFO:teuthology.orchestra.run.smithi074.stdout: Successfully uninstalled setuptools-28.8.0 2019-11-29T01:57:08.767 INFO:teuthology.orchestra.run.smithi074.stdout:Successfully installed setuptools-32.3.1 2019-11-29T01:57:09.182 INFO:teuthology.orchestra.run.smithi074.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-29T01:57:09.414 INFO:teuthology.orchestra.run.smithi074.stdout:Processing /home/ubuntu/.cache/pip/wheels/d9/45/dd/65f0b38450c47cf7e5312883deb97d065e030c5cca0a365030/PyYAML-5.1.2-cp27-cp27mu-linux_x86_64.whl 2019-11-29T01:57:09.487 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting nose>=1.0.0 2019-11-29T01:57:09.490 INFO:teuthology.orchestra.run.smithi074.stdout: Using cached https://files.pythonhosted.org/packages/99/4f/13fb671119e65c4dce97c60e67d3fd9e6f7f809f2b307e2611f4701205cb/nose-1.3.7-py2-none-any.whl 2019-11-29T01:57:09.637 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting boto>=2.0b4 2019-11-29T01:57:09.645 INFO:teuthology.orchestra.run.smithi074.stdout: Using cached https://files.pythonhosted.org/packages/23/10/c0b78c27298029e4454a472a1919bde20cb182dab1662cec7f2ca1dcc523/boto-2.49.0-py2.py3-none-any.whl 2019-11-29T01:57:09.818 INFO:teuthology.orchestra.run.smithi074.stdout:Processing /home/ubuntu/.cache/pip/wheels/56/0f/19/fbbf81e5764e6d8b74501c4357a88c14c94466ec777c03734c/bunch-1.0.1-cp27-none-any.whl 2019-11-29T01:57:10.147 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting gevent>=0.14 2019-11-29T01:57:10.160 INFO:teuthology.orchestra.run.smithi074.stdout: Using cached https://files.pythonhosted.org/packages/e6/e9/3a693414f706e12abe60554cd73c5ae8f848b182ae58018f93d86c9eb418/gevent-1.4.0-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-29T01:57:10.420 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting isodate>=0.4.4 2019-11-29T01:57:10.421 INFO:teuthology.orchestra.run.smithi074.stdout: Using cached https://files.pythonhosted.org/packages/9b/9f/b36f7774ff5ea8e428fdcfc4bb332c39ee5b9362ddd3d40d9516a55221b2/isodate-0.6.0-py2.py3-none-any.whl 2019-11-29T01:57:10.480 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting eventlet>=0.9.14 2019-11-29T01:57:10.539 INFO:teuthology.orchestra.run.smithi074.stdout: Downloading https://files.pythonhosted.org/packages/ef/01/83454d11bac9015f34e93cf11efcae169390ddf2df97cb73ca86de6465ed/eventlet-0.25.1-py2.py3-none-any.whl (222kB) 2019-11-29T01:57:10.737 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting netifaces>=0.5 2019-11-29T01:57:10.749 INFO:teuthology.orchestra.run.smithi074.stdout: Downloading https://files.pythonhosted.org/packages/7e/02/ad1a92a72620cc17d448fe4dbdfbdf8fe1487ee7bfd82bb48308712c2f3c/netifaces-0.10.9-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-29T01:57:10.834 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting xattr<0.7.0,>=0.6 2019-11-29T01:57:10.846 INFO:teuthology.orchestra.run.smithi074.stdout: Downloading https://files.pythonhosted.org/packages/c5/80/b25d549ae4bf4f3e9635a331b759ffca2de4dd8a78dc5106d1ca92f5d08d/xattr-0.6.4.tar.gz 2019-11-29T01:57:11.248 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting simplejson>=2.1.3 2019-11-29T01:57:11.259 INFO:teuthology.orchestra.run.smithi074.stdout: Downloading https://files.pythonhosted.org/packages/98/87/a7b98aa9256c8843f92878966dc3d8d914c14aad97e2c5ce4798d5743e07/simplejson-3.17.0.tar.gz (83kB) 2019-11-29T01:57:11.612 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting WebOb==1.0 2019-11-29T01:57:11.623 INFO:teuthology.orchestra.run.smithi074.stdout: Downloading https://files.pythonhosted.org/packages/bc/eb/91b8dd8f3a8d3c3943bf27a2d322501ad8b227bf29f59e792c2eae092bc9/WebOb-1.0.tar.gz (210kB) 2019-11-29T01:57:12.018 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting greenlet>=0.4.14; platform_python_implementation == "CPython" 2019-11-29T01:57:12.019 INFO:teuthology.orchestra.run.smithi074.stdout: Using cached https://files.pythonhosted.org/packages/8b/6e/f2d25875713ad0885c8d3c69269697406652e6f64e1a6bd8264f7a609327/greenlet-0.4.15-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-29T01:57:12.093 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting six 2019-11-29T01:57:12.095 INFO:teuthology.orchestra.run.smithi074.stdout: Using cached https://files.pythonhosted.org/packages/65/26/32b8464df2a97e6dd1b656ed26b2c194606c16fe163c695a992b36c11cdf/six-1.13.0-py2.py3-none-any.whl 2019-11-29T01:57:12.150 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting monotonic>=1.4 2019-11-29T01:57:12.161 INFO:teuthology.orchestra.run.smithi074.stdout: Downloading https://files.pythonhosted.org/packages/ac/aa/063eca6a416f397bd99552c534c6d11d57f58f2e94c14780f3bbf818c4cf/monotonic-1.5-py2.py3-none-any.whl 2019-11-29T01:57:12.260 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting dnspython>=1.15.0 2019-11-29T01:57:12.273 INFO:teuthology.orchestra.run.smithi074.stdout: Downloading https://files.pythonhosted.org/packages/ec/d3/3aa0e7213ef72b8585747aa0e271a9523e713813b9a20177ebe1e939deb0/dnspython-1.16.0-py2.py3-none-any.whl (188kB) 2019-11-29T01:57:12.420 INFO:teuthology.orchestra.run.smithi074.stdout:Collecting enum34; python_version < "3.4" 2019-11-29T01:57:12.431 INFO:teuthology.orchestra.run.smithi074.stdout: Downloading https://files.pythonhosted.org/packages/c5/db/e56e6b4bbac7c4a06de1c50de6fe1ef3810018ae11732a50f15f62c7d050/enum34-1.1.6-py2-none-any.whl 2019-11-29T01:57:12.471 INFO:teuthology.orchestra.run.smithi074.stdout:Building wheels for collected packages: xattr, simplejson, WebOb 2019-11-29T01:57:12.471 INFO:teuthology.orchestra.run.smithi074.stdout: Building wheel for xattr (setup.py): started 2019-11-29T01:57:12.969 INFO:teuthology.orchestra.run.smithi074.stdout: Building wheel for xattr (setup.py): finished with status 'done' 2019-11-29T01:57:12.969 INFO:teuthology.orchestra.run.smithi074.stdout: Created wheel for xattr: filename=xattr-0.6.4-cp27-cp27mu-linux_x86_64.whl size=24115 sha256=0689ded5deeffdcfb9207dbfe69264ff74e5e02f425b512002ff58f2ecf177c9 2019-11-29T01:57:12.969 INFO:teuthology.orchestra.run.smithi074.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/cb/2c/40/ea48345a21b521cdacebf61db13e3bf0c42c77ec664e3fe9e5 2019-11-29T01:57:12.974 INFO:teuthology.orchestra.run.smithi074.stdout: Building wheel for simplejson (setup.py): started 2019-11-29T01:57:14.029 INFO:teuthology.orchestra.run.smithi074.stdout: Building wheel for simplejson (setup.py): finished with status 'done' 2019-11-29T01:57:14.029 INFO:teuthology.orchestra.run.smithi074.stdout: Created wheel for simplejson: filename=simplejson-3.17.0-cp27-cp27mu-linux_x86_64.whl size=113127 sha256=0295bf356711f9c5cef14a41cb8977041a90bfc17996449811c0f021d3586b55 2019-11-29T01:57:14.029 INFO:teuthology.orchestra.run.smithi074.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/86/c0/83/dcd0339abb2640544bb8e0938aab2d069cef55e5647ce6e097 2019-11-29T01:57:14.040 INFO:teuthology.orchestra.run.smithi074.stdout: Building wheel for WebOb (setup.py): started 2019-11-29T01:57:14.279 INFO:teuthology.orchestra.run.smithi074.stdout: Building wheel for WebOb (setup.py): finished with status 'done' 2019-11-29T01:57:14.279 INFO:teuthology.orchestra.run.smithi074.stdout: Created wheel for WebOb: filename=WebOb-1.0-cp27-none-any.whl size=58478 sha256=e85d45efce85147cc2255c438fd5a0f2a9910b86c2fbadb871953c222d089159 2019-11-29T01:57:14.280 INFO:teuthology.orchestra.run.smithi074.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/30/41/c0/8ff9e679d72e05f355e6e2ec87d026131538c953a3b12496eb 2019-11-29T01:57:14.288 INFO:teuthology.orchestra.run.smithi074.stdout:Successfully built xattr simplejson WebOb 2019-11-29T01:57:14.337 INFO:teuthology.orchestra.run.smithi074.stdout:Installing collected packages: PyYAML, nose, boto, bunch, greenlet, gevent, six, isodate, monotonic, dnspython, enum34, eventlet, netifaces, xattr, simplejson, WebOb 2019-11-29T01:57:15.705 INFO:teuthology.orchestra.run.smithi074.stdout:Successfully installed PyYAML-5.1.2 WebOb-1.0 boto-2.49.0 bunch-1.0.1 dnspython-1.16.0 enum34-1.1.6 eventlet-0.25.1 gevent-1.4.0 greenlet-0.4.15 isodate-0.6.0 monotonic-1.5 netifaces-0.10.9 nose-1.3.7 simplejson-3.17.0 six-1.13.0 xattr-0.6.4 2019-11-29T01:57:15.979 INFO:teuthology.orchestra.run.smithi074.stdout:running develop 2019-11-29T01:57:16.025 INFO:teuthology.orchestra.run.smithi074.stdout:running egg_info 2019-11-29T01:57:16.025 INFO:teuthology.orchestra.run.smithi074.stdout:creating swift.egg-info 2019-11-29T01:57:16.025 INFO:teuthology.orchestra.run.smithi074.stdout:writing swift.egg-info/PKG-INFO 2019-11-29T01:57:16.026 INFO:teuthology.orchestra.run.smithi074.stdout:writing top-level names to swift.egg-info/top_level.txt 2019-11-29T01:57:16.026 INFO:teuthology.orchestra.run.smithi074.stdout:writing dependency_links to swift.egg-info/dependency_links.txt 2019-11-29T01:57:16.030 INFO:teuthology.orchestra.run.smithi074.stdout:writing entry points to swift.egg-info/entry_points.txt 2019-11-29T01:57:16.031 INFO:teuthology.orchestra.run.smithi074.stdout:writing manifest file 'swift.egg-info/SOURCES.txt' 2019-11-29T01:57:16.034 INFO:teuthology.orchestra.run.smithi074.stdout:reading manifest file 'swift.egg-info/SOURCES.txt' 2019-11-29T01:57:16.034 INFO:teuthology.orchestra.run.smithi074.stdout:reading manifest template 'MANIFEST.in' 2019-11-29T01:57:16.035 INFO:teuthology.orchestra.run.smithi074.stderr:warning: no files found matching 'ChangeLog' 2019-11-29T01:57:16.038 INFO:teuthology.orchestra.run.smithi074.stdout:writing manifest file 'swift.egg-info/SOURCES.txt' 2019-11-29T01:57:16.039 INFO:teuthology.orchestra.run.smithi074.stdout:running build_ext 2019-11-29T01:57:16.039 INFO:teuthology.orchestra.run.smithi074.stdout:Creating /home/ubuntu/cephtest/swift/virtualenv/lib/python2.7/site-packages/swift.egg-link (link to .) 2019-11-29T01:57:16.039 INFO:teuthology.orchestra.run.smithi074.stdout:Adding swift 1.4.4 to easy-install.pth file 2019-11-29T01:57:16.056 INFO:teuthology.orchestra.run.smithi074.stdout:Installing swift script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T01:57:16.057 INFO:teuthology.orchestra.run.smithi074.stdout:Installing swift-account-auditor script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T01:57:16.059 INFO:teuthology.orchestra.run.smithi074.stdout:Installing swift-account-audit script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T01:57:16.060 INFO:teuthology.orchestra.run.smithi074.stdout:Installing swift-account-reaper script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T01:57:16.061 INFO:teuthology.orchestra.run.smithi074.stdout:Installing swift-account-replicator script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T01:57:16.062 INFO:teuthology.orchestra.run.smithi074.stdout:Installing swift-account-server script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T01:57:16.062 INFO:teuthology.orchestra.run.smithi074.stdout:Installing swift-container-auditor script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T01:57:16.063 INFO:teuthology.orchestra.run.smithi074.stdout:Installing swift-container-replicator script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T01:57:16.064 INFO:teuthology.orchestra.run.smithi074.stdout:Installing swift-container-sync script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T01:57:16.065 INFO:teuthology.orchestra.run.smithi074.stdout:Installing swift-container-server script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T01:57:16.066 INFO:teuthology.orchestra.run.smithi074.stdout:Installing swift-container-updater script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T01:57:16.067 INFO:teuthology.orchestra.run.smithi074.stdout:Installing swift-drive-audit script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T01:57:16.068 INFO:teuthology.orchestra.run.smithi074.stdout:Installing swift-get-nodes script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T01:57:16.069 INFO:teuthology.orchestra.run.smithi074.stdout:Installing swift-init script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T01:57:16.070 INFO:teuthology.orchestra.run.smithi074.stdout:Installing swift-object-auditor script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T01:57:16.071 INFO:teuthology.orchestra.run.smithi074.stdout:Installing swift-object-expirer script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T01:57:16.072 INFO:teuthology.orchestra.run.smithi074.stdout:Installing swift-object-info script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T01:57:16.073 INFO:teuthology.orchestra.run.smithi074.stdout:Installing swift-object-replicator script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T01:57:16.074 INFO:teuthology.orchestra.run.smithi074.stdout:Installing swift-object-server script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T01:57:16.074 INFO:teuthology.orchestra.run.smithi074.stdout:Installing swift-object-updater script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T01:57:16.075 INFO:teuthology.orchestra.run.smithi074.stdout:Installing swift-proxy-server script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T01:57:16.079 INFO:teuthology.orchestra.run.smithi074.stdout:Installing swift-ring-builder script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T01:57:16.081 INFO:teuthology.orchestra.run.smithi074.stdout:Installing swift-stats-populate script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T01:57:16.087 INFO:teuthology.orchestra.run.smithi074.stdout:Installing swift-stats-report script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T01:57:16.094 INFO:teuthology.orchestra.run.smithi074.stdout:Installing swift-dispersion-populate script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T01:57:16.094 INFO:teuthology.orchestra.run.smithi074.stdout:Installing swift-dispersion-report script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T01:57:16.094 INFO:teuthology.orchestra.run.smithi074.stdout:Installing swift-bench script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T01:57:16.095 INFO:teuthology.orchestra.run.smithi074.stdout:Installing swift-recon script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T01:57:16.095 INFO:teuthology.orchestra.run.smithi074.stdout:Installing swift-recon-cron script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T01:57:16.095 INFO:teuthology.orchestra.run.smithi074.stdout: 2019-11-29T01:57:16.095 INFO:teuthology.orchestra.run.smithi074.stdout:Installed /home/ubuntu/cephtest/swift 2019-11-29T01:57:16.096 INFO:teuthology.orchestra.run.smithi074.stdout:Processing dependencies for swift==1.4.4 2019-11-29T01:57:16.097 INFO:teuthology.orchestra.run.smithi074.stdout:Finished processing dependencies for swift==1.4.4 2019-11-29T01:57:16.108 INFO:teuthology.orchestra.run.smithi074:> cat > /home/ubuntu/cephtest/archive/testswift.client.0.conf 2019-11-29T01:57:16.183 INFO:teuthology.orchestra.run.smithi074:> SWIFT_TEST_CONFIG_FILE=/home/ubuntu/cephtest/archive/testswift.client.0.conf /home/ubuntu/cephtest/swift/virtualenv/bin/nosetests -w /home/ubuntu/cephtest/swift/test/functional -v -a '!fails_on_rgw' 2019-11-29T01:57:44.729 INFO:teuthology.orchestra.run.smithi074.stderr:testAccountHead (test.functional.tests.TestAccount) ... ok 2019-11-29T01:57:54.805 INFO:teuthology.orchestra.run.smithi074.stderr:testContainerListing (test.functional.tests.TestAccount) ... ok 2019-11-29T01:57:59.638 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:11:41.855 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:57:59.687 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:11:41.904 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T01:57:59.721 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:11:41.949 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:57:59.725 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:11:41.944 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:57:59.729 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:11:41.958 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:57:59.731 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:11:41.950 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:57:59.787 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:11:42.005 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T01:57:59.790 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:11:42.018 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T01:57:59.816 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:11:42.033 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:01:18.048 INFO:teuthology.orchestra.run.smithi074.stderr:testContainerSerializedInfo (test.functional.tests.TestAccount) ... ok 2019-11-29T02:01:26.270 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:15:08.487 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:01:26.275 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:15:08.492 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:01:26.286 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:15:08.505 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:01:26.291 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:15:08.520 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:01:26.292 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:15:08.510 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:01:26.296 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:15:08.525 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:01:26.413 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:15:08.631 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:01:26.457 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:15:08.686 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:01:26.485 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:15:08.704 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:01:28.737 INFO:teuthology.orchestra.run.smithi074.stderr:testContainersOrderedByName (test.functional.tests.TestAccount) ... ok 2019-11-29T02:01:29.461 INFO:teuthology.orchestra.run.smithi074.stderr:testInvalidAuthToken (test.functional.tests.TestAccount) ... ok 2019-11-29T02:01:40.414 INFO:teuthology.orchestra.run.smithi074.stderr:testLastContainerMarker (test.functional.tests.TestAccount) ... ok 2019-11-29T02:01:56.355 INFO:teuthology.orchestra.run.smithi074.stderr:testListingLimit (test.functional.tests.TestAccount) ... ok 2019-11-29T02:02:29.120 INFO:teuthology.orchestra.run.smithi074.stderr:testMarkerLimitContainerList (test.functional.tests.TestAccount) ... ok 2019-11-29T02:02:29.411 INFO:teuthology.orchestra.run.smithi074.stderr:testPUT (test.functional.tests.TestAccount) ... ok 2019-11-29T02:06:20.988 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:20:03.206 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:06:21.063 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:20:03.211 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:06:21.063 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:20:03.246 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:06:21.063 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:20:03.248 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:06:21.067 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:20:03.295 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:06:21.072 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:20:03.300 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:06:21.142 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:20:03.360 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:06:21.155 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:20:03.372 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:06:21.239 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:20:03.467 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:06:37.194 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:20:19.411 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:06:37.200 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:20:19.418 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:06:37.212 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:20:19.430 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:06:37.216 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:20:19.444 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:06:37.219 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:20:19.437 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:06:37.221 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:20:19.450 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:06:37.236 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:20:19.453 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:06:37.250 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:20:19.468 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:06:37.260 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:20:19.488 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:07:30.095 INFO:teuthology.orchestra.run.smithi074.stderr:testGetRequest (test.functional.tests.TestAccountNoContainers) ... ok 2019-11-29T02:07:33.179 INFO:teuthology.orchestra.run.smithi074.stderr:testGetRequest (test.functional.tests.TestAccountNoContainersUTF8) ... ok 2019-11-29T02:07:58.921 INFO:teuthology.orchestra.run.smithi074.stderr:testAccountHead (test.functional.tests.TestAccountUTF8) ... ok 2019-11-29T02:08:08.787 INFO:teuthology.orchestra.run.smithi074.stderr:testContainerListing (test.functional.tests.TestAccountUTF8) ... ok 2019-11-29T02:11:06.945 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:24:49.162 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:11:07.011 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:24:49.234 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:11:07.011 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:24:49.236 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:11:07.011 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:24:49.195 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:11:07.011 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:24:49.210 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:11:07.020 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:24:49.239 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:11:07.125 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:24:49.342 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:11:07.187 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:24:49.406 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:11:07.203 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:24:49.431 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:11:43.085 INFO:teuthology.orchestra.run.smithi074.stderr:testContainerSerializedInfo (test.functional.tests.TestAccountUTF8) ... ok 2019-11-29T02:11:48.452 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:25:30.669 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:11:48.462 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:25:30.680 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:11:48.472 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:25:30.701 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:11:48.473 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:25:30.691 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:11:48.476 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:25:30.705 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:11:48.477 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:25:30.695 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:11:48.525 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:25:30.742 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:11:48.538 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:25:30.757 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:11:48.539 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:25:30.768 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:11:54.093 INFO:teuthology.orchestra.run.smithi074.stderr:testContainersOrderedByName (test.functional.tests.TestAccountUTF8) ... ok 2019-11-29T02:11:54.790 INFO:teuthology.orchestra.run.smithi074.stderr:testInvalidAuthToken (test.functional.tests.TestAccountUTF8) ... ok 2019-11-29T02:12:10.138 INFO:teuthology.orchestra.run.smithi074.stderr:testLastContainerMarker (test.functional.tests.TestAccountUTF8) ... ok 2019-11-29T02:12:26.720 INFO:teuthology.orchestra.run.smithi074.stderr:testListingLimit (test.functional.tests.TestAccountUTF8) ... ok 2019-11-29T02:13:44.820 INFO:teuthology.orchestra.run.smithi074.stderr:testMarkerLimitContainerList (test.functional.tests.TestAccountUTF8) ... ok 2019-11-29T02:13:44.893 INFO:teuthology.orchestra.run.smithi074.stderr:testPUT (test.functional.tests.TestAccountUTF8) ... ok 2019-11-29T02:14:42.696 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:28:24.914 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:14:42.748 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:28:24.965 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:14:42.752 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:28:24.980 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:14:42.773 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:28:25.001 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:14:42.789 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:28:25.007 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:14:42.792 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:28:25.011 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:14:42.834 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:28:25.051 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:14:42.868 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:28:25.086 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:14:42.893 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:28:25.121 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:17:00.670 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:30:42.887 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:17:00.688 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:30:42.896 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:17:00.688 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:30:42.903 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:17:00.688 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:30:42.905 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:17:00.688 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:30:42.917 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:17:00.691 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:30:42.920 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:17:00.769 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:30:42.986 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:17:00.785 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:30:43.013 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:17:00.789 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:30:43.008 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:19:05.310 INFO:teuthology.orchestra.run.smithi074.stderr:testContainerExistenceCachingProblem (test.functional.tests.TestContainer) ... ok 2019-11-29T02:19:06.443 INFO:teuthology.orchestra.run.smithi074.stderr:testContainerFileList (test.functional.tests.TestContainer) ... ok 2019-11-29T02:19:06.846 INFO:teuthology.orchestra.run.smithi074.stderr:testContainerFileListOnContainerThatDoesNotExist (test.functional.tests.TestContainer) ... ok 2019-11-29T02:19:08.388 INFO:teuthology.orchestra.run.smithi074.stderr:testContainerFileListWithLimit (test.functional.tests.TestContainer) ... ok 2019-11-29T02:19:08.800 INFO:teuthology.orchestra.run.smithi074.stderr:testContainerInfo (test.functional.tests.TestContainer) ... ok 2019-11-29T02:19:09.075 INFO:teuthology.orchestra.run.smithi074.stderr:testContainerInfoOnContainerThatDoesNotExist (test.functional.tests.TestContainer) ... ok 2019-11-29T02:19:16.162 INFO:teuthology.orchestra.run.smithi074.stderr:testContainerNameLimit (test.functional.tests.TestContainer) ... ok 2019-11-29T02:19:20.356 INFO:teuthology.orchestra.run.smithi074.stderr:testCreate (test.functional.tests.TestContainer) ... ok 2019-11-29T02:19:26.704 INFO:teuthology.orchestra.run.smithi074.stderr:testDelete (test.functional.tests.TestContainer) ... ok 2019-11-29T02:19:26.867 INFO:teuthology.orchestra.run.smithi074.stderr:testDeleteOnContainerThatDoesNotExist (test.functional.tests.TestContainer) ... ok 2019-11-29T02:19:31.674 INFO:teuthology.orchestra.run.smithi074.stderr:testDeleteOnContainerWithFiles (test.functional.tests.TestContainer) ... ok 2019-11-29T02:19:32.524 INFO:teuthology.orchestra.run.smithi074.stderr:testFileCreateInContainerThatDoesNotExist (test.functional.tests.TestContainer) ... ok 2019-11-29T02:20:39.424 INFO:teuthology.orchestra.run.smithi074.stderr:testFileListingLimitMarkerPrefix (test.functional.tests.TestContainer) ... ok 2019-11-29T02:20:41.655 INFO:teuthology.orchestra.run.smithi074.stderr:testFileOrder (test.functional.tests.TestContainer) ... ok 2019-11-29T02:20:53.932 INFO:teuthology.orchestra.run.smithi074.stderr:testFileThenContainerDelete (test.functional.tests.TestContainer) ... ok 2019-11-29T02:20:58.638 INFO:teuthology.orchestra.run.smithi074.stderr:testLastFileMarker (test.functional.tests.TestContainer) ... ok 2019-11-29T02:21:25.333 INFO:teuthology.orchestra.run.smithi074.stderr:testMarkerLimitFileList (test.functional.tests.TestContainer) ... ok 2019-11-29T02:22:12.889 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:35:55.106 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:22:12.899 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:35:55.116 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:22:12.905 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:35:55.124 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:22:12.908 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:35:55.127 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:22:12.922 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:35:55.150 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:22:12.931 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:35:55.160 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:22:13.135 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:35:55.353 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:22:13.153 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:35:55.381 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:22:13.182 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:35:55.399 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:22:16.377 INFO:teuthology.orchestra.run.smithi074.stderr:testPrefixAndLimit (test.functional.tests.TestContainer) ... ok 2019-11-29T02:22:16.540 INFO:teuthology.orchestra.run.smithi074.stderr:testTooLongName (test.functional.tests.TestContainer) ... ok 2019-11-29T02:23:04.141 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:36:46.358 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:23:04.159 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:36:46.374 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:23:04.171 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:36:46.389 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:23:04.179 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:36:46.398 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:23:04.201 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:36:46.419 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:23:04.216 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:36:46.435 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:23:04.237 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:36:46.466 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:23:04.241 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:36:46.469 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:23:04.328 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:36:46.557 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:23:05.307 INFO:teuthology.orchestra.run.smithi074.stderr:testUnorderedList (test.functional.tests.TestContainer) ... ok 2019-11-29T02:26:47.622 INFO:teuthology.orchestra.run.smithi074.stderr:testContainerListing (test.functional.tests.TestContainerPaths) ... ok 2019-11-29T02:26:54.666 INFO:teuthology.orchestra.run.smithi074.stderr:testStructure (test.functional.tests.TestContainerPaths) ... ok 2019-11-29T02:27:06.957 INFO:teuthology.orchestra.run.smithi074.stderr:testTraverseContainer (test.functional.tests.TestContainerPaths) ... ok 2019-11-29T02:27:22.963 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:41:05.181 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:27:22.971 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:41:05.189 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:27:22.982 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:41:05.210 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:27:22.983 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:41:05.202 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:27:22.985 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:41:05.214 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:27:22.988 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:41:05.207 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:27:23.132 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:41:05.361 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:27:23.142 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:41:05.359 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:27:23.157 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:41:05.376 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:28:22.904 INFO:teuthology.orchestra.run.smithi074.stderr:testContainerExistenceCachingProblem (test.functional.tests.TestContainerUTF8) ... ok 2019-11-29T02:28:25.217 INFO:teuthology.orchestra.run.smithi074.stderr:testContainerFileList (test.functional.tests.TestContainerUTF8) ... ok 2019-11-29T02:28:25.837 INFO:teuthology.orchestra.run.smithi074.stderr:testContainerFileListOnContainerThatDoesNotExist (test.functional.tests.TestContainerUTF8) ... ok 2019-11-29T02:28:27.024 INFO:teuthology.orchestra.run.smithi074.stderr:testContainerFileListWithLimit (test.functional.tests.TestContainerUTF8) ... ok 2019-11-29T02:28:27.356 INFO:teuthology.orchestra.run.smithi074.stderr:testContainerInfo (test.functional.tests.TestContainerUTF8) ... ok 2019-11-29T02:28:27.941 INFO:teuthology.orchestra.run.smithi074.stderr:testContainerInfoOnContainerThatDoesNotExist (test.functional.tests.TestContainerUTF8) ... ok 2019-11-29T02:28:33.480 INFO:teuthology.orchestra.run.smithi074.stderr:testContainerNameLimit (test.functional.tests.TestContainerUTF8) ... ok 2019-11-29T02:28:37.458 INFO:teuthology.orchestra.run.smithi074.stderr:testCreate (test.functional.tests.TestContainerUTF8) ... ok 2019-11-29T02:28:43.059 INFO:teuthology.orchestra.run.smithi074.stderr:testDelete (test.functional.tests.TestContainerUTF8) ... ok 2019-11-29T02:28:43.288 INFO:teuthology.orchestra.run.smithi074.stderr:testDeleteOnContainerThatDoesNotExist (test.functional.tests.TestContainerUTF8) ... ok 2019-11-29T02:28:46.979 INFO:teuthology.orchestra.run.smithi074.stderr:testDeleteOnContainerWithFiles (test.functional.tests.TestContainerUTF8) ... ok 2019-11-29T02:28:47.119 INFO:teuthology.orchestra.run.smithi074.stderr:testFileCreateInContainerThatDoesNotExist (test.functional.tests.TestContainerUTF8) ... ok 2019-11-29T02:29:57.476 INFO:teuthology.orchestra.run.smithi074.stderr:testFileListingLimitMarkerPrefix (test.functional.tests.TestContainerUTF8) ... ok 2019-11-29T02:29:59.608 INFO:teuthology.orchestra.run.smithi074.stderr:testFileOrder (test.functional.tests.TestContainerUTF8) ... ok 2019-11-29T02:30:11.840 INFO:teuthology.orchestra.run.smithi074.stderr:testFileThenContainerDelete (test.functional.tests.TestContainerUTF8) ... ok 2019-11-29T02:30:17.028 INFO:teuthology.orchestra.run.smithi074.stderr:testLastFileMarker (test.functional.tests.TestContainerUTF8) ... ok 2019-11-29T02:30:45.064 INFO:teuthology.orchestra.run.smithi074.stderr:testMarkerLimitFileList (test.functional.tests.TestContainerUTF8) ... ok 2019-11-29T02:31:25.474 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:45:07.692 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:31:25.491 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:45:07.709 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:31:25.515 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:45:07.733 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:31:25.541 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:45:07.759 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:31:25.548 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:45:07.777 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:31:25.551 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:45:07.779 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:31:25.598 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:45:07.815 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:31:25.690 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:45:07.904 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:31:25.709 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:45:07.938 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:31:35.563 INFO:teuthology.orchestra.run.smithi074.stderr:testPrefixAndLimit (test.functional.tests.TestContainerUTF8) ... ok 2019-11-29T02:31:35.611 INFO:teuthology.orchestra.run.smithi074.stderr:testTooLongName (test.functional.tests.TestContainerUTF8) ... ok 2019-11-29T02:32:25.964 INFO:teuthology.orchestra.run.smithi074.stderr:testUnorderedList (test.functional.tests.TestContainerUTF8) ... ok 2019-11-29T02:32:33.230 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:46:15.448 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:32:33.238 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:46:15.455 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:32:33.248 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:46:15.467 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:32:33.251 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:46:15.470 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:32:33.256 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:46:15.484 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:32:33.265 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:46:15.493 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:32:33.295 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:46:15.513 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:32:33.318 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:46:15.537 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:32:33.358 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:46:15.586 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:35:42.785 INFO:teuthology.orchestra.run.smithi074.stderr:test_get_manifest (test.functional.tests.TestDlo) ... ok 2019-11-29T02:35:43.513 INFO:teuthology.orchestra.run.smithi074.stderr:test_get_manifest_document_itself (test.functional.tests.TestDlo) ... ok 2019-11-29T02:35:47.777 INFO:teuthology.orchestra.run.smithi074.stderr:test_get_range (test.functional.tests.TestDlo) ... ok 2019-11-29T02:35:48.815 INFO:teuthology.orchestra.run.smithi074.stderr:test_get_range_out_of_range (test.functional.tests.TestDlo) ... ok 2019-11-29T02:36:36.584 INFO:teuthology.orchestra.run.smithi074.stderr:test_get_manifest (test.functional.tests.TestDloUTF8) ... ok 2019-11-29T02:36:36.911 INFO:teuthology.orchestra.run.smithi074.stderr:test_get_manifest_document_itself (test.functional.tests.TestDloUTF8) ... ok 2019-11-29T02:36:42.081 INFO:teuthology.orchestra.run.smithi074.stderr:test_get_range (test.functional.tests.TestDloUTF8) ... ok 2019-11-29T02:36:42.579 INFO:teuthology.orchestra.run.smithi074.stderr:test_get_range_out_of_range (test.functional.tests.TestDloUTF8) ... ok 2019-11-29T02:37:10.640 INFO:teuthology.orchestra.run.smithi074.stderr:testBadHeaders (test.functional.tests.TestFile) ... ok 2019-11-29T02:37:10.929 INFO:teuthology.orchestra.run.smithi074.stderr:testBlankMetadataName (test.functional.tests.TestFile) ... ok 2019-11-29T02:37:45.428 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:51:27.645 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:37:45.438 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:51:27.655 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:37:45.447 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:51:27.666 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:37:45.449 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:51:27.678 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:37:45.451 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:51:27.670 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:37:45.454 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:51:27.683 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:37:45.626 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:51:27.844 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:37:45.629 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:51:27.847 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:37:45.648 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:51:27.876 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:39:46.905 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:53:29.122 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:39:46.937 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:53:29.155 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:39:46.950 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:53:29.169 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:39:46.952 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:53:29.171 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:39:46.977 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:53:29.206 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:39:46.980 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:53:29.209 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:39:46.996 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:53:29.213 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:39:47.030 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:53:29.249 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:39:47.070 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:53:29.299 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:42:57.457 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:56:39.674 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:42:57.478 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:56:39.681 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:42:57.478 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:56:39.693 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:42:57.481 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:56:39.700 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:42:57.484 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:56:39.713 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:42:57.509 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:56:39.738 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:42:57.613 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:04:56:39.818 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:42:57.613 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:04:56:39.830 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:42:57.717 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:04:56:39.945 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:48:08.417 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:01:50.634 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:48:09.516 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:01:50.710 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:48:09.516 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:01:50.718 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:48:09.516 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:01:50.869 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:48:09.517 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:01:50.680 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:48:09.517 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:01:50.858 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:48:09.517 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:01:50.723 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:48:09.517 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:01:50.739 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:48:09.517 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:01:50.870 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:48:10.024 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:01:52.243 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:48:10.026 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:01:52.245 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:48:10.040 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:01:52.259 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:48:10.072 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:01:52.300 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:48:10.074 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:01:52.303 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:48:10.093 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:01:52.322 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:48:10.156 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:01:52.374 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:48:10.157 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:01:52.375 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:48:10.168 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:01:52.386 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:49:23.204 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:49:23.196+0000 1694c700 -1 osd.0 138 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:48:39.782121+0000 front 2019-11-29T02:48:39.757036+0000 (oldest deadline 2019-11-29T02:49:23.186101+0000) 2019-11-29T02:49:23.360 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:49:23.349+0000 1694c700 -1 osd.2 138 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:48:42.002525+0000 front 2019-11-29T02:48:41.999141+0000 (oldest deadline 2019-11-29T02:49:23.079938+0000) 2019-11-29T02:49:24.033 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:49:24.021+0000 1694c700 -1 osd.5 138 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:48:42.801861+0000 front 2019-11-29T02:48:42.809379+0000 (oldest deadline 2019-11-29T02:49:23.767654+0000) 2019-11-29T02:49:24.206 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:49:24.202+0000 1694c700 -1 osd.0 138 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:48:39.782121+0000 front 2019-11-29T02:48:39.757036+0000 (oldest deadline 2019-11-29T02:49:23.186101+0000) 2019-11-29T02:49:24.364 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:49:24.359+0000 1694c700 -1 osd.2 138 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:48:42.002525+0000 front 2019-11-29T02:48:41.999141+0000 (oldest deadline 2019-11-29T02:49:23.079938+0000) 2019-11-29T02:49:24.462 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:49:24.448+0000 1694c700 -1 osd.7 138 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:48:41.395544+0000 front 2019-11-29T02:48:41.422282+0000 (oldest deadline 2019-11-29T02:49:24.028640+0000) 2019-11-29T02:49:25.005 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:49:24.988+0000 1694c700 -1 osd.5 138 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:48:42.801861+0000 front 2019-11-29T02:48:42.809379+0000 (oldest deadline 2019-11-29T02:49:23.767654+0000) 2019-11-29T02:49:25.175 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:49:25.152+0000 1694c700 -1 osd.1 138 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:48:42.298396+0000 front 2019-11-29T02:48:42.546894+0000 (oldest deadline 2019-11-29T02:49:24.385694+0000) 2019-11-29T02:49:25.250 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:49:25.237+0000 1694c700 -1 osd.0 138 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:48:39.782121+0000 front 2019-11-29T02:48:39.757036+0000 (oldest deadline 2019-11-29T02:49:23.186101+0000) 2019-11-29T02:49:25.366 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:49:25.361+0000 1694c700 -1 osd.2 138 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:48:42.002525+0000 front 2019-11-29T02:48:41.999141+0000 (oldest deadline 2019-11-29T02:49:23.079938+0000) 2019-11-29T02:49:25.440 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:49:25.434+0000 1694c700 -1 osd.7 138 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:48:41.395544+0000 front 2019-11-29T02:48:41.422282+0000 (oldest deadline 2019-11-29T02:49:24.028640+0000) 2019-11-29T02:49:26.021 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:49:26.017+0000 1694c700 -1 osd.5 138 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:48:42.801861+0000 front 2019-11-29T02:48:42.809379+0000 (oldest deadline 2019-11-29T02:49:23.767654+0000) 2019-11-29T02:49:26.148 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:49:26.144+0000 1694c700 -1 osd.1 138 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:48:42.298396+0000 front 2019-11-29T02:48:42.546894+0000 (oldest deadline 2019-11-29T02:49:24.385694+0000) 2019-11-29T02:50:20.448 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:50:20.399+0000 31f84700 -1 osd.6 142 build_incremental_map_msg missing incremental map 142 2019-11-29T02:50:20.755 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:50:20.604+0000 35f8c700 -1 osd.6 142 build_incremental_map_msg missing incremental map 142 2019-11-29T02:50:20.757 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:50:20.609+0000 37f90700 -1 osd.6 142 build_incremental_map_msg missing incremental map 142 2019-11-29T02:50:20.867 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:50:20.716+0000 32785700 -1 osd.6 142 build_incremental_map_msg missing incremental map 142 2019-11-29T02:50:21.001 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:50:20.890+0000 38791700 -1 osd.6 142 build_incremental_map_msg missing incremental map 142 2019-11-29T02:50:21.641 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:50:21.634+0000 1694c700 -1 osd.2 143 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:49:38.265274+0000 front 2019-11-29T02:49:43.042681+0000 (oldest deadline 2019-11-29T02:50:21.590997+0000) 2019-11-29T02:50:22.092 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:50:22.075+0000 1694c700 -1 osd.6 143 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:49:37.374909+0000 front 2019-11-29T02:49:37.376470+0000 (oldest deadline 2019-11-29T02:50:21.562242+0000) 2019-11-29T02:50:22.218 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:50:22.214+0000 1694c700 -1 osd.0 143 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:49:41.905945+0000 front 2019-11-29T02:49:40.487359+0000 (oldest deadline 2019-11-29T02:50:21.419805+0000) 2019-11-29T02:50:22.695 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:50:22.691+0000 1694c700 -1 osd.2 143 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:49:38.265274+0000 front 2019-11-29T02:49:43.042681+0000 (oldest deadline 2019-11-29T02:50:21.590997+0000) 2019-11-29T02:50:24.039 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:04:06.256 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:50:24.061 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:04:06.279 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:50:24.091 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:04:06.319 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:50:24.093 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:04:06.312 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:50:24.100 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:04:06.329 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:50:24.105 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:04:06.324 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:50:24.216 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:04:06.445 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:50:24.283 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:04:06.500 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:50:24.308 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:04:06.527 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:50:24.692 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T02:50:24.570+0000 35f8c700 -1 osd.3 145 build_incremental_map_msg missing incremental map 145 2019-11-29T02:50:24.975 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T02:50:24.729+0000 34789700 -1 osd.3 145 build_incremental_map_msg missing incremental map 145 2019-11-29T02:50:25.160 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T02:50:25.115+0000 37f90700 -1 osd.3 145 build_incremental_map_msg missing incremental map 145 2019-11-29T02:50:26.702 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T02:50:26.698+0000 34789700 -1 osd.3 146 build_incremental_map_msg missing incremental map 145 2019-11-29T02:51:38.121 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:51:38.012+0000 3678d700 -1 osd.5 150 build_incremental_map_msg missing incremental map 150 2019-11-29T02:52:33.864 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:06:16.082 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:52:33.875 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:06:16.093 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:52:33.880 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:06:16.099 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:52:33.882 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:06:16.101 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:52:33.906 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:06:16.135 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:52:33.931 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:06:16.160 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:52:34.004 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:06:16.223 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:52:34.050 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:06:16.268 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:52:34.093 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:06:16.322 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:52:37.617 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:52:37.613+0000 1694c700 -1 osd.0 151 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:51:53.439505+0000 front 2019-11-29T02:51:53.706368+0000 (oldest deadline 2019-11-29T02:52:37.503296+0000) 2019-11-29T02:52:38.028 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:52:38.023+0000 1694c700 -1 osd.1 151 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:51:54.523306+0000 front 2019-11-29T02:51:54.604746+0000 (oldest deadline 2019-11-29T02:52:37.899776+0000) 2019-11-29T02:52:38.578 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:52:38.575+0000 1694c700 -1 osd.0 151 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:51:53.439505+0000 front 2019-11-29T02:51:53.706368+0000 (oldest deadline 2019-11-29T02:52:37.503296+0000) 2019-11-29T02:52:38.632 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:52:38.626+0000 1694c700 -1 osd.7 151 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:51:54.709444+0000 front 2019-11-29T02:51:54.690418+0000 (oldest deadline 2019-11-29T02:52:38.158544+0000) 2019-11-29T02:52:38.852 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:52:38.841+0000 1694c700 -1 osd.4 151 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:51:56.868271+0000 front 2019-11-29T02:51:56.874433+0000 (oldest deadline 2019-11-29T02:52:38.529861+0000) 2019-11-29T02:52:38.998 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:52:38.993+0000 1694c700 -1 osd.1 151 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:51:54.523306+0000 front 2019-11-29T02:51:54.604746+0000 (oldest deadline 2019-11-29T02:52:37.899776+0000) 2019-11-29T02:52:39.623 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:52:39.618+0000 1694c700 -1 osd.0 151 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:51:53.439505+0000 front 2019-11-29T02:51:53.706368+0000 (oldest deadline 2019-11-29T02:52:37.503296+0000) 2019-11-29T02:52:39.626 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:52:39.620+0000 1694c700 -1 osd.7 151 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:51:54.709444+0000 front 2019-11-29T02:51:54.690418+0000 (oldest deadline 2019-11-29T02:52:38.158544+0000) 2019-11-29T02:52:39.889 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:52:39.876+0000 1694c700 -1 osd.4 151 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:51:56.868271+0000 front 2019-11-29T02:51:56.874433+0000 (oldest deadline 2019-11-29T02:52:38.529861+0000) 2019-11-29T02:52:40.050 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:52:40.045+0000 1694c700 -1 osd.1 151 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:51:54.523306+0000 front 2019-11-29T02:51:54.604746+0000 (oldest deadline 2019-11-29T02:52:37.899776+0000) 2019-11-29T02:52:40.619 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:52:40.614+0000 1694c700 -1 osd.7 151 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:51:54.709444+0000 front 2019-11-29T02:51:54.690418+0000 (oldest deadline 2019-11-29T02:52:38.158544+0000) 2019-11-29T02:52:40.672 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:52:40.668+0000 1694c700 -1 osd.0 151 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:51:53.439505+0000 front 2019-11-29T02:51:53.706368+0000 (oldest deadline 2019-11-29T02:52:37.503296+0000) 2019-11-29T02:52:40.895 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:52:40.889+0000 1694c700 -1 osd.4 151 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:51:56.868271+0000 front 2019-11-29T02:51:56.874433+0000 (oldest deadline 2019-11-29T02:52:38.529861+0000) 2019-11-29T02:52:41.042 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:52:41.036+0000 1694c700 -1 osd.5 151 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:51:56.788959+0000 front 2019-11-29T02:51:56.873175+0000 (oldest deadline 2019-11-29T02:52:40.183036+0000) 2019-11-29T02:52:41.072 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:52:41.067+0000 1694c700 -1 osd.1 151 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:51:54.523306+0000 front 2019-11-29T02:51:54.604746+0000 (oldest deadline 2019-11-29T02:52:37.899776+0000) 2019-11-29T02:52:41.127 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:52:41.123+0000 1694c700 -1 osd.2 151 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:51:56.873986+0000 front 2019-11-29T02:51:56.805875+0000 (oldest deadline 2019-11-29T02:52:40.836781+0000) 2019-11-29T02:52:41.320 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:52:41.315+0000 1694c700 -1 osd.6 151 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:51:56.839248+0000 front 2019-11-29T02:51:56.743359+0000 (oldest deadline 2019-11-29T02:52:40.820155+0000) 2019-11-29T02:52:41.683 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:52:41.667+0000 1694c700 -1 osd.7 151 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:51:54.709444+0000 front 2019-11-29T02:51:54.690418+0000 (oldest deadline 2019-11-29T02:52:38.158544+0000) 2019-11-29T02:52:41.683 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:52:41.675+0000 1694c700 -1 osd.0 151 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:51:53.439505+0000 front 2019-11-29T02:51:53.706368+0000 (oldest deadline 2019-11-29T02:52:37.503296+0000) 2019-11-29T02:53:09.767 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:53:09.747+0000 31783700 -1 osd.6 153 build_incremental_map_msg missing incremental map 142 2019-11-29T02:53:11.501 INFO:teuthology.orchestra.run.smithi074.stderr:testChunkedPut (test.functional.tests.TestFile) ... ok 2019-11-29T02:53:40.438 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:53:40.433+0000 1694c700 -1 osd.4 154 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:58.411560+0000 front 2019-11-29T02:52:58.400042+0000 (oldest deadline 2019-11-29T02:53:39.899459+0000) 2019-11-29T02:53:40.517 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:53:40.512+0000 1694c700 -1 osd.7 154 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:58.600494+0000 front 2019-11-29T02:52:57.739178+0000 (oldest deadline 2019-11-29T02:53:40.432593+0000) 2019-11-29T02:53:40.589 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:53:40.585+0000 1694c700 -1 osd.2 154 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:58.529746+0000 front 2019-11-29T02:52:58.599552+0000 (oldest deadline 2019-11-29T02:53:39.584374+0000) 2019-11-29T02:53:41.496 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:53:41.485+0000 1694c700 -1 osd.4 154 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:58.411560+0000 front 2019-11-29T02:52:58.400042+0000 (oldest deadline 2019-11-29T02:53:39.899459+0000) 2019-11-29T02:53:41.509 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:53:41.504+0000 1694c700 -1 osd.7 154 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:58.600494+0000 front 2019-11-29T02:52:57.739178+0000 (oldest deadline 2019-11-29T02:53:40.432593+0000) 2019-11-29T02:53:41.627 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:53:41.623+0000 1694c700 -1 osd.2 154 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:58.529746+0000 front 2019-11-29T02:52:58.599552+0000 (oldest deadline 2019-11-29T02:53:39.584374+0000) 2019-11-29T02:53:42.462 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:53:42.457+0000 1694c700 -1 osd.7 154 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:58.600494+0000 front 2019-11-29T02:52:57.739178+0000 (oldest deadline 2019-11-29T02:53:40.432593+0000) 2019-11-29T02:53:42.512 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:53:42.506+0000 1694c700 -1 osd.4 154 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:58.411560+0000 front 2019-11-29T02:52:58.400042+0000 (oldest deadline 2019-11-29T02:53:39.899459+0000) 2019-11-29T02:53:42.593 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:53:42.590+0000 1694c700 -1 osd.2 154 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:58.529746+0000 front 2019-11-29T02:52:58.599552+0000 (oldest deadline 2019-11-29T02:53:39.584374+0000) 2019-11-29T02:53:43.113 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:53:43.110+0000 1694c700 -1 osd.0 154 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:58.929462+0000 front 2019-11-29T02:52:58.752920+0000 (oldest deadline 2019-11-29T02:53:43.047495+0000) 2019-11-29T02:53:43.429 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:53:43.424+0000 1694c700 -1 osd.7 154 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:58.600494+0000 front 2019-11-29T02:52:57.739178+0000 (oldest deadline 2019-11-29T02:53:40.432593+0000) 2019-11-29T02:53:43.486 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:53:43.481+0000 1694c700 -1 osd.4 154 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:58.411560+0000 front 2019-11-29T02:52:58.400042+0000 (oldest deadline 2019-11-29T02:53:39.899459+0000) 2019-11-29T02:53:43.601 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:53:43.597+0000 1694c700 -1 osd.2 154 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:58.529746+0000 front 2019-11-29T02:52:58.599552+0000 (oldest deadline 2019-11-29T02:53:39.584374+0000) 2019-11-29T02:53:43.910 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:53:43.907+0000 1694c700 -1 osd.1 154 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:59.165329+0000 front 2019-11-29T02:52:58.987078+0000 (oldest deadline 2019-11-29T02:53:43.636032+0000) 2019-11-29T02:53:44.075 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:53:44.072+0000 1694c700 -1 osd.0 154 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:58.929462+0000 front 2019-11-29T02:52:58.752920+0000 (oldest deadline 2019-11-29T02:53:43.047495+0000) 2019-11-29T02:53:44.466 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:53:44.461+0000 1694c700 -1 osd.7 154 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:58.600494+0000 front 2019-11-29T02:52:57.739178+0000 (oldest deadline 2019-11-29T02:53:40.432593+0000) 2019-11-29T02:53:44.528 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:53:44.522+0000 1694c700 -1 osd.4 154 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:58.411560+0000 front 2019-11-29T02:52:58.400042+0000 (oldest deadline 2019-11-29T02:53:39.899459+0000) 2019-11-29T02:53:44.555 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:53:44.552+0000 1694c700 -1 osd.2 154 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:58.529746+0000 front 2019-11-29T02:52:58.599552+0000 (oldest deadline 2019-11-29T02:53:39.584374+0000) 2019-11-29T02:53:44.958 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:53:44.954+0000 1694c700 -1 osd.1 154 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:59.165329+0000 front 2019-11-29T02:52:58.987078+0000 (oldest deadline 2019-11-29T02:53:43.636032+0000) 2019-11-29T02:53:45.049 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:53:45.046+0000 1694c700 -1 osd.0 154 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:58.929462+0000 front 2019-11-29T02:52:58.752920+0000 (oldest deadline 2019-11-29T02:53:43.047495+0000) 2019-11-29T02:53:45.433 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:53:45.428+0000 1694c700 -1 osd.7 154 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:58.600494+0000 front 2019-11-29T02:52:57.739178+0000 (oldest deadline 2019-11-29T02:53:40.432593+0000) 2019-11-29T02:53:45.513 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:53:45.507+0000 1694c700 -1 osd.4 154 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:58.411560+0000 front 2019-11-29T02:52:58.400042+0000 (oldest deadline 2019-11-29T02:53:39.899459+0000) 2019-11-29T02:53:45.532 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:53:45.529+0000 1694c700 -1 osd.2 154 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:58.529746+0000 front 2019-11-29T02:52:58.599552+0000 (oldest deadline 2019-11-29T02:53:39.584374+0000) 2019-11-29T02:53:45.976 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:53:45.973+0000 1694c700 -1 osd.1 154 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:59.165329+0000 front 2019-11-29T02:52:58.987078+0000 (oldest deadline 2019-11-29T02:53:43.636032+0000) 2019-11-29T02:53:46.218 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:53:46.215+0000 1694c700 -1 osd.0 155 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:58.929462+0000 front 2019-11-29T02:52:58.752920+0000 (oldest deadline 2019-11-29T02:53:43.047495+0000) 2019-11-29T02:53:46.456 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:53:46.423+0000 1694c700 -1 osd.7 155 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:58.600494+0000 front 2019-11-29T02:52:57.739178+0000 (oldest deadline 2019-11-29T02:53:40.432593+0000) 2019-11-29T02:53:46.492 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:53:46.487+0000 1694c700 -1 osd.4 155 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:58.411560+0000 front 2019-11-29T02:52:58.400042+0000 (oldest deadline 2019-11-29T02:53:39.899459+0000) 2019-11-29T02:53:46.544 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:53:46.541+0000 1694c700 -1 osd.2 155 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:58.529746+0000 front 2019-11-29T02:52:58.599552+0000 (oldest deadline 2019-11-29T02:53:39.584374+0000) 2019-11-29T02:53:47.011 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:53:47.008+0000 1694c700 -1 osd.1 155 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:59.165329+0000 front 2019-11-29T02:52:58.987078+0000 (oldest deadline 2019-11-29T02:53:43.636032+0000) 2019-11-29T02:53:47.300 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:53:47.298+0000 1694c700 -1 osd.0 156 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:58.929462+0000 front 2019-11-29T02:52:58.752920+0000 (oldest deadline 2019-11-29T02:53:43.047495+0000) 2019-11-29T02:53:47.498 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:53:47.494+0000 1694c700 -1 osd.4 156 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:58.411560+0000 front 2019-11-29T02:52:58.400042+0000 (oldest deadline 2019-11-29T02:53:39.899459+0000) 2019-11-29T02:53:47.560 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:53:47.556+0000 1694c700 -1 osd.7 156 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:58.600494+0000 front 2019-11-29T02:52:57.739178+0000 (oldest deadline 2019-11-29T02:53:40.432593+0000) 2019-11-29T02:53:47.714 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:53:47.711+0000 1694c700 -1 osd.2 156 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:58.529746+0000 front 2019-11-29T02:52:58.599552+0000 (oldest deadline 2019-11-29T02:53:39.584374+0000) 2019-11-29T02:53:47.978 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:53:47.968+0000 1694c700 -1 osd.1 157 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:59.165329+0000 front 2019-11-29T02:52:58.987078+0000 (oldest deadline 2019-11-29T02:53:43.636032+0000) 2019-11-29T02:53:48.300 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:53:48.289+0000 1694c700 -1 osd.0 157 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:58.929462+0000 front 2019-11-29T02:52:58.752920+0000 (oldest deadline 2019-11-29T02:53:43.047495+0000) 2019-11-29T02:53:48.372 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:53:48.366+0000 1694c700 -1 osd.6 157 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:102458 2.35s0 2:af24ec70:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.651_cc8c66a196964cc2ab50acb2ec8f77d0.txt:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~0,setxattr user.rgw.manifest (365) in=382b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (11) in=32b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e154) 2019-11-29T02:53:48.527 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:53:48.497+0000 1694c700 -1 osd.4 157 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:58.411560+0000 front 2019-11-29T02:52:58.400042+0000 (oldest deadline 2019-11-29T02:53:39.899459+0000) 2019-11-29T02:53:48.607 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:53:48.581+0000 1694c700 -1 osd.7 157 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:58.600494+0000 front 2019-11-29T02:52:57.739178+0000 (oldest deadline 2019-11-29T02:53:40.432593+0000) 2019-11-29T02:53:48.737 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:53:48.735+0000 1694c700 -1 osd.2 157 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:58.529746+0000 front 2019-11-29T02:52:58.599552+0000 (oldest deadline 2019-11-29T02:53:39.584374+0000) 2019-11-29T02:53:48.969 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:53:48.967+0000 1694c700 -1 osd.1 157 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:59.165329+0000 front 2019-11-29T02:52:58.987078+0000 (oldest deadline 2019-11-29T02:53:43.636032+0000) 2019-11-29T02:53:49.297 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:53:49.295+0000 1694c700 -1 osd.0 157 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:58.929462+0000 front 2019-11-29T02:52:58.752920+0000 (oldest deadline 2019-11-29T02:53:43.047495+0000) 2019-11-29T02:53:49.338 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:53:49.334+0000 1694c700 -1 osd.6 157 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:102458 2.35s0 2:af24ec70:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.651_cc8c66a196964cc2ab50acb2ec8f77d0.txt:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~0,setxattr user.rgw.manifest (365) in=382b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (11) in=32b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e154) 2019-11-29T02:53:49.462 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:53:49.458+0000 1694c700 -1 osd.4 157 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:58.411560+0000 front 2019-11-29T02:52:58.400042+0000 (oldest deadline 2019-11-29T02:53:39.899459+0000) 2019-11-29T02:53:49.607 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:53:49.603+0000 1694c700 -1 osd.7 157 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:58.600494+0000 front 2019-11-29T02:52:57.739178+0000 (oldest deadline 2019-11-29T02:53:40.432593+0000) 2019-11-29T02:53:50.008 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:53:49.977+0000 1694c700 -1 osd.1 157 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:52:59.165329+0000 front 2019-11-29T02:52:58.987078+0000 (oldest deadline 2019-11-29T02:53:43.636032+0000) 2019-11-29T02:53:50.657 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:53:50.647+0000 1694c700 -1 osd.6 158 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:102458 2.35s0 2:af24ec70:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.651_cc8c66a196964cc2ab50acb2ec8f77d0.txt:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~0,setxattr user.rgw.manifest (365) in=382b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (11) in=32b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e154) 2019-11-29T02:53:51.689 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:53:51.685+0000 1694c700 -1 osd.6 159 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:102458 2.35s0 2:af24ec70:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.651_cc8c66a196964cc2ab50acb2ec8f77d0.txt:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~0,setxattr user.rgw.manifest (365) in=382b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (11) in=32b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e154) 2019-11-29T02:53:52.786 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:53:52.701+0000 1694c700 -1 osd.6 159 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:102458 2.35s0 2:af24ec70:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.651_cc8c66a196964cc2ab50acb2ec8f77d0.txt:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~0,setxattr user.rgw.manifest (365) in=382b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (11) in=32b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e154) 2019-11-29T02:53:53.698 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:53:53.695+0000 1694c700 -1 osd.6 159 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:102458 2.35s0 2:af24ec70:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.651_cc8c66a196964cc2ab50acb2ec8f77d0.txt:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~0,setxattr user.rgw.manifest (365) in=382b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (11) in=32b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e154) 2019-11-29T02:53:53.762 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T02:53:53.752+0000 32785700 -1 osd.3 159 build_incremental_map_msg missing incremental map 145 2019-11-29T02:53:54.704 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:53:54.694+0000 1694c700 -1 osd.6 159 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:102458 2.35s0 2:af24ec70:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.651_cc8c66a196964cc2ab50acb2ec8f77d0.txt:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~0,setxattr user.rgw.manifest (365) in=382b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (11) in=32b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e154) 2019-11-29T02:53:55.745 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:53:55.741+0000 1694c700 -1 osd.6 159 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:102458 2.35s0 2:af24ec70:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.651_cc8c66a196964cc2ab50acb2ec8f77d0.txt:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~0,setxattr user.rgw.manifest (365) in=382b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (11) in=32b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e154) 2019-11-29T02:53:56.715 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:53:56.711+0000 1694c700 -1 osd.6 159 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:102458 2.35s0 2:af24ec70:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.651_cc8c66a196964cc2ab50acb2ec8f77d0.txt:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~0,setxattr user.rgw.manifest (365) in=382b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (11) in=32b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e154) 2019-11-29T02:53:57.760 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:53:57.756+0000 1694c700 -1 osd.6 159 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:102458 2.35s0 2:af24ec70:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.651_cc8c66a196964cc2ab50acb2ec8f77d0.txt:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~0,setxattr user.rgw.manifest (365) in=382b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (11) in=32b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e154) 2019-11-29T02:53:58.782 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:53:58.778+0000 1694c700 -1 osd.6 159 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:102458 2.35s0 2:af24ec70:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.651_cc8c66a196964cc2ab50acb2ec8f77d0.txt:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~0,setxattr user.rgw.manifest (365) in=382b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (11) in=32b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e154) 2019-11-29T02:53:59.827 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:53:59.824+0000 1694c700 -1 osd.6 159 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:102458 2.35s0 2:af24ec70:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.651_cc8c66a196964cc2ab50acb2ec8f77d0.txt:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~0,setxattr user.rgw.manifest (365) in=382b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (11) in=32b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e154) 2019-11-29T02:54:00.792 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:54:00.788+0000 1694c700 -1 osd.6 159 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:102458 2.35s0 2:af24ec70:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.651_cc8c66a196964cc2ab50acb2ec8f77d0.txt:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~0,setxattr user.rgw.manifest (365) in=382b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (11) in=32b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e154) 2019-11-29T02:54:01.778 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:54:01.774+0000 1694c700 -1 osd.6 159 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:102458 2.35s0 2:af24ec70:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.651_cc8c66a196964cc2ab50acb2ec8f77d0.txt:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~0,setxattr user.rgw.manifest (365) in=382b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (11) in=32b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e154) 2019-11-29T02:54:02.781 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:54:02.778+0000 1694c700 -1 osd.6 159 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:102458 2.35s0 2:af24ec70:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.651_cc8c66a196964cc2ab50acb2ec8f77d0.txt:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~0,setxattr user.rgw.manifest (365) in=382b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (11) in=32b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e154) 2019-11-29T02:54:03.786 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:54:03.782+0000 1694c700 -1 osd.6 159 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:102458 2.35s0 2:af24ec70:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.651_cc8c66a196964cc2ab50acb2ec8f77d0.txt:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~0,setxattr user.rgw.manifest (365) in=382b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (11) in=32b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e154) 2019-11-29T02:54:04.836 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:54:04.833+0000 1694c700 -1 osd.6 159 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:102458 2.35s0 2:af24ec70:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.651_cc8c66a196964cc2ab50acb2ec8f77d0.txt:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~0,setxattr user.rgw.manifest (365) in=382b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (11) in=32b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e154) 2019-11-29T02:54:05.826 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:54:05.822+0000 1694c700 -1 osd.6 159 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:102458 2.35s0 2:af24ec70:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.651_cc8c66a196964cc2ab50acb2ec8f77d0.txt:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~0,setxattr user.rgw.manifest (365) in=382b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (11) in=32b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e154) 2019-11-29T02:54:06.851 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:54:06.847+0000 1694c700 -1 osd.6 159 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:102458 2.35s0 2:af24ec70:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.651_cc8c66a196964cc2ab50acb2ec8f77d0.txt:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~0,setxattr user.rgw.manifest (365) in=382b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (11) in=32b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e154) 2019-11-29T02:54:20.363 INFO:teuthology.orchestra.run.smithi074.stderr:testContentTypeGuessing (test.functional.tests.TestFile) ... ok 2019-11-29T02:54:55.848 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:54:55.786+0000 3778f700 -1 osd.5 162 build_incremental_map_msg missing incremental map 162 2019-11-29T02:54:55.901 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:54:55.818+0000 32f86700 -1 osd.5 162 build_incremental_map_msg missing incremental map 162 2019-11-29T02:54:55.908 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:54:55.845+0000 31f84700 -1 osd.5 162 build_incremental_map_msg missing incremental map 162 2019-11-29T02:54:56.069 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:54:56.031+0000 30f82700 -1 osd.5 162 build_incremental_map_msg missing incremental map 162 2019-11-29T02:54:56.193 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:54:56.114+0000 34f8a700 -1 osd.5 162 build_incremental_map_msg missing incremental map 162 2019-11-29T02:54:56.665 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:54:56.648+0000 37f90700 -1 osd.5 162 build_incremental_map_msg missing incremental map 162 2019-11-29T02:55:54.626 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:55:54.622+0000 1694c700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:14.220176+0000 front 2019-11-29T02:55:13.230157+0000 (oldest deadline 2019-11-29T02:55:54.115457+0000) 2019-11-29T02:55:54.870 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:55:54.866+0000 1694c700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:09.534197+0000 front 2019-11-29T02:55:14.815089+0000 (oldest deadline 2019-11-29T02:55:54.799222+0000) 2019-11-29T02:55:55.623 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:55:55.616+0000 1694c700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:11.759927+0000 front 2019-11-29T02:55:11.761451+0000 (oldest deadline 2019-11-29T02:55:55.230112+0000) 2019-11-29T02:55:55.664 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:55:55.658+0000 1694c700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:14.220176+0000 front 2019-11-29T02:55:13.230157+0000 (oldest deadline 2019-11-29T02:55:54.115457+0000) 2019-11-29T02:55:55.890 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:55:55.885+0000 1694c700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:09.534197+0000 front 2019-11-29T02:55:14.815089+0000 (oldest deadline 2019-11-29T02:55:54.799222+0000) 2019-11-29T02:55:56.182 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:55:56.175+0000 1694c700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.107230+0000 front 2019-11-29T02:55:13.229700+0000 (oldest deadline 2019-11-29T02:55:55.253206+0000) 2019-11-29T02:55:56.617 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:55:56.609+0000 1694c700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:11.759927+0000 front 2019-11-29T02:55:11.761451+0000 (oldest deadline 2019-11-29T02:55:55.230112+0000) 2019-11-29T02:55:56.631 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:55:56.626+0000 1694c700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:14.220176+0000 front 2019-11-29T02:55:13.230157+0000 (oldest deadline 2019-11-29T02:55:54.115457+0000) 2019-11-29T02:55:56.930 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:55:56.925+0000 1694c700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:09.534197+0000 front 2019-11-29T02:55:14.815089+0000 (oldest deadline 2019-11-29T02:55:54.799222+0000) 2019-11-29T02:55:57.232 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:55:57.224+0000 1694c700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.107230+0000 front 2019-11-29T02:55:13.229700+0000 (oldest deadline 2019-11-29T02:55:55.253206+0000) 2019-11-29T02:55:57.579 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:55:57.572+0000 1694c700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:11.759927+0000 front 2019-11-29T02:55:11.761451+0000 (oldest deadline 2019-11-29T02:55:55.230112+0000) 2019-11-29T02:55:57.657 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:55:57.653+0000 1694c700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.027005+0000 front 2019-11-29T02:55:13.226719+0000 (oldest deadline 2019-11-29T02:55:57.052956+0000) 2019-11-29T02:55:57.671 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:55:57.667+0000 1694c700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:14.220176+0000 front 2019-11-29T02:55:13.230157+0000 (oldest deadline 2019-11-29T02:55:54.115457+0000) 2019-11-29T02:55:57.887 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:55:57.882+0000 1694c700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:09.534197+0000 front 2019-11-29T02:55:14.815089+0000 (oldest deadline 2019-11-29T02:55:54.799222+0000) 2019-11-29T02:55:58.286 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:55:58.280+0000 1694c700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.107230+0000 front 2019-11-29T02:55:13.229700+0000 (oldest deadline 2019-11-29T02:55:55.253206+0000) 2019-11-29T02:55:58.582 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:55:58.576+0000 1694c700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:11.759927+0000 front 2019-11-29T02:55:11.761451+0000 (oldest deadline 2019-11-29T02:55:55.230112+0000) 2019-11-29T02:55:58.637 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:55:58.633+0000 1694c700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.027005+0000 front 2019-11-29T02:55:13.226719+0000 (oldest deadline 2019-11-29T02:55:57.052956+0000) 2019-11-29T02:55:58.693 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:55:58.690+0000 1694c700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:14.220176+0000 front 2019-11-29T02:55:13.230157+0000 (oldest deadline 2019-11-29T02:55:54.115457+0000) 2019-11-29T02:55:58.891 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:55:58.888+0000 1694c700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:09.534197+0000 front 2019-11-29T02:55:14.815089+0000 (oldest deadline 2019-11-29T02:55:54.799222+0000) 2019-11-29T02:55:59.302 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:55:59.296+0000 1694c700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.107230+0000 front 2019-11-29T02:55:13.229700+0000 (oldest deadline 2019-11-29T02:55:55.253206+0000) 2019-11-29T02:55:59.425 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:55:59.420+0000 1694c700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.903425+0000 front 2019-11-29T02:55:13.964533+0000 (oldest deadline 2019-11-29T02:55:59.134295+0000) 2019-11-29T02:55:59.610 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:55:59.604+0000 1694c700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:11.759927+0000 front 2019-11-29T02:55:11.761451+0000 (oldest deadline 2019-11-29T02:55:55.230112+0000) 2019-11-29T02:55:59.629 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:55:59.625+0000 1694c700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.027005+0000 front 2019-11-29T02:55:13.226719+0000 (oldest deadline 2019-11-29T02:55:57.052956+0000) 2019-11-29T02:55:59.697 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:55:59.694+0000 1694c700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:14.220176+0000 front 2019-11-29T02:55:13.230157+0000 (oldest deadline 2019-11-29T02:55:54.115457+0000) 2019-11-29T02:55:59.816 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:55:59.811+0000 1694c700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:15.124978+0000 front 2019-11-29T02:55:13.627013+0000 (oldest deadline 2019-11-29T02:55:58.883214+0000) 2019-11-29T02:55:59.865 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:55:59.862+0000 1694c700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:09.534197+0000 front 2019-11-29T02:55:14.815089+0000 (oldest deadline 2019-11-29T02:55:54.799222+0000) 2019-11-29T02:56:00.296 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:56:00.290+0000 1694c700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.107230+0000 front 2019-11-29T02:55:13.229700+0000 (oldest deadline 2019-11-29T02:55:55.253206+0000) 2019-11-29T02:56:00.402 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:56:00.395+0000 1694c700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.903425+0000 front 2019-11-29T02:55:13.964533+0000 (oldest deadline 2019-11-29T02:55:59.134295+0000) 2019-11-29T02:56:00.619 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:56:00.613+0000 1694c700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:11.759927+0000 front 2019-11-29T02:55:11.761451+0000 (oldest deadline 2019-11-29T02:55:55.230112+0000) 2019-11-29T02:56:00.649 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:56:00.646+0000 1694c700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.027005+0000 front 2019-11-29T02:55:13.226719+0000 (oldest deadline 2019-11-29T02:55:57.052956+0000) 2019-11-29T02:56:00.733 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:56:00.731+0000 1694c700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:14.220176+0000 front 2019-11-29T02:55:13.230157+0000 (oldest deadline 2019-11-29T02:55:54.115457+0000) 2019-11-29T02:56:00.864 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:56:00.857+0000 1694c700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:15.124978+0000 front 2019-11-29T02:55:13.627013+0000 (oldest deadline 2019-11-29T02:55:58.883214+0000) 2019-11-29T02:56:00.875 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:56:00.871+0000 1694c700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:09.534197+0000 front 2019-11-29T02:55:14.815089+0000 (oldest deadline 2019-11-29T02:55:54.799222+0000) 2019-11-29T02:56:01.338 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:56:01.333+0000 1694c700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.107230+0000 front 2019-11-29T02:55:13.229700+0000 (oldest deadline 2019-11-29T02:55:55.253206+0000) 2019-11-29T02:56:01.405 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:56:01.399+0000 1694c700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.903425+0000 front 2019-11-29T02:55:13.964533+0000 (oldest deadline 2019-11-29T02:55:59.134295+0000) 2019-11-29T02:56:01.625 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:56:01.620+0000 1694c700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.027005+0000 front 2019-11-29T02:55:13.226719+0000 (oldest deadline 2019-11-29T02:55:57.052956+0000) 2019-11-29T02:56:01.653 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:56:01.648+0000 1694c700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:11.759927+0000 front 2019-11-29T02:55:11.761451+0000 (oldest deadline 2019-11-29T02:55:55.230112+0000) 2019-11-29T02:56:01.772 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:56:01.769+0000 1694c700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:14.220176+0000 front 2019-11-29T02:55:13.230157+0000 (oldest deadline 2019-11-29T02:55:54.115457+0000) 2019-11-29T02:56:01.857 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:56:01.851+0000 1694c700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:15.124978+0000 front 2019-11-29T02:55:13.627013+0000 (oldest deadline 2019-11-29T02:55:58.883214+0000) 2019-11-29T02:56:01.920 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:56:01.915+0000 1694c700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:09.534197+0000 front 2019-11-29T02:55:14.815089+0000 (oldest deadline 2019-11-29T02:55:54.799222+0000) 2019-11-29T02:56:02.342 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:56:02.335+0000 1694c700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.107230+0000 front 2019-11-29T02:55:13.229700+0000 (oldest deadline 2019-11-29T02:55:55.253206+0000) 2019-11-29T02:56:02.386 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:56:02.380+0000 1694c700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.903425+0000 front 2019-11-29T02:55:13.964533+0000 (oldest deadline 2019-11-29T02:55:59.134295+0000) 2019-11-29T02:56:02.622 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:56:02.618+0000 1694c700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.027005+0000 front 2019-11-29T02:55:13.226719+0000 (oldest deadline 2019-11-29T02:55:57.052956+0000) 2019-11-29T02:56:02.626 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:56:02.622+0000 1694c700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:11.759927+0000 front 2019-11-29T02:55:11.761451+0000 (oldest deadline 2019-11-29T02:55:55.230112+0000) 2019-11-29T02:56:02.793 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:56:02.790+0000 1694c700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:14.220176+0000 front 2019-11-29T02:55:13.230157+0000 (oldest deadline 2019-11-29T02:55:54.115457+0000) 2019-11-29T02:56:02.839 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:56:02.833+0000 1694c700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:15.124978+0000 front 2019-11-29T02:55:13.627013+0000 (oldest deadline 2019-11-29T02:55:58.883214+0000) 2019-11-29T02:56:02.883 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:56:02.877+0000 1694c700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:09.534197+0000 front 2019-11-29T02:55:14.815089+0000 (oldest deadline 2019-11-29T02:55:54.799222+0000) 2019-11-29T02:56:03.370 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:56:03.364+0000 1694c700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.903425+0000 front 2019-11-29T02:55:13.964533+0000 (oldest deadline 2019-11-29T02:55:59.134295+0000) 2019-11-29T02:56:03.386 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:56:03.380+0000 1694c700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.107230+0000 front 2019-11-29T02:55:13.229700+0000 (oldest deadline 2019-11-29T02:55:55.253206+0000) 2019-11-29T02:56:03.589 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:56:03.585+0000 1694c700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.027005+0000 front 2019-11-29T02:55:13.226719+0000 (oldest deadline 2019-11-29T02:55:57.052956+0000) 2019-11-29T02:56:03.666 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:56:03.661+0000 1694c700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:11.759927+0000 front 2019-11-29T02:55:11.761451+0000 (oldest deadline 2019-11-29T02:55:55.230112+0000) 2019-11-29T02:56:03.822 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:56:03.819+0000 1694c700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:14.220176+0000 front 2019-11-29T02:55:13.230157+0000 (oldest deadline 2019-11-29T02:55:54.115457+0000) 2019-11-29T02:56:03.829 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:56:03.824+0000 1694c700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:15.124978+0000 front 2019-11-29T02:55:13.627013+0000 (oldest deadline 2019-11-29T02:55:58.883214+0000) 2019-11-29T02:56:03.892 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:56:03.887+0000 1694c700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:09.534197+0000 front 2019-11-29T02:55:14.815089+0000 (oldest deadline 2019-11-29T02:55:54.799222+0000) 2019-11-29T02:56:04.335 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:56:04.329+0000 1694c700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.903425+0000 front 2019-11-29T02:55:13.964533+0000 (oldest deadline 2019-11-29T02:55:59.134295+0000) 2019-11-29T02:56:04.413 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:56:04.408+0000 1694c700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.107230+0000 front 2019-11-29T02:55:13.229700+0000 (oldest deadline 2019-11-29T02:55:55.253206+0000) 2019-11-29T02:56:04.587 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:56:04.584+0000 1694c700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.027005+0000 front 2019-11-29T02:55:13.226719+0000 (oldest deadline 2019-11-29T02:55:57.052956+0000) 2019-11-29T02:56:04.681 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:56:04.676+0000 1694c700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:11.759927+0000 front 2019-11-29T02:55:11.761451+0000 (oldest deadline 2019-11-29T02:55:55.230112+0000) 2019-11-29T02:56:04.831 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:56:04.826+0000 1694c700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:15.124978+0000 front 2019-11-29T02:55:13.627013+0000 (oldest deadline 2019-11-29T02:55:58.883214+0000) 2019-11-29T02:56:04.873 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:56:04.869+0000 1694c700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:14.220176+0000 front 2019-11-29T02:55:13.230157+0000 (oldest deadline 2019-11-29T02:55:54.115457+0000) 2019-11-29T02:56:04.911 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:56:04.908+0000 1694c700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:09.534197+0000 front 2019-11-29T02:55:14.815089+0000 (oldest deadline 2019-11-29T02:55:54.799222+0000) 2019-11-29T02:56:05.389 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:56:05.383+0000 1694c700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.903425+0000 front 2019-11-29T02:55:13.964533+0000 (oldest deadline 2019-11-29T02:55:59.134295+0000) 2019-11-29T02:56:05.426 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:56:05.419+0000 1694c700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.107230+0000 front 2019-11-29T02:55:13.229700+0000 (oldest deadline 2019-11-29T02:55:55.253206+0000) 2019-11-29T02:56:05.636 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:56:05.632+0000 1694c700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.027005+0000 front 2019-11-29T02:55:13.226719+0000 (oldest deadline 2019-11-29T02:55:57.052956+0000) 2019-11-29T02:56:05.717 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:56:05.711+0000 1694c700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:11.759927+0000 front 2019-11-29T02:55:11.761451+0000 (oldest deadline 2019-11-29T02:55:55.230112+0000) 2019-11-29T02:56:05.867 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:56:05.860+0000 1694c700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:15.124978+0000 front 2019-11-29T02:55:13.627013+0000 (oldest deadline 2019-11-29T02:55:58.883214+0000) 2019-11-29T02:56:05.871 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:56:05.867+0000 1694c700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:09.534197+0000 front 2019-11-29T02:55:14.815089+0000 (oldest deadline 2019-11-29T02:55:54.799222+0000) 2019-11-29T02:56:05.889 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:56:05.886+0000 1694c700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:14.220176+0000 front 2019-11-29T02:55:13.230157+0000 (oldest deadline 2019-11-29T02:55:54.115457+0000) 2019-11-29T02:56:06.402 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:56:06.396+0000 1694c700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.107230+0000 front 2019-11-29T02:55:13.229700+0000 (oldest deadline 2019-11-29T02:55:55.253206+0000) 2019-11-29T02:56:06.415 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:56:06.407+0000 1694c700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.903425+0000 front 2019-11-29T02:55:13.964533+0000 (oldest deadline 2019-11-29T02:55:59.134295+0000) 2019-11-29T02:56:06.620 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:56:06.614+0000 1694c700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.027005+0000 front 2019-11-29T02:55:13.226719+0000 (oldest deadline 2019-11-29T02:55:57.052956+0000) 2019-11-29T02:56:06.687 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:56:06.682+0000 1694c700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:11.759927+0000 front 2019-11-29T02:55:11.761451+0000 (oldest deadline 2019-11-29T02:55:55.230112+0000) 2019-11-29T02:56:06.853 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:56:06.850+0000 1694c700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:14.220176+0000 front 2019-11-29T02:55:13.230157+0000 (oldest deadline 2019-11-29T02:55:54.115457+0000) 2019-11-29T02:56:06.890 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:56:06.886+0000 1694c700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:09.534197+0000 front 2019-11-29T02:55:14.815089+0000 (oldest deadline 2019-11-29T02:55:54.799222+0000) 2019-11-29T02:56:06.894 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:56:06.889+0000 1694c700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:15.124978+0000 front 2019-11-29T02:55:13.627013+0000 (oldest deadline 2019-11-29T02:55:58.883214+0000) 2019-11-29T02:56:07.399 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:56:07.393+0000 1694c700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.107230+0000 front 2019-11-29T02:55:13.229700+0000 (oldest deadline 2019-11-29T02:55:55.253206+0000) 2019-11-29T02:56:07.404 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:56:07.399+0000 1694c700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.903425+0000 front 2019-11-29T02:55:13.964533+0000 (oldest deadline 2019-11-29T02:55:59.134295+0000) 2019-11-29T02:56:07.611 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:56:07.607+0000 1694c700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.027005+0000 front 2019-11-29T02:55:13.226719+0000 (oldest deadline 2019-11-29T02:55:57.052956+0000) 2019-11-29T02:56:07.723 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:56:07.718+0000 1694c700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:11.759927+0000 front 2019-11-29T02:55:11.761451+0000 (oldest deadline 2019-11-29T02:55:55.230112+0000) 2019-11-29T02:56:07.826 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:56:07.823+0000 1694c700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:14.220176+0000 front 2019-11-29T02:55:13.230157+0000 (oldest deadline 2019-11-29T02:55:54.115457+0000) 2019-11-29T02:56:07.852 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:56:07.849+0000 1694c700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:09.534197+0000 front 2019-11-29T02:55:14.815089+0000 (oldest deadline 2019-11-29T02:55:54.799222+0000) 2019-11-29T02:56:07.937 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:56:07.933+0000 1694c700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:15.124978+0000 front 2019-11-29T02:55:13.627013+0000 (oldest deadline 2019-11-29T02:55:58.883214+0000) 2019-11-29T02:56:08.391 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:56:08.385+0000 1694c700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.107230+0000 front 2019-11-29T02:55:13.229700+0000 (oldest deadline 2019-11-29T02:55:55.253206+0000) 2019-11-29T02:56:08.395 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:56:08.389+0000 1694c700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.903425+0000 front 2019-11-29T02:55:13.964533+0000 (oldest deadline 2019-11-29T02:55:59.134295+0000) 2019-11-29T02:56:08.629 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:56:08.625+0000 1694c700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.027005+0000 front 2019-11-29T02:55:13.226719+0000 (oldest deadline 2019-11-29T02:55:57.052956+0000) 2019-11-29T02:56:08.760 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:56:08.754+0000 1694c700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:11.759927+0000 front 2019-11-29T02:55:11.761451+0000 (oldest deadline 2019-11-29T02:55:55.230112+0000) 2019-11-29T02:56:08.843 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:56:08.839+0000 1694c700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:09.534197+0000 front 2019-11-29T02:55:14.815089+0000 (oldest deadline 2019-11-29T02:55:54.799222+0000) 2019-11-29T02:56:08.879 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:56:08.876+0000 1694c700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:14.220176+0000 front 2019-11-29T02:55:13.230157+0000 (oldest deadline 2019-11-29T02:55:54.115457+0000) 2019-11-29T02:56:08.982 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:56:08.977+0000 1694c700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:15.124978+0000 front 2019-11-29T02:55:13.627013+0000 (oldest deadline 2019-11-29T02:55:58.883214+0000) 2019-11-29T02:56:09.363 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:56:09.357+0000 1694c700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.107230+0000 front 2019-11-29T02:55:13.229700+0000 (oldest deadline 2019-11-29T02:55:55.253206+0000) 2019-11-29T02:56:09.398 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:56:09.392+0000 1694c700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.903425+0000 front 2019-11-29T02:55:13.964533+0000 (oldest deadline 2019-11-29T02:55:59.134295+0000) 2019-11-29T02:56:09.606 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:56:09.604+0000 1694c700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.027005+0000 front 2019-11-29T02:55:13.226719+0000 (oldest deadline 2019-11-29T02:55:57.052956+0000) 2019-11-29T02:56:09.773 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:56:09.767+0000 1694c700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:11.759927+0000 front 2019-11-29T02:55:11.761451+0000 (oldest deadline 2019-11-29T02:55:55.230112+0000) 2019-11-29T02:56:09.839 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:56:09.836+0000 1694c700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:09.534197+0000 front 2019-11-29T02:55:14.815089+0000 (oldest deadline 2019-11-29T02:55:54.799222+0000) 2019-11-29T02:56:09.877 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:56:09.875+0000 1694c700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:14.220176+0000 front 2019-11-29T02:55:13.230157+0000 (oldest deadline 2019-11-29T02:55:54.115457+0000) 2019-11-29T02:56:10.027 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:56:10.020+0000 1694c700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:15.124978+0000 front 2019-11-29T02:55:13.627013+0000 (oldest deadline 2019-11-29T02:55:58.883214+0000) 2019-11-29T02:56:10.329 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:56:10.325+0000 1694c700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.107230+0000 front 2019-11-29T02:55:13.229700+0000 (oldest deadline 2019-11-29T02:55:55.253206+0000) 2019-11-29T02:56:10.399 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:56:10.393+0000 1694c700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.903425+0000 front 2019-11-29T02:55:13.964533+0000 (oldest deadline 2019-11-29T02:55:59.134295+0000) 2019-11-29T02:56:10.586 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:56:10.583+0000 1694c700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.027005+0000 front 2019-11-29T02:55:13.226719+0000 (oldest deadline 2019-11-29T02:55:57.052956+0000) 2019-11-29T02:56:10.767 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:56:10.762+0000 1694c700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:11.759927+0000 front 2019-11-29T02:55:11.761451+0000 (oldest deadline 2019-11-29T02:55:55.230112+0000) 2019-11-29T02:56:10.840 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:56:10.837+0000 1694c700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:14.220176+0000 front 2019-11-29T02:55:13.230157+0000 (oldest deadline 2019-11-29T02:55:54.115457+0000) 2019-11-29T02:56:10.864 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:56:10.860+0000 1694c700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:09.534197+0000 front 2019-11-29T02:55:14.815089+0000 (oldest deadline 2019-11-29T02:55:54.799222+0000) 2019-11-29T02:56:11.051 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:56:11.046+0000 1694c700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:15.124978+0000 front 2019-11-29T02:55:13.627013+0000 (oldest deadline 2019-11-29T02:55:58.883214+0000) 2019-11-29T02:56:11.300 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:56:11.295+0000 1694c700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.107230+0000 front 2019-11-29T02:55:13.229700+0000 (oldest deadline 2019-11-29T02:55:55.253206+0000) 2019-11-29T02:56:11.452 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:56:11.446+0000 1694c700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.903425+0000 front 2019-11-29T02:55:13.964533+0000 (oldest deadline 2019-11-29T02:55:59.134295+0000) 2019-11-29T02:56:11.569 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:56:11.564+0000 1694c700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.027005+0000 front 2019-11-29T02:55:13.226719+0000 (oldest deadline 2019-11-29T02:55:57.052956+0000) 2019-11-29T02:56:11.755 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:56:11.750+0000 1694c700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:11.759927+0000 front 2019-11-29T02:55:11.761451+0000 (oldest deadline 2019-11-29T02:55:55.230112+0000) 2019-11-29T02:56:11.863 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:56:11.860+0000 1694c700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:09.534197+0000 front 2019-11-29T02:55:14.815089+0000 (oldest deadline 2019-11-29T02:55:54.799222+0000) 2019-11-29T02:56:11.880 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:56:11.876+0000 1694c700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:14.220176+0000 front 2019-11-29T02:55:13.230157+0000 (oldest deadline 2019-11-29T02:55:54.115457+0000) 2019-11-29T02:56:12.098 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:56:12.093+0000 1694c700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:15.124978+0000 front 2019-11-29T02:55:13.627013+0000 (oldest deadline 2019-11-29T02:55:58.883214+0000) 2019-11-29T02:56:12.259 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:56:12.254+0000 1694c700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.107230+0000 front 2019-11-29T02:55:13.229700+0000 (oldest deadline 2019-11-29T02:55:55.253206+0000) 2019-11-29T02:56:12.452 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:56:12.446+0000 1694c700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.903425+0000 front 2019-11-29T02:55:13.964533+0000 (oldest deadline 2019-11-29T02:55:59.134295+0000) 2019-11-29T02:56:12.574 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:56:12.570+0000 1694c700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.027005+0000 front 2019-11-29T02:55:13.226719+0000 (oldest deadline 2019-11-29T02:55:57.052956+0000) 2019-11-29T02:56:12.762 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:56:12.757+0000 1694c700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:11.759927+0000 front 2019-11-29T02:55:11.761451+0000 (oldest deadline 2019-11-29T02:55:55.230112+0000) 2019-11-29T02:56:12.845 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:56:12.841+0000 1694c700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:14.220176+0000 front 2019-11-29T02:55:13.230157+0000 (oldest deadline 2019-11-29T02:55:54.115457+0000) 2019-11-29T02:56:12.882 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:56:12.878+0000 1694c700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:09.534197+0000 front 2019-11-29T02:55:14.815089+0000 (oldest deadline 2019-11-29T02:55:54.799222+0000) 2019-11-29T02:56:13.105 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:56:13.100+0000 1694c700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:15.124978+0000 front 2019-11-29T02:55:13.627013+0000 (oldest deadline 2019-11-29T02:55:58.883214+0000) 2019-11-29T02:56:13.222 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:56:13.217+0000 1694c700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.107230+0000 front 2019-11-29T02:55:13.229700+0000 (oldest deadline 2019-11-29T02:55:55.253206+0000) 2019-11-29T02:56:13.481 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:56:13.475+0000 1694c700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.903425+0000 front 2019-11-29T02:55:13.964533+0000 (oldest deadline 2019-11-29T02:55:59.134295+0000) 2019-11-29T02:56:13.567 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:56:13.563+0000 1694c700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.027005+0000 front 2019-11-29T02:55:13.226719+0000 (oldest deadline 2019-11-29T02:55:57.052956+0000) 2019-11-29T02:56:13.724 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:56:13.717+0000 1694c700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:11.759927+0000 front 2019-11-29T02:55:11.761451+0000 (oldest deadline 2019-11-29T02:55:55.230112+0000) 2019-11-29T02:56:13.805 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:56:13.801+0000 1694c700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:14.220176+0000 front 2019-11-29T02:55:13.230157+0000 (oldest deadline 2019-11-29T02:55:54.115457+0000) 2019-11-29T02:56:13.873 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:56:13.869+0000 1694c700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:09.534197+0000 front 2019-11-29T02:55:14.815089+0000 (oldest deadline 2019-11-29T02:55:54.799222+0000) 2019-11-29T02:56:14.151 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:56:14.146+0000 1694c700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:15.124978+0000 front 2019-11-29T02:55:13.627013+0000 (oldest deadline 2019-11-29T02:55:58.883214+0000) 2019-11-29T02:56:14.250 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:56:14.244+0000 1694c700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.107230+0000 front 2019-11-29T02:55:13.229700+0000 (oldest deadline 2019-11-29T02:55:55.253206+0000) 2019-11-29T02:56:14.445 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:56:14.439+0000 1694c700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.903425+0000 front 2019-11-29T02:55:13.964533+0000 (oldest deadline 2019-11-29T02:55:59.134295+0000) 2019-11-29T02:56:14.569 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:56:14.564+0000 1694c700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.027005+0000 front 2019-11-29T02:55:13.226719+0000 (oldest deadline 2019-11-29T02:55:57.052956+0000) 2019-11-29T02:56:14.700 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:56:14.694+0000 1694c700 -1 osd.5 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:11.759927+0000 front 2019-11-29T02:55:11.761451+0000 (oldest deadline 2019-11-29T02:55:55.230112+0000) 2019-11-29T02:56:14.775 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:56:14.771+0000 1694c700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:14.220176+0000 front 2019-11-29T02:55:13.230157+0000 (oldest deadline 2019-11-29T02:55:54.115457+0000) 2019-11-29T02:56:14.862 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:56:14.857+0000 1694c700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:09.534197+0000 front 2019-11-29T02:55:14.815089+0000 (oldest deadline 2019-11-29T02:55:54.799222+0000) 2019-11-29T02:56:15.149 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:56:15.144+0000 1694c700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:15.124978+0000 front 2019-11-29T02:55:13.627013+0000 (oldest deadline 2019-11-29T02:55:58.883214+0000) 2019-11-29T02:56:15.292 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:56:15.288+0000 1694c700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.107230+0000 front 2019-11-29T02:55:13.229700+0000 (oldest deadline 2019-11-29T02:55:55.253206+0000) 2019-11-29T02:56:15.401 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:56:15.396+0000 1694c700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:55:13.903425+0000 front 2019-11-29T02:55:13.964533+0000 (oldest deadline 2019-11-29T02:55:59.134295+0000) 2019-11-29T02:56:30.194 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:10:12.412 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:56:30.245 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:10:12.463 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:56:30.257 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:10:12.476 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:56:30.262 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:10:12.481 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:56:30.266 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:10:12.495 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:56:30.273 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:10:12.502 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:56:30.450 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:10:12.669 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:56:30.520 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:10:12.738 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:56:30.628 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:10:12.853 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:56:31.974 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:10:14.191 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:56:31.983 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:10:14.198 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:56:31.988 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:10:14.207 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:56:31.989 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:10:14.218 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:56:31.993 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:10:14.222 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:56:31.994 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:10:14.213 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:56:31.999 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:10:14.217 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T02:56:32.016 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:10:14.245 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T02:56:32.025 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:10:14.244 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T02:56:49.985 INFO:teuthology.orchestra.run.smithi074.stderr:testCopy (test.functional.tests.TestFile) ... ok 2019-11-29T02:57:04.926 INFO:teuthology.orchestra.run.smithi074.stderr:testCopy404s (test.functional.tests.TestFile) ... ok 2019-11-29T02:57:06.979 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:57:06.803+0000 11cac700 -1 osd.6 167 build_incremental_map_msg missing incremental map 167 2019-11-29T02:57:07.132 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:57:06.953+0000 31f84700 -1 osd.6 167 build_incremental_map_msg missing incremental map 167 2019-11-29T02:57:07.163 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:57:06.978+0000 37f90700 -1 osd.6 167 build_incremental_map_msg missing incremental map 167 2019-11-29T02:57:07.175 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:57:07.005+0000 32785700 -1 osd.6 167 build_incremental_map_msg missing incremental map 167 2019-11-29T02:57:07.219 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:57:07.194+0000 31f84700 -1 osd.4 167 build_incremental_map_msg missing incremental map 167 2019-11-29T02:57:07.256 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:57:07.234+0000 124ad700 -1 osd.4 167 build_incremental_map_msg missing incremental map 167 2019-11-29T02:57:07.272 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:57:07.220+0000 38791700 -1 osd.6 167 build_incremental_map_msg missing incremental map 167 2019-11-29T02:57:07.316 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:57:07.293+0000 32785700 -1 osd.4 167 build_incremental_map_msg missing incremental map 167 2019-11-29T02:57:07.629 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:57:07.622+0000 3578b700 -1 osd.4 167 build_incremental_map_msg missing incremental map 167 2019-11-29T02:57:07.691 INFO:teuthology.orchestra.run.smithi074.stderr:testCopyDestinationSlashProblems (test.functional.tests.TestFile) ... ok 2019-11-29T02:57:09.860 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T02:57:09.761+0000 35f8c700 -1 osd.3 169 build_incremental_map_msg missing incremental map 169 2019-11-29T02:57:10.049 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T02:57:09.965+0000 33f88700 -1 osd.3 169 build_incremental_map_msg missing incremental map 169 2019-11-29T02:57:10.073 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T02:57:09.974+0000 32785700 -1 osd.3 169 build_incremental_map_msg missing incremental map 169 2019-11-29T02:57:10.703 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T02:57:10.646+0000 38f92700 -1 osd.3 169 build_incremental_map_msg missing incremental map 169 2019-11-29T02:57:10.906 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T02:57:10.900+0000 31783700 -1 osd.3 169 build_incremental_map_msg missing incremental map 169 2019-11-29T02:57:11.245 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T02:57:11.230+0000 38791700 -1 osd.3 169 build_incremental_map_msg missing incremental map 169 2019-11-29T02:57:12.220 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:57:12.215+0000 1694c700 -1 osd.0 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:30.075859+0000 front 2019-11-29T02:56:30.077031+0000 (oldest deadline 2019-11-29T02:57:12.082183+0000) 2019-11-29T02:57:13.174 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:57:13.170+0000 1694c700 -1 osd.0 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:30.075859+0000 front 2019-11-29T02:56:30.077031+0000 (oldest deadline 2019-11-29T02:57:12.082183+0000) 2019-11-29T02:57:14.192 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:57:14.188+0000 1694c700 -1 osd.0 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:30.075859+0000 front 2019-11-29T02:56:30.077031+0000 (oldest deadline 2019-11-29T02:57:12.082183+0000) 2019-11-29T02:57:14.445 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:57:14.437+0000 3678d700 -1 osd.6 169 build_incremental_map_msg missing incremental map 167 2019-11-29T02:57:15.225 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:57:15.219+0000 1694c700 -1 osd.0 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:30.075859+0000 front 2019-11-29T02:56:30.077031+0000 (oldest deadline 2019-11-29T02:57:12.082183+0000) 2019-11-29T02:57:16.254 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:57:16.250+0000 1694c700 -1 osd.0 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:30.075859+0000 front 2019-11-29T02:56:30.077031+0000 (oldest deadline 2019-11-29T02:57:12.082183+0000) 2019-11-29T02:57:16.314 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:57:16.309+0000 1694c700 -1 osd.4 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.303509+0000 front 2019-11-29T02:56:31.235909+0000 (oldest deadline 2019-11-29T02:57:15.826054+0000) 2019-11-29T02:57:16.664 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:57:16.660+0000 1694c700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.918370+0000 front 2019-11-29T02:56:31.889341+0000 (oldest deadline 2019-11-29T02:57:15.894975+0000) 2019-11-29T02:57:16.790 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:57:16.785+0000 1694c700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.422574+0000 front 2019-11-29T02:56:31.924852+0000 (oldest deadline 2019-11-29T02:57:16.592558+0000) 2019-11-29T02:57:17.278 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:57:17.274+0000 1694c700 -1 osd.0 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:30.075859+0000 front 2019-11-29T02:56:30.077031+0000 (oldest deadline 2019-11-29T02:57:12.082183+0000) 2019-11-29T02:57:17.313 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:57:17.308+0000 1694c700 -1 osd.4 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.303509+0000 front 2019-11-29T02:56:31.235909+0000 (oldest deadline 2019-11-29T02:57:15.826054+0000) 2019-11-29T02:57:17.633 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:57:17.629+0000 1694c700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.918370+0000 front 2019-11-29T02:56:31.889341+0000 (oldest deadline 2019-11-29T02:57:15.894975+0000) 2019-11-29T02:57:17.722 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:57:17.717+0000 1694c700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:32.076711+0000 front 2019-11-29T02:56:32.075304+0000 (oldest deadline 2019-11-29T02:57:17.109616+0000) 2019-11-29T02:57:17.803 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:57:17.798+0000 1694c700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.422574+0000 front 2019-11-29T02:56:31.924852+0000 (oldest deadline 2019-11-29T02:57:16.592558+0000) 2019-11-29T02:57:18.295 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:57:18.281+0000 1694c700 -1 osd.0 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:30.075859+0000 front 2019-11-29T02:56:30.077031+0000 (oldest deadline 2019-11-29T02:57:12.082183+0000) 2019-11-29T02:57:18.319 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:57:18.314+0000 1694c700 -1 osd.4 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.303509+0000 front 2019-11-29T02:56:31.235909+0000 (oldest deadline 2019-11-29T02:57:15.826054+0000) 2019-11-29T02:57:18.601 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:57:18.596+0000 1694c700 -1 osd.6 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:32.019030+0000 front 2019-11-29T02:56:32.010773+0000 (oldest deadline 2019-11-29T02:57:17.757519+0000) 2019-11-29T02:57:18.657 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:57:18.653+0000 1694c700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.918370+0000 front 2019-11-29T02:56:31.889341+0000 (oldest deadline 2019-11-29T02:57:15.894975+0000) 2019-11-29T02:57:18.713 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:57:18.709+0000 1694c700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:32.076711+0000 front 2019-11-29T02:56:32.075304+0000 (oldest deadline 2019-11-29T02:57:17.109616+0000) 2019-11-29T02:57:18.829 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:57:18.826+0000 1694c700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.422574+0000 front 2019-11-29T02:56:31.924852+0000 (oldest deadline 2019-11-29T02:57:16.592558+0000) 2019-11-29T02:57:19.298 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:57:19.294+0000 1694c700 -1 osd.0 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:30.075859+0000 front 2019-11-29T02:56:30.077031+0000 (oldest deadline 2019-11-29T02:57:12.082183+0000) 2019-11-29T02:57:19.373 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:57:19.365+0000 1694c700 -1 osd.4 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.303509+0000 front 2019-11-29T02:56:31.235909+0000 (oldest deadline 2019-11-29T02:57:15.826054+0000) 2019-11-29T02:57:19.598 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:57:19.593+0000 1694c700 -1 osd.6 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:32.019030+0000 front 2019-11-29T02:56:32.010773+0000 (oldest deadline 2019-11-29T02:57:17.757519+0000) 2019-11-29T02:57:19.653 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:57:19.649+0000 1694c700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.918370+0000 front 2019-11-29T02:56:31.889341+0000 (oldest deadline 2019-11-29T02:57:15.894975+0000) 2019-11-29T02:57:19.681 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:57:19.508+0000 36f8e700 -1 osd.5 169 build_incremental_map_msg missing incremental map 150 2019-11-29T02:57:19.723 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:57:19.718+0000 1694c700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:32.076711+0000 front 2019-11-29T02:56:32.075304+0000 (oldest deadline 2019-11-29T02:57:17.109616+0000) 2019-11-29T02:57:19.790 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:57:19.785+0000 1694c700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.422574+0000 front 2019-11-29T02:56:31.924852+0000 (oldest deadline 2019-11-29T02:57:16.592558+0000) 2019-11-29T02:57:20.209 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:57:20.102+0000 36f8e700 -1 osd.5 169 build_incremental_map_msg missing incremental map 162 2019-11-29T02:57:20.337 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:57:20.333+0000 1694c700 -1 osd.0 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:30.075859+0000 front 2019-11-29T02:56:30.077031+0000 (oldest deadline 2019-11-29T02:57:12.082183+0000) 2019-11-29T02:57:20.400 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:57:20.397+0000 1694c700 -1 osd.4 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.303509+0000 front 2019-11-29T02:56:31.235909+0000 (oldest deadline 2019-11-29T02:57:15.826054+0000) 2019-11-29T02:57:20.594 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:57:20.590+0000 1694c700 -1 osd.6 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:32.019030+0000 front 2019-11-29T02:56:32.010773+0000 (oldest deadline 2019-11-29T02:57:17.757519+0000) 2019-11-29T02:57:20.704 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:57:20.698+0000 1694c700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.918370+0000 front 2019-11-29T02:56:31.889341+0000 (oldest deadline 2019-11-29T02:57:15.894975+0000) 2019-11-29T02:57:20.708 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:57:20.704+0000 1694c700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:32.076711+0000 front 2019-11-29T02:56:32.075304+0000 (oldest deadline 2019-11-29T02:57:17.109616+0000) 2019-11-29T02:57:20.746 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:57:20.742+0000 1694c700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.422574+0000 front 2019-11-29T02:56:31.924852+0000 (oldest deadline 2019-11-29T02:57:16.592558+0000) 2019-11-29T02:57:21.386 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:57:21.381+0000 1694c700 -1 osd.0 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:30.075859+0000 front 2019-11-29T02:56:30.077031+0000 (oldest deadline 2019-11-29T02:57:12.082183+0000) 2019-11-29T02:57:21.412 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:57:21.407+0000 1694c700 -1 osd.4 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.303509+0000 front 2019-11-29T02:56:31.235909+0000 (oldest deadline 2019-11-29T02:57:15.826054+0000) 2019-11-29T02:57:21.587 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:57:21.581+0000 1694c700 -1 osd.6 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:32.019030+0000 front 2019-11-29T02:56:32.010773+0000 (oldest deadline 2019-11-29T02:57:17.757519+0000) 2019-11-29T02:57:21.689 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:57:21.684+0000 1694c700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:32.076711+0000 front 2019-11-29T02:56:32.075304+0000 (oldest deadline 2019-11-29T02:57:17.109616+0000) 2019-11-29T02:57:21.706 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:57:21.702+0000 1694c700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.918370+0000 front 2019-11-29T02:56:31.889341+0000 (oldest deadline 2019-11-29T02:57:15.894975+0000) 2019-11-29T02:57:21.781 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:57:21.776+0000 1694c700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.422574+0000 front 2019-11-29T02:56:31.924852+0000 (oldest deadline 2019-11-29T02:57:16.592558+0000) 2019-11-29T02:57:22.353 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:57:22.350+0000 1694c700 -1 osd.0 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:30.075859+0000 front 2019-11-29T02:56:30.077031+0000 (oldest deadline 2019-11-29T02:57:12.082183+0000) 2019-11-29T02:57:22.445 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:57:22.441+0000 1694c700 -1 osd.4 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.303509+0000 front 2019-11-29T02:56:31.235909+0000 (oldest deadline 2019-11-29T02:57:15.826054+0000) 2019-11-29T02:57:22.581 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:57:22.577+0000 1694c700 -1 osd.6 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:32.019030+0000 front 2019-11-29T02:56:32.010773+0000 (oldest deadline 2019-11-29T02:57:17.757519+0000) 2019-11-29T02:57:22.714 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:57:22.709+0000 1694c700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:32.076711+0000 front 2019-11-29T02:56:32.075304+0000 (oldest deadline 2019-11-29T02:57:17.109616+0000) 2019-11-29T02:57:22.746 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:57:22.743+0000 1694c700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.918370+0000 front 2019-11-29T02:56:31.889341+0000 (oldest deadline 2019-11-29T02:57:15.894975+0000) 2019-11-29T02:57:22.754 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:57:22.751+0000 1694c700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.422574+0000 front 2019-11-29T02:56:31.924852+0000 (oldest deadline 2019-11-29T02:57:16.592558+0000) 2019-11-29T02:57:23.342 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:57:23.338+0000 1694c700 -1 osd.0 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:30.075859+0000 front 2019-11-29T02:56:30.077031+0000 (oldest deadline 2019-11-29T02:57:12.082183+0000) 2019-11-29T02:57:23.404 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:57:23.400+0000 1694c700 -1 osd.4 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.303509+0000 front 2019-11-29T02:56:31.235909+0000 (oldest deadline 2019-11-29T02:57:15.826054+0000) 2019-11-29T02:57:23.588 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:57:23.584+0000 1694c700 -1 osd.6 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:32.019030+0000 front 2019-11-29T02:56:32.010773+0000 (oldest deadline 2019-11-29T02:57:17.757519+0000) 2019-11-29T02:57:23.727 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:57:23.723+0000 1694c700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:32.076711+0000 front 2019-11-29T02:56:32.075304+0000 (oldest deadline 2019-11-29T02:57:17.109616+0000) 2019-11-29T02:57:23.756 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:57:23.749+0000 1694c700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.422574+0000 front 2019-11-29T02:56:31.924852+0000 (oldest deadline 2019-11-29T02:57:16.592558+0000) 2019-11-29T02:57:23.797 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:57:23.794+0000 1694c700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.918370+0000 front 2019-11-29T02:56:31.889341+0000 (oldest deadline 2019-11-29T02:57:15.894975+0000) 2019-11-29T02:57:24.317 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:57:24.312+0000 1694c700 -1 osd.0 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:30.075859+0000 front 2019-11-29T02:56:30.077031+0000 (oldest deadline 2019-11-29T02:57:12.082183+0000) 2019-11-29T02:57:24.385 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:57:24.380+0000 1694c700 -1 osd.4 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.303509+0000 front 2019-11-29T02:56:31.235909+0000 (oldest deadline 2019-11-29T02:57:15.826054+0000) 2019-11-29T02:57:24.608 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:57:24.604+0000 1694c700 -1 osd.6 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:32.019030+0000 front 2019-11-29T02:56:32.010773+0000 (oldest deadline 2019-11-29T02:57:17.757519+0000) 2019-11-29T02:57:24.713 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:57:24.710+0000 1694c700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:32.076711+0000 front 2019-11-29T02:56:32.075304+0000 (oldest deadline 2019-11-29T02:57:17.109616+0000) 2019-11-29T02:57:24.775 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:57:24.770+0000 1694c700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.422574+0000 front 2019-11-29T02:56:31.924852+0000 (oldest deadline 2019-11-29T02:57:16.592558+0000) 2019-11-29T02:57:24.810 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:57:24.806+0000 1694c700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.918370+0000 front 2019-11-29T02:56:31.889341+0000 (oldest deadline 2019-11-29T02:57:15.894975+0000) 2019-11-29T02:57:25.319 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:57:25.315+0000 1694c700 -1 osd.0 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:30.075859+0000 front 2019-11-29T02:56:30.077031+0000 (oldest deadline 2019-11-29T02:57:12.082183+0000) 2019-11-29T02:57:25.417 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:57:25.412+0000 1694c700 -1 osd.4 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.303509+0000 front 2019-11-29T02:56:31.235909+0000 (oldest deadline 2019-11-29T02:57:15.826054+0000) 2019-11-29T02:57:25.577 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:57:25.572+0000 1694c700 -1 osd.6 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:32.019030+0000 front 2019-11-29T02:56:32.010773+0000 (oldest deadline 2019-11-29T02:57:17.757519+0000) 2019-11-29T02:57:25.738 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:57:25.732+0000 1694c700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:32.076711+0000 front 2019-11-29T02:56:32.075304+0000 (oldest deadline 2019-11-29T02:57:17.109616+0000) 2019-11-29T02:57:25.757 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:57:25.753+0000 1694c700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.422574+0000 front 2019-11-29T02:56:31.924852+0000 (oldest deadline 2019-11-29T02:57:16.592558+0000) 2019-11-29T02:57:25.827 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:57:25.823+0000 1694c700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.918370+0000 front 2019-11-29T02:56:31.889341+0000 (oldest deadline 2019-11-29T02:57:15.894975+0000) 2019-11-29T02:57:26.355 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:57:26.350+0000 1694c700 -1 osd.0 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:30.075859+0000 front 2019-11-29T02:56:30.077031+0000 (oldest deadline 2019-11-29T02:57:12.082183+0000) 2019-11-29T02:57:26.402 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:57:26.397+0000 1694c700 -1 osd.4 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.303509+0000 front 2019-11-29T02:56:31.235909+0000 (oldest deadline 2019-11-29T02:57:15.826054+0000) 2019-11-29T02:57:26.590 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:57:26.585+0000 1694c700 -1 osd.6 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:32.019030+0000 front 2019-11-29T02:56:32.010773+0000 (oldest deadline 2019-11-29T02:57:17.757519+0000) 2019-11-29T02:57:26.704 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:57:26.699+0000 1694c700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:32.076711+0000 front 2019-11-29T02:56:32.075304+0000 (oldest deadline 2019-11-29T02:57:17.109616+0000) 2019-11-29T02:57:26.802 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:57:26.798+0000 1694c700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.422574+0000 front 2019-11-29T02:56:31.924852+0000 (oldest deadline 2019-11-29T02:57:16.592558+0000) 2019-11-29T02:57:26.884 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:57:26.878+0000 1694c700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.918370+0000 front 2019-11-29T02:56:31.889341+0000 (oldest deadline 2019-11-29T02:57:15.894975+0000) 2019-11-29T02:57:27.357 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:57:27.352+0000 1694c700 -1 osd.0 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:30.075859+0000 front 2019-11-29T02:56:30.077031+0000 (oldest deadline 2019-11-29T02:57:12.082183+0000) 2019-11-29T02:57:27.448 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:57:27.443+0000 1694c700 -1 osd.4 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.303509+0000 front 2019-11-29T02:56:31.235909+0000 (oldest deadline 2019-11-29T02:57:15.826054+0000) 2019-11-29T02:57:27.566 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:57:27.560+0000 1694c700 -1 osd.6 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:32.019030+0000 front 2019-11-29T02:56:32.010773+0000 (oldest deadline 2019-11-29T02:57:17.757519+0000) 2019-11-29T02:57:27.693 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:57:27.688+0000 1694c700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:32.076711+0000 front 2019-11-29T02:56:32.075304+0000 (oldest deadline 2019-11-29T02:57:17.109616+0000) 2019-11-29T02:57:27.802 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:57:27.798+0000 1694c700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.422574+0000 front 2019-11-29T02:56:31.924852+0000 (oldest deadline 2019-11-29T02:57:16.592558+0000) 2019-11-29T02:57:27.889 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:57:27.885+0000 1694c700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.918370+0000 front 2019-11-29T02:56:31.889341+0000 (oldest deadline 2019-11-29T02:57:15.894975+0000) 2019-11-29T02:57:28.379 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:57:28.374+0000 1694c700 -1 osd.0 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:30.075859+0000 front 2019-11-29T02:56:30.077031+0000 (oldest deadline 2019-11-29T02:57:12.082183+0000) 2019-11-29T02:57:28.431 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:57:28.426+0000 1694c700 -1 osd.4 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.303509+0000 front 2019-11-29T02:56:31.235909+0000 (oldest deadline 2019-11-29T02:57:15.826054+0000) 2019-11-29T02:57:28.539 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:57:28.534+0000 1694c700 -1 osd.6 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:32.019030+0000 front 2019-11-29T02:56:32.010773+0000 (oldest deadline 2019-11-29T02:57:17.757519+0000) 2019-11-29T02:57:28.653 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:57:28.649+0000 1694c700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:32.076711+0000 front 2019-11-29T02:56:32.075304+0000 (oldest deadline 2019-11-29T02:57:17.109616+0000) 2019-11-29T02:57:28.823 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:57:28.820+0000 1694c700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.422574+0000 front 2019-11-29T02:56:31.924852+0000 (oldest deadline 2019-11-29T02:57:16.592558+0000) 2019-11-29T02:57:28.905 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:57:28.901+0000 1694c700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.918370+0000 front 2019-11-29T02:56:31.889341+0000 (oldest deadline 2019-11-29T02:57:15.894975+0000) 2019-11-29T02:57:29.417 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:57:29.413+0000 1694c700 -1 osd.0 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:30.075859+0000 front 2019-11-29T02:56:30.077031+0000 (oldest deadline 2019-11-29T02:57:12.082183+0000) 2019-11-29T02:57:29.438 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:57:29.432+0000 1694c700 -1 osd.4 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.303509+0000 front 2019-11-29T02:56:31.235909+0000 (oldest deadline 2019-11-29T02:57:15.826054+0000) 2019-11-29T02:57:29.548 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:57:29.542+0000 1694c700 -1 osd.6 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:32.019030+0000 front 2019-11-29T02:56:32.010773+0000 (oldest deadline 2019-11-29T02:57:17.757519+0000) 2019-11-29T02:57:29.661 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:57:29.649+0000 1694c700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:32.076711+0000 front 2019-11-29T02:56:32.075304+0000 (oldest deadline 2019-11-29T02:57:17.109616+0000) 2019-11-29T02:57:29.820 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:57:29.816+0000 1694c700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.422574+0000 front 2019-11-29T02:56:31.924852+0000 (oldest deadline 2019-11-29T02:57:16.592558+0000) 2019-11-29T02:57:29.956 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:57:29.953+0000 1694c700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:31.918370+0000 front 2019-11-29T02:56:31.889341+0000 (oldest deadline 2019-11-29T02:57:15.894975+0000) 2019-11-29T02:57:30.403 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:57:30.400+0000 1694c700 -1 osd.0 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:30.075859+0000 front 2019-11-29T02:56:30.077031+0000 (oldest deadline 2019-11-29T02:57:12.082183+0000) 2019-11-29T02:57:30.551 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:57:30.546+0000 1694c700 -1 osd.6 169 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T02:56:32.019030+0000 front 2019-11-29T02:56:32.010773+0000 (oldest deadline 2019-11-29T02:57:17.757519+0000) 2019-11-29T02:57:30.917 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T02:57:30.845+0000 37f90700 -1 osd.3 170 build_incremental_map_msg missing incremental map 169 2019-11-29T02:57:59.606 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T02:57:59.596+0000 32f86700 -1 osd.3 171 build_incremental_map_msg missing incremental map 169 2019-11-29T02:58:04.045 INFO:teuthology.orchestra.run.smithi074.stderr:testCopyFromHeader (test.functional.tests.TestFile) ... ok 2019-11-29T02:58:09.442 INFO:teuthology.orchestra.run.smithi074.stderr:testCopyFromHeader404s (test.functional.tests.TestFile) ... ok 2019-11-29T02:58:11.346 INFO:teuthology.orchestra.run.smithi074.stderr:testCopyNoDestinationHeader (test.functional.tests.TestFile) ... ok 2019-11-29T02:58:16.526 INFO:teuthology.orchestra.run.smithi074.stderr:testDelete (test.functional.tests.TestFile) ... ok 2019-11-29T02:58:17.851 INFO:teuthology.orchestra.run.smithi074.stderr:testDeleteOfFileThatDoesNotExist (test.functional.tests.TestFile) ... ok 2019-11-29T02:58:22.751 INFO:teuthology.orchestra.run.smithi074.stderr:testDeleteThen404s (test.functional.tests.TestFile) ... ok 2019-11-29T02:58:23.877 INFO:teuthology.orchestra.run.smithi074.stderr:testEtagResponse (test.functional.tests.TestFile) ... ok 2019-11-29T02:58:24.017 INFO:teuthology.orchestra.run.smithi074.stderr:testEtagWayoff (test.functional.tests.TestFile) ... ok 2019-11-29T02:58:25.164 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:58:25.157+0000 3578b700 -1 osd.4 171 build_incremental_map_msg missing incremental map 167 2019-11-29T02:58:45.566 INFO:teuthology.orchestra.run.smithi074.stderr:testFileCreate (test.functional.tests.TestFile) ... ok 2019-11-29T02:58:48.276 INFO:teuthology.orchestra.run.smithi074.stderr:testGetContentType (test.functional.tests.TestFile) ... ok 2019-11-29T02:58:49.024 INFO:teuthology.orchestra.run.smithi074.stderr:testGetOnFileThatDoesNotExist (test.functional.tests.TestFile) ... ok 2019-11-29T02:58:53.553 INFO:teuthology.orchestra.run.smithi074.stderr:testHead (test.functional.tests.TestFile) ... ok 2019-11-29T02:58:54.326 INFO:teuthology.orchestra.run.smithi074.stderr:testHeadOnFileThatDoesNotExist (test.functional.tests.TestFile) ... ok 2019-11-29T02:59:15.097 INFO:teuthology.orchestra.run.smithi074.stderr:testMetadataOnPost (test.functional.tests.TestFile) ... ok 2019-11-29T02:59:30.321 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:59:30.315+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.974419+0000 front 2019-11-29T02:58:46.114819+0000 (oldest deadline 2019-11-29T02:59:29.426911+0000) 2019-11-29T02:59:31.281 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:59:31.274+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.341344+0000 front 2019-11-29T02:58:46.232238+0000 (oldest deadline 2019-11-29T02:59:30.288352+0000) 2019-11-29T02:59:31.294 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:59:31.289+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.974419+0000 front 2019-11-29T02:58:46.114819+0000 (oldest deadline 2019-11-29T02:59:29.426911+0000) 2019-11-29T02:59:31.491 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:59:31.486+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.191742+0000 front 2019-11-29T02:58:46.148865+0000 (oldest deadline 2019-11-29T02:59:30.663322+0000) 2019-11-29T02:59:31.829 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:59:31.823+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.218889+0000 front 2019-11-29T02:58:46.114684+0000 (oldest deadline 2019-11-29T02:59:31.330028+0000) 2019-11-29T02:59:31.995 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:59:31.990+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.289629+0000 front 2019-11-29T02:58:45.216524+0000 (oldest deadline 2019-11-29T02:59:31.089041+0000) 2019-11-29T02:59:32.076 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:59:32.069+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.954179+0000 front 2019-11-29T02:58:45.806515+0000 (oldest deadline 2019-11-29T02:59:31.679070+0000) 2019-11-29T02:59:32.143 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:59:32.139+0000 1694c700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.871764+0000 front 2019-11-29T02:58:46.836091+0000 (oldest deadline 2019-11-29T02:59:31.508923+0000) 2019-11-29T02:59:32.265 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:59:32.261+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.341344+0000 front 2019-11-29T02:58:46.232238+0000 (oldest deadline 2019-11-29T02:59:30.288352+0000) 2019-11-29T02:59:32.312 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:59:32.296+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.974419+0000 front 2019-11-29T02:58:46.114819+0000 (oldest deadline 2019-11-29T02:59:29.426911+0000) 2019-11-29T02:59:32.463 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:59:32.458+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.191742+0000 front 2019-11-29T02:58:46.148865+0000 (oldest deadline 2019-11-29T02:59:30.663322+0000) 2019-11-29T02:59:32.849 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:59:32.843+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.218889+0000 front 2019-11-29T02:58:46.114684+0000 (oldest deadline 2019-11-29T02:59:31.330028+0000) 2019-11-29T02:59:33.003 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:59:32.998+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.289629+0000 front 2019-11-29T02:58:45.216524+0000 (oldest deadline 2019-11-29T02:59:31.089041+0000) 2019-11-29T02:59:33.099 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:59:33.093+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.954179+0000 front 2019-11-29T02:58:45.806515+0000 (oldest deadline 2019-11-29T02:59:31.679070+0000) 2019-11-29T02:59:33.130 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:59:33.125+0000 1694c700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.871764+0000 front 2019-11-29T02:58:46.836091+0000 (oldest deadline 2019-11-29T02:59:31.508923+0000) 2019-11-29T02:59:33.305 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:59:33.301+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.341344+0000 front 2019-11-29T02:58:46.232238+0000 (oldest deadline 2019-11-29T02:59:30.288352+0000) 2019-11-29T02:59:33.336 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:59:33.329+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.974419+0000 front 2019-11-29T02:58:46.114819+0000 (oldest deadline 2019-11-29T02:59:29.426911+0000) 2019-11-29T02:59:33.506 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:59:33.501+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.191742+0000 front 2019-11-29T02:58:46.148865+0000 (oldest deadline 2019-11-29T02:59:30.663322+0000) 2019-11-29T02:59:33.893 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:59:33.885+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.218889+0000 front 2019-11-29T02:58:46.114684+0000 (oldest deadline 2019-11-29T02:59:31.330028+0000) 2019-11-29T02:59:34.037 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:59:34.032+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.289629+0000 front 2019-11-29T02:58:45.216524+0000 (oldest deadline 2019-11-29T02:59:31.089041+0000) 2019-11-29T02:59:34.081 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:59:34.075+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.954179+0000 front 2019-11-29T02:58:45.806515+0000 (oldest deadline 2019-11-29T02:59:31.679070+0000) 2019-11-29T02:59:34.154 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:59:34.150+0000 1694c700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.871764+0000 front 2019-11-29T02:58:46.836091+0000 (oldest deadline 2019-11-29T02:59:31.508923+0000) 2019-11-29T02:59:34.332 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:59:34.328+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.341344+0000 front 2019-11-29T02:58:46.232238+0000 (oldest deadline 2019-11-29T02:59:30.288352+0000) 2019-11-29T02:59:34.343 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:59:34.338+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.974419+0000 front 2019-11-29T02:58:46.114819+0000 (oldest deadline 2019-11-29T02:59:29.426911+0000) 2019-11-29T02:59:34.528 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:59:34.524+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.191742+0000 front 2019-11-29T02:58:46.148865+0000 (oldest deadline 2019-11-29T02:59:30.663322+0000) 2019-11-29T02:59:34.887 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:59:34.881+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.218889+0000 front 2019-11-29T02:58:46.114684+0000 (oldest deadline 2019-11-29T02:59:31.330028+0000) 2019-11-29T02:59:35.040 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:59:35.035+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.289629+0000 front 2019-11-29T02:58:45.216524+0000 (oldest deadline 2019-11-29T02:59:31.089041+0000) 2019-11-29T02:59:35.131 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:59:35.125+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.954179+0000 front 2019-11-29T02:58:45.806515+0000 (oldest deadline 2019-11-29T02:59:31.679070+0000) 2019-11-29T02:59:35.179 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:59:35.176+0000 1694c700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.871764+0000 front 2019-11-29T02:58:46.836091+0000 (oldest deadline 2019-11-29T02:59:31.508923+0000) 2019-11-29T02:59:35.317 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:59:35.314+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.341344+0000 front 2019-11-29T02:58:46.232238+0000 (oldest deadline 2019-11-29T02:59:30.288352+0000) 2019-11-29T02:59:35.379 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:59:35.374+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.974419+0000 front 2019-11-29T02:58:46.114819+0000 (oldest deadline 2019-11-29T02:59:29.426911+0000) 2019-11-29T02:59:35.489 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:59:35.483+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.191742+0000 front 2019-11-29T02:58:46.148865+0000 (oldest deadline 2019-11-29T02:59:30.663322+0000) 2019-11-29T02:59:35.888 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:59:35.882+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.218889+0000 front 2019-11-29T02:58:46.114684+0000 (oldest deadline 2019-11-29T02:59:31.330028+0000) 2019-11-29T02:59:36.071 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:59:36.067+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.289629+0000 front 2019-11-29T02:58:45.216524+0000 (oldest deadline 2019-11-29T02:59:31.089041+0000) 2019-11-29T02:59:36.095 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:59:36.090+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.954179+0000 front 2019-11-29T02:58:45.806515+0000 (oldest deadline 2019-11-29T02:59:31.679070+0000) 2019-11-29T02:59:36.231 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:59:36.225+0000 1694c700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.871764+0000 front 2019-11-29T02:58:46.836091+0000 (oldest deadline 2019-11-29T02:59:31.508923+0000) 2019-11-29T02:59:36.306 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:59:36.302+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.341344+0000 front 2019-11-29T02:58:46.232238+0000 (oldest deadline 2019-11-29T02:59:30.288352+0000) 2019-11-29T02:59:36.389 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:59:36.384+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.974419+0000 front 2019-11-29T02:58:46.114819+0000 (oldest deadline 2019-11-29T02:59:29.426911+0000) 2019-11-29T02:59:36.452 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:59:36.446+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.191742+0000 front 2019-11-29T02:58:46.148865+0000 (oldest deadline 2019-11-29T02:59:30.663322+0000) 2019-11-29T02:59:36.924 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:59:36.919+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.218889+0000 front 2019-11-29T02:58:46.114684+0000 (oldest deadline 2019-11-29T02:59:31.330028+0000) 2019-11-29T02:59:37.065 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:59:37.060+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.289629+0000 front 2019-11-29T02:58:45.216524+0000 (oldest deadline 2019-11-29T02:59:31.089041+0000) 2019-11-29T02:59:37.142 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:59:37.137+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.954179+0000 front 2019-11-29T02:58:45.806515+0000 (oldest deadline 2019-11-29T02:59:31.679070+0000) 2019-11-29T02:59:37.245 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:59:37.237+0000 1694c700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.871764+0000 front 2019-11-29T02:58:46.836091+0000 (oldest deadline 2019-11-29T02:59:31.508923+0000) 2019-11-29T02:59:37.333 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:59:37.328+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.341344+0000 front 2019-11-29T02:58:46.232238+0000 (oldest deadline 2019-11-29T02:59:30.288352+0000) 2019-11-29T02:59:37.393 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:59:37.388+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.974419+0000 front 2019-11-29T02:58:46.114819+0000 (oldest deadline 2019-11-29T02:59:29.426911+0000) 2019-11-29T02:59:37.408 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:59:37.402+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.191742+0000 front 2019-11-29T02:58:46.148865+0000 (oldest deadline 2019-11-29T02:59:30.663322+0000) 2019-11-29T02:59:37.911 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:59:37.905+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.218889+0000 front 2019-11-29T02:58:46.114684+0000 (oldest deadline 2019-11-29T02:59:31.330028+0000) 2019-11-29T02:59:38.082 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:59:38.078+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.289629+0000 front 2019-11-29T02:58:45.216524+0000 (oldest deadline 2019-11-29T02:59:31.089041+0000) 2019-11-29T02:59:38.162 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:59:38.156+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.954179+0000 front 2019-11-29T02:58:45.806515+0000 (oldest deadline 2019-11-29T02:59:31.679070+0000) 2019-11-29T02:59:38.226 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:59:38.220+0000 1694c700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.871764+0000 front 2019-11-29T02:58:46.836091+0000 (oldest deadline 2019-11-29T02:59:31.508923+0000) 2019-11-29T02:59:38.349 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:59:38.345+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.341344+0000 front 2019-11-29T02:58:46.232238+0000 (oldest deadline 2019-11-29T02:59:30.288352+0000) 2019-11-29T02:59:38.425 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:59:38.420+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.974419+0000 front 2019-11-29T02:58:46.114819+0000 (oldest deadline 2019-11-29T02:59:29.426911+0000) 2019-11-29T02:59:38.429 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:59:38.424+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.191742+0000 front 2019-11-29T02:58:46.148865+0000 (oldest deadline 2019-11-29T02:59:30.663322+0000) 2019-11-29T02:59:38.917 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:59:38.908+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.218889+0000 front 2019-11-29T02:58:46.114684+0000 (oldest deadline 2019-11-29T02:59:31.330028+0000) 2019-11-29T02:59:39.075 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:59:39.071+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.289629+0000 front 2019-11-29T02:58:45.216524+0000 (oldest deadline 2019-11-29T02:59:31.089041+0000) 2019-11-29T02:59:39.118 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:59:39.113+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.954179+0000 front 2019-11-29T02:58:45.806515+0000 (oldest deadline 2019-11-29T02:59:31.679070+0000) 2019-11-29T02:59:39.241 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:59:39.238+0000 1694c700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.871764+0000 front 2019-11-29T02:58:46.836091+0000 (oldest deadline 2019-11-29T02:59:31.508923+0000) 2019-11-29T02:59:39.397 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:59:39.393+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.341344+0000 front 2019-11-29T02:58:46.232238+0000 (oldest deadline 2019-11-29T02:59:30.288352+0000) 2019-11-29T02:59:39.404 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:59:39.399+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.974419+0000 front 2019-11-29T02:58:46.114819+0000 (oldest deadline 2019-11-29T02:59:29.426911+0000) 2019-11-29T02:59:39.452 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:59:39.447+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.191742+0000 front 2019-11-29T02:58:46.148865+0000 (oldest deadline 2019-11-29T02:59:30.663322+0000) 2019-11-29T02:59:39.956 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:59:39.950+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.218889+0000 front 2019-11-29T02:58:46.114684+0000 (oldest deadline 2019-11-29T02:59:31.330028+0000) 2019-11-29T02:59:40.065 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:59:40.061+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.289629+0000 front 2019-11-29T02:58:45.216524+0000 (oldest deadline 2019-11-29T02:59:31.089041+0000) 2019-11-29T02:59:40.130 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:59:40.124+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.954179+0000 front 2019-11-29T02:58:45.806515+0000 (oldest deadline 2019-11-29T02:59:31.679070+0000) 2019-11-29T02:59:40.203 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:59:40.198+0000 1694c700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.871764+0000 front 2019-11-29T02:58:46.836091+0000 (oldest deadline 2019-11-29T02:59:31.508923+0000) 2019-11-29T02:59:40.392 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:59:40.386+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.341344+0000 front 2019-11-29T02:58:46.232238+0000 (oldest deadline 2019-11-29T02:59:30.288352+0000) 2019-11-29T02:59:40.449 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:59:40.444+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.974419+0000 front 2019-11-29T02:58:46.114819+0000 (oldest deadline 2019-11-29T02:59:29.426911+0000) 2019-11-29T02:59:40.487 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:59:40.481+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.191742+0000 front 2019-11-29T02:58:46.148865+0000 (oldest deadline 2019-11-29T02:59:30.663322+0000) 2019-11-29T02:59:40.990 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:59:40.985+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.218889+0000 front 2019-11-29T02:58:46.114684+0000 (oldest deadline 2019-11-29T02:59:31.330028+0000) 2019-11-29T02:59:41.039 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:59:41.034+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.289629+0000 front 2019-11-29T02:58:45.216524+0000 (oldest deadline 2019-11-29T02:59:31.089041+0000) 2019-11-29T02:59:41.089 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:59:41.083+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.954179+0000 front 2019-11-29T02:58:45.806515+0000 (oldest deadline 2019-11-29T02:59:31.679070+0000) 2019-11-29T02:59:41.199 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:59:41.194+0000 1694c700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.871764+0000 front 2019-11-29T02:58:46.836091+0000 (oldest deadline 2019-11-29T02:59:31.508923+0000) 2019-11-29T02:59:41.439 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:59:41.434+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.341344+0000 front 2019-11-29T02:58:46.232238+0000 (oldest deadline 2019-11-29T02:59:30.288352+0000) 2019-11-29T02:59:41.450 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:59:41.445+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.191742+0000 front 2019-11-29T02:58:46.148865+0000 (oldest deadline 2019-11-29T02:59:30.663322+0000) 2019-11-29T02:59:41.492 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:59:41.486+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.974419+0000 front 2019-11-29T02:58:46.114819+0000 (oldest deadline 2019-11-29T02:59:29.426911+0000) 2019-11-29T02:59:41.957 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:59:41.950+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.218889+0000 front 2019-11-29T02:58:46.114684+0000 (oldest deadline 2019-11-29T02:59:31.330028+0000) 2019-11-29T02:59:42.057 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:59:42.053+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.289629+0000 front 2019-11-29T02:58:45.216524+0000 (oldest deadline 2019-11-29T02:59:31.089041+0000) 2019-11-29T02:59:42.090 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:59:42.085+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.954179+0000 front 2019-11-29T02:58:45.806515+0000 (oldest deadline 2019-11-29T02:59:31.679070+0000) 2019-11-29T02:59:42.207 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:59:42.202+0000 1694c700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.871764+0000 front 2019-11-29T02:58:46.836091+0000 (oldest deadline 2019-11-29T02:59:31.508923+0000) 2019-11-29T02:59:42.418 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:59:42.412+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.191742+0000 front 2019-11-29T02:58:46.148865+0000 (oldest deadline 2019-11-29T02:59:30.663322+0000) 2019-11-29T02:59:42.449 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:59:42.443+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.974419+0000 front 2019-11-29T02:58:46.114819+0000 (oldest deadline 2019-11-29T02:59:29.426911+0000) 2019-11-29T02:59:42.475 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:59:42.471+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.341344+0000 front 2019-11-29T02:58:46.232238+0000 (oldest deadline 2019-11-29T02:59:30.288352+0000) 2019-11-29T02:59:42.952 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:59:42.946+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.218889+0000 front 2019-11-29T02:58:46.114684+0000 (oldest deadline 2019-11-29T02:59:31.330028+0000) 2019-11-29T02:59:43.053 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:59:43.046+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.289629+0000 front 2019-11-29T02:58:45.216524+0000 (oldest deadline 2019-11-29T02:59:31.089041+0000) 2019-11-29T02:59:43.101 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:59:43.095+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.954179+0000 front 2019-11-29T02:58:45.806515+0000 (oldest deadline 2019-11-29T02:59:31.679070+0000) 2019-11-29T02:59:43.165 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:59:43.162+0000 1694c700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.871764+0000 front 2019-11-29T02:58:46.836091+0000 (oldest deadline 2019-11-29T02:59:31.508923+0000) 2019-11-29T02:59:43.423 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:59:43.414+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.191742+0000 front 2019-11-29T02:58:46.148865+0000 (oldest deadline 2019-11-29T02:59:30.663322+0000) 2019-11-29T02:59:43.485 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:59:43.479+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.341344+0000 front 2019-11-29T02:58:46.232238+0000 (oldest deadline 2019-11-29T02:59:30.288352+0000) 2019-11-29T02:59:43.492 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:59:43.486+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.974419+0000 front 2019-11-29T02:58:46.114819+0000 (oldest deadline 2019-11-29T02:59:29.426911+0000) 2019-11-29T02:59:43.987 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:59:43.982+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.218889+0000 front 2019-11-29T02:58:46.114684+0000 (oldest deadline 2019-11-29T02:59:31.330028+0000) 2019-11-29T02:59:44.058 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:59:44.053+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.289629+0000 front 2019-11-29T02:58:45.216524+0000 (oldest deadline 2019-11-29T02:59:31.089041+0000) 2019-11-29T02:59:44.077 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:59:44.072+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.954179+0000 front 2019-11-29T02:58:45.806515+0000 (oldest deadline 2019-11-29T02:59:31.679070+0000) 2019-11-29T02:59:44.138 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:59:44.134+0000 1694c700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.871764+0000 front 2019-11-29T02:58:46.836091+0000 (oldest deadline 2019-11-29T02:59:31.508923+0000) 2019-11-29T02:59:44.405 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:59:44.400+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.191742+0000 front 2019-11-29T02:58:46.148865+0000 (oldest deadline 2019-11-29T02:59:30.663322+0000) 2019-11-29T02:59:44.466 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:59:44.463+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.341344+0000 front 2019-11-29T02:58:46.232238+0000 (oldest deadline 2019-11-29T02:59:30.288352+0000) 2019-11-29T02:59:44.474 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:59:44.469+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.974419+0000 front 2019-11-29T02:58:46.114819+0000 (oldest deadline 2019-11-29T02:59:29.426911+0000) 2019-11-29T02:59:45.016 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:59:45.011+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.218889+0000 front 2019-11-29T02:58:46.114684+0000 (oldest deadline 2019-11-29T02:59:31.330028+0000) 2019-11-29T02:59:45.026 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:59:45.022+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.289629+0000 front 2019-11-29T02:58:45.216524+0000 (oldest deadline 2019-11-29T02:59:31.089041+0000) 2019-11-29T02:59:45.040 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:59:45.034+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.954179+0000 front 2019-11-29T02:58:45.806515+0000 (oldest deadline 2019-11-29T02:59:31.679070+0000) 2019-11-29T02:59:45.111 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:59:45.108+0000 1694c700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.871764+0000 front 2019-11-29T02:58:46.836091+0000 (oldest deadline 2019-11-29T02:59:31.508923+0000) 2019-11-29T02:59:45.428 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:59:45.425+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.341344+0000 front 2019-11-29T02:58:46.232238+0000 (oldest deadline 2019-11-29T02:59:30.288352+0000) 2019-11-29T02:59:45.431 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:59:45.425+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.191742+0000 front 2019-11-29T02:58:46.148865+0000 (oldest deadline 2019-11-29T02:59:30.663322+0000) 2019-11-29T02:59:45.471 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:59:45.465+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.974419+0000 front 2019-11-29T02:58:46.114819+0000 (oldest deadline 2019-11-29T02:59:29.426911+0000) 2019-11-29T02:59:45.997 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:59:45.992+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.954179+0000 front 2019-11-29T02:58:45.806515+0000 (oldest deadline 2019-11-29T02:59:31.679070+0000) 2019-11-29T02:59:46.000 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:59:45.995+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.218889+0000 front 2019-11-29T02:58:46.114684+0000 (oldest deadline 2019-11-29T02:59:31.330028+0000) 2019-11-29T02:59:46.015 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:59:46.012+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.289629+0000 front 2019-11-29T02:58:45.216524+0000 (oldest deadline 2019-11-29T02:59:31.089041+0000) 2019-11-29T02:59:46.119 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:59:46.115+0000 1694c700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.871764+0000 front 2019-11-29T02:58:46.836091+0000 (oldest deadline 2019-11-29T02:59:31.508923+0000) 2019-11-29T02:59:46.383 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:59:46.380+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.341344+0000 front 2019-11-29T02:58:46.232238+0000 (oldest deadline 2019-11-29T02:59:30.288352+0000) 2019-11-29T02:59:46.406 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:59:46.401+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.191742+0000 front 2019-11-29T02:58:46.148865+0000 (oldest deadline 2019-11-29T02:59:30.663322+0000) 2019-11-29T02:59:46.451 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:59:46.443+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.974419+0000 front 2019-11-29T02:58:46.114819+0000 (oldest deadline 2019-11-29T02:59:29.426911+0000) 2019-11-29T02:59:46.973 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:59:46.967+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.218889+0000 front 2019-11-29T02:58:46.114684+0000 (oldest deadline 2019-11-29T02:59:31.330028+0000) 2019-11-29T02:59:47.011 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:59:47.005+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.954179+0000 front 2019-11-29T02:58:45.806515+0000 (oldest deadline 2019-11-29T02:59:31.679070+0000) 2019-11-29T02:59:47.043 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:59:47.041+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.289629+0000 front 2019-11-29T02:58:45.216524+0000 (oldest deadline 2019-11-29T02:59:31.089041+0000) 2019-11-29T02:59:47.150 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:59:47.146+0000 1694c700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.871764+0000 front 2019-11-29T02:58:46.836091+0000 (oldest deadline 2019-11-29T02:59:31.508923+0000) 2019-11-29T02:59:47.384 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:59:47.378+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.191742+0000 front 2019-11-29T02:58:46.148865+0000 (oldest deadline 2019-11-29T02:59:30.663322+0000) 2019-11-29T02:59:47.399 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:59:47.396+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.341344+0000 front 2019-11-29T02:58:46.232238+0000 (oldest deadline 2019-11-29T02:59:30.288352+0000) 2019-11-29T02:59:47.435 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:59:47.428+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.974419+0000 front 2019-11-29T02:58:46.114819+0000 (oldest deadline 2019-11-29T02:59:29.426911+0000) 2019-11-29T02:59:47.974 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:59:47.969+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.218889+0000 front 2019-11-29T02:58:46.114684+0000 (oldest deadline 2019-11-29T02:59:31.330028+0000) 2019-11-29T02:59:47.999 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:59:47.994+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.954179+0000 front 2019-11-29T02:58:45.806515+0000 (oldest deadline 2019-11-29T02:59:31.679070+0000) 2019-11-29T02:59:48.024 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:59:48.020+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.289629+0000 front 2019-11-29T02:58:45.216524+0000 (oldest deadline 2019-11-29T02:59:31.089041+0000) 2019-11-29T02:59:48.131 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:59:48.128+0000 1694c700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.871764+0000 front 2019-11-29T02:58:46.836091+0000 (oldest deadline 2019-11-29T02:59:31.508923+0000) 2019-11-29T02:59:48.396 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:59:48.391+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.341344+0000 front 2019-11-29T02:58:46.232238+0000 (oldest deadline 2019-11-29T02:59:30.288352+0000) 2019-11-29T02:59:48.402 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:59:48.396+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.191742+0000 front 2019-11-29T02:58:46.148865+0000 (oldest deadline 2019-11-29T02:59:30.663322+0000) 2019-11-29T02:59:48.473 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:59:48.468+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.974419+0000 front 2019-11-29T02:58:46.114819+0000 (oldest deadline 2019-11-29T02:59:29.426911+0000) 2019-11-29T02:59:48.973 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:59:48.968+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.954179+0000 front 2019-11-29T02:58:45.806515+0000 (oldest deadline 2019-11-29T02:59:31.679070+0000) 2019-11-29T02:59:48.987 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:59:48.983+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.289629+0000 front 2019-11-29T02:58:45.216524+0000 (oldest deadline 2019-11-29T02:59:31.089041+0000) 2019-11-29T02:59:48.998 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:59:48.992+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.218889+0000 front 2019-11-29T02:58:46.114684+0000 (oldest deadline 2019-11-29T02:59:31.330028+0000) 2019-11-29T02:59:49.157 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:59:49.155+0000 1694c700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.871764+0000 front 2019-11-29T02:58:46.836091+0000 (oldest deadline 2019-11-29T02:59:31.508923+0000) 2019-11-29T02:59:49.397 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:59:49.394+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.341344+0000 front 2019-11-29T02:58:46.232238+0000 (oldest deadline 2019-11-29T02:59:30.288352+0000) 2019-11-29T02:59:49.398 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:59:49.389+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.191742+0000 front 2019-11-29T02:58:46.148865+0000 (oldest deadline 2019-11-29T02:59:30.663322+0000) 2019-11-29T02:59:49.440 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:59:49.435+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.974419+0000 front 2019-11-29T02:58:46.114819+0000 (oldest deadline 2019-11-29T02:59:29.426911+0000) 2019-11-29T02:59:49.974 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:59:49.970+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.289629+0000 front 2019-11-29T02:58:45.216524+0000 (oldest deadline 2019-11-29T02:59:31.089041+0000) 2019-11-29T02:59:50.004 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:59:49.997+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.954179+0000 front 2019-11-29T02:58:45.806515+0000 (oldest deadline 2019-11-29T02:59:31.679070+0000) 2019-11-29T02:59:50.031 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:59:50.025+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.218889+0000 front 2019-11-29T02:58:46.114684+0000 (oldest deadline 2019-11-29T02:59:31.330028+0000) 2019-11-29T02:59:50.149 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:59:50.147+0000 1694c700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.871764+0000 front 2019-11-29T02:58:46.836091+0000 (oldest deadline 2019-11-29T02:59:31.508923+0000) 2019-11-29T02:59:50.370 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:59:50.366+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.341344+0000 front 2019-11-29T02:58:46.232238+0000 (oldest deadline 2019-11-29T02:59:30.288352+0000) 2019-11-29T02:59:50.411 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:59:50.404+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.191742+0000 front 2019-11-29T02:58:46.148865+0000 (oldest deadline 2019-11-29T02:59:30.663322+0000) 2019-11-29T02:59:50.482 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:59:50.476+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.974419+0000 front 2019-11-29T02:58:46.114819+0000 (oldest deadline 2019-11-29T02:59:29.426911+0000) 2019-11-29T02:59:50.954 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:59:50.951+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.289629+0000 front 2019-11-29T02:58:45.216524+0000 (oldest deadline 2019-11-29T02:59:31.089041+0000) 2019-11-29T02:59:51.016 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:59:51.008+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.954179+0000 front 2019-11-29T02:58:45.806515+0000 (oldest deadline 2019-11-29T02:59:31.679070+0000) 2019-11-29T02:59:51.084 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:59:51.076+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.218889+0000 front 2019-11-29T02:58:46.114684+0000 (oldest deadline 2019-11-29T02:59:31.330028+0000) 2019-11-29T02:59:51.169 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:59:51.165+0000 1694c700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.871764+0000 front 2019-11-29T02:58:46.836091+0000 (oldest deadline 2019-11-29T02:59:31.508923+0000) 2019-11-29T02:59:51.354 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:59:51.352+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.341344+0000 front 2019-11-29T02:58:46.232238+0000 (oldest deadline 2019-11-29T02:59:30.288352+0000) 2019-11-29T02:59:51.458 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:59:51.452+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.974419+0000 front 2019-11-29T02:58:46.114819+0000 (oldest deadline 2019-11-29T02:59:29.426911+0000) 2019-11-29T02:59:51.459 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:59:51.453+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.191742+0000 front 2019-11-29T02:58:46.148865+0000 (oldest deadline 2019-11-29T02:59:30.663322+0000) 2019-11-29T02:59:51.919 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:59:51.916+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.289629+0000 front 2019-11-29T02:58:45.216524+0000 (oldest deadline 2019-11-29T02:59:31.089041+0000) 2019-11-29T02:59:52.026 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:59:52.020+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.954179+0000 front 2019-11-29T02:58:45.806515+0000 (oldest deadline 2019-11-29T02:59:31.679070+0000) 2019-11-29T02:59:52.073 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:59:52.067+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.218889+0000 front 2019-11-29T02:58:46.114684+0000 (oldest deadline 2019-11-29T02:59:31.330028+0000) 2019-11-29T02:59:52.149 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:59:52.146+0000 1694c700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.871764+0000 front 2019-11-29T02:58:46.836091+0000 (oldest deadline 2019-11-29T02:59:31.508923+0000) 2019-11-29T02:59:52.370 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:59:52.368+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.341344+0000 front 2019-11-29T02:58:46.232238+0000 (oldest deadline 2019-11-29T02:59:30.288352+0000) 2019-11-29T02:59:52.465 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:59:52.458+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.974419+0000 front 2019-11-29T02:58:46.114819+0000 (oldest deadline 2019-11-29T02:59:29.426911+0000) 2019-11-29T02:59:52.493 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:59:52.487+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.191742+0000 front 2019-11-29T02:58:46.148865+0000 (oldest deadline 2019-11-29T02:59:30.663322+0000) 2019-11-29T02:59:52.911 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:59:52.908+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.289629+0000 front 2019-11-29T02:58:45.216524+0000 (oldest deadline 2019-11-29T02:59:31.089041+0000) 2019-11-29T02:59:53.030 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:59:53.023+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.954179+0000 front 2019-11-29T02:58:45.806515+0000 (oldest deadline 2019-11-29T02:59:31.679070+0000) 2019-11-29T02:59:53.124 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:59:53.120+0000 1694c700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.871764+0000 front 2019-11-29T02:58:46.836091+0000 (oldest deadline 2019-11-29T02:59:31.508923+0000) 2019-11-29T02:59:53.126 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:59:53.120+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.218889+0000 front 2019-11-29T02:58:46.114684+0000 (oldest deadline 2019-11-29T02:59:31.330028+0000) 2019-11-29T02:59:53.353 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:59:53.346+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.341344+0000 front 2019-11-29T02:58:46.232238+0000 (oldest deadline 2019-11-29T02:59:30.288352+0000) 2019-11-29T02:59:53.476 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:59:53.470+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.191742+0000 front 2019-11-29T02:58:46.148865+0000 (oldest deadline 2019-11-29T02:59:30.663322+0000) 2019-11-29T02:59:53.493 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:59:53.487+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.974419+0000 front 2019-11-29T02:58:46.114819+0000 (oldest deadline 2019-11-29T02:59:29.426911+0000) 2019-11-29T02:59:53.891 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:59:53.886+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.289629+0000 front 2019-11-29T02:58:45.216524+0000 (oldest deadline 2019-11-29T02:59:31.089041+0000) 2019-11-29T02:59:54.043 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:59:54.037+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.954179+0000 front 2019-11-29T02:58:45.806515+0000 (oldest deadline 2019-11-29T02:59:31.679070+0000) 2019-11-29T02:59:54.133 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:59:54.130+0000 1694c700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.871764+0000 front 2019-11-29T02:58:46.836091+0000 (oldest deadline 2019-11-29T02:59:31.508923+0000) 2019-11-29T02:59:54.156 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:59:54.150+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.218889+0000 front 2019-11-29T02:58:46.114684+0000 (oldest deadline 2019-11-29T02:59:31.330028+0000) 2019-11-29T02:59:54.403 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:59:54.400+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.341344+0000 front 2019-11-29T02:58:46.232238+0000 (oldest deadline 2019-11-29T02:59:30.288352+0000) 2019-11-29T02:59:54.448 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:59:54.443+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.974419+0000 front 2019-11-29T02:58:46.114819+0000 (oldest deadline 2019-11-29T02:59:29.426911+0000) 2019-11-29T02:59:54.487 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:59:54.481+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.191742+0000 front 2019-11-29T02:58:46.148865+0000 (oldest deadline 2019-11-29T02:59:30.663322+0000) 2019-11-29T02:59:54.891 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:59:54.889+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.289629+0000 front 2019-11-29T02:58:45.216524+0000 (oldest deadline 2019-11-29T02:59:31.089041+0000) 2019-11-29T02:59:55.031 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T02:59:55.025+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.954179+0000 front 2019-11-29T02:58:45.806515+0000 (oldest deadline 2019-11-29T02:59:31.679070+0000) 2019-11-29T02:59:55.135 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:59:55.130+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.218889+0000 front 2019-11-29T02:58:46.114684+0000 (oldest deadline 2019-11-29T02:59:31.330028+0000) 2019-11-29T02:59:55.140 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:59:55.136+0000 1694c700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.871764+0000 front 2019-11-29T02:58:46.836091+0000 (oldest deadline 2019-11-29T02:59:31.508923+0000) 2019-11-29T02:59:55.420 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T02:59:55.417+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.341344+0000 front 2019-11-29T02:58:46.232238+0000 (oldest deadline 2019-11-29T02:59:30.288352+0000) 2019-11-29T02:59:55.443 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T02:59:55.437+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.974419+0000 front 2019-11-29T02:58:46.114819+0000 (oldest deadline 2019-11-29T02:59:29.426911+0000) 2019-11-29T02:59:55.458 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T02:59:55.452+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.191742+0000 front 2019-11-29T02:58:46.148865+0000 (oldest deadline 2019-11-29T02:59:30.663322+0000) 2019-11-29T02:59:55.886 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T02:59:55.883+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:45.289629+0000 front 2019-11-29T02:58:45.216524+0000 (oldest deadline 2019-11-29T02:59:31.089041+0000) 2019-11-29T02:59:56.099 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T02:59:56.095+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.218889+0000 front 2019-11-29T02:58:46.114684+0000 (oldest deadline 2019-11-29T02:59:31.330028+0000) 2019-11-29T02:59:56.153 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T02:59:56.150+0000 1694c700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T02:58:46.871764+0000 front 2019-11-29T02:58:46.836091+0000 (oldest deadline 2019-11-29T02:59:31.508923+0000) 2019-11-29T03:00:02.631 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:00:02.623+0000 1694c700 -1 osd.7 176 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:103532 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~128 in=128b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,setxattr user.rgw.x-amz-meta-0e1d8fed50394e0389c1f7836d2ad89c (33) in=85b,setxattr user.rgw.x-amz-meta-2c994b45708e4e54a87086005088ae10 (33) in=85b,setxattr user.rgw.x-amz-meta-625a379df51640f48eaf87f14456b8e9 (33) in=85b,setxattr user.rgw.x-amz-meta-816362916f97407083d6d673aecbe876 (33) in=85b,setxattr user.rgw.x-amz-meta-8e7e69f0ae004effb9762f83b47ec392 (33) in=85b,setxattr user.rgw.x-amz-meta-a19a92d6807b426ea20422b3d4443f7f (33) in=85b,setxattr user.rgw.x-amz-meta-bf31a75e1e0944b99e114156c0bf4833 (33) in=85b,setxattr user.rgw.x-amz-meta-d1b32bdb8286468296088113447d53eb (33) in=85b,setxattr user.rgw.x-amz-meta-e8f9953146b245dbbcab7760d89c38c9 (33) in=85b,setxattr user.rgw.x-amz-meta-fef651cdf402484084f43929c2b8729e (33) in=85b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-29T03:00:03.647 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:00:03.643+0000 1694c700 -1 osd.7 176 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:103532 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~128 in=128b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,setxattr user.rgw.x-amz-meta-0e1d8fed50394e0389c1f7836d2ad89c (33) in=85b,setxattr user.rgw.x-amz-meta-2c994b45708e4e54a87086005088ae10 (33) in=85b,setxattr user.rgw.x-amz-meta-625a379df51640f48eaf87f14456b8e9 (33) in=85b,setxattr user.rgw.x-amz-meta-816362916f97407083d6d673aecbe876 (33) in=85b,setxattr user.rgw.x-amz-meta-8e7e69f0ae004effb9762f83b47ec392 (33) in=85b,setxattr user.rgw.x-amz-meta-a19a92d6807b426ea20422b3d4443f7f (33) in=85b,setxattr user.rgw.x-amz-meta-bf31a75e1e0944b99e114156c0bf4833 (33) in=85b,setxattr user.rgw.x-amz-meta-d1b32bdb8286468296088113447d53eb (33) in=85b,setxattr user.rgw.x-amz-meta-e8f9953146b245dbbcab7760d89c38c9 (33) in=85b,setxattr user.rgw.x-amz-meta-fef651cdf402484084f43929c2b8729e (33) in=85b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-29T03:00:04.700 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:00:04.695+0000 1694c700 -1 osd.7 176 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:103532 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~128 in=128b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,setxattr user.rgw.x-amz-meta-0e1d8fed50394e0389c1f7836d2ad89c (33) in=85b,setxattr user.rgw.x-amz-meta-2c994b45708e4e54a87086005088ae10 (33) in=85b,setxattr user.rgw.x-amz-meta-625a379df51640f48eaf87f14456b8e9 (33) in=85b,setxattr user.rgw.x-amz-meta-816362916f97407083d6d673aecbe876 (33) in=85b,setxattr user.rgw.x-amz-meta-8e7e69f0ae004effb9762f83b47ec392 (33) in=85b,setxattr user.rgw.x-amz-meta-a19a92d6807b426ea20422b3d4443f7f (33) in=85b,setxattr user.rgw.x-amz-meta-bf31a75e1e0944b99e114156c0bf4833 (33) in=85b,setxattr user.rgw.x-amz-meta-d1b32bdb8286468296088113447d53eb (33) in=85b,setxattr user.rgw.x-amz-meta-e8f9953146b245dbbcab7760d89c38c9 (33) in=85b,setxattr user.rgw.x-amz-meta-fef651cdf402484084f43929c2b8729e (33) in=85b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-29T03:00:05.690 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:00:05.686+0000 1694c700 -1 osd.7 176 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:103532 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~128 in=128b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,setxattr user.rgw.x-amz-meta-0e1d8fed50394e0389c1f7836d2ad89c (33) in=85b,setxattr user.rgw.x-amz-meta-2c994b45708e4e54a87086005088ae10 (33) in=85b,setxattr user.rgw.x-amz-meta-625a379df51640f48eaf87f14456b8e9 (33) in=85b,setxattr user.rgw.x-amz-meta-816362916f97407083d6d673aecbe876 (33) in=85b,setxattr user.rgw.x-amz-meta-8e7e69f0ae004effb9762f83b47ec392 (33) in=85b,setxattr user.rgw.x-amz-meta-a19a92d6807b426ea20422b3d4443f7f (33) in=85b,setxattr user.rgw.x-amz-meta-bf31a75e1e0944b99e114156c0bf4833 (33) in=85b,setxattr user.rgw.x-amz-meta-d1b32bdb8286468296088113447d53eb (33) in=85b,setxattr user.rgw.x-amz-meta-e8f9953146b245dbbcab7760d89c38c9 (33) in=85b,setxattr user.rgw.x-amz-meta-fef651cdf402484084f43929c2b8729e (33) in=85b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-29T03:00:06.672 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:00:06.667+0000 1694c700 -1 osd.7 176 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:103532 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~128 in=128b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,setxattr user.rgw.x-amz-meta-0e1d8fed50394e0389c1f7836d2ad89c (33) in=85b,setxattr user.rgw.x-amz-meta-2c994b45708e4e54a87086005088ae10 (33) in=85b,setxattr user.rgw.x-amz-meta-625a379df51640f48eaf87f14456b8e9 (33) in=85b,setxattr user.rgw.x-amz-meta-816362916f97407083d6d673aecbe876 (33) in=85b,setxattr user.rgw.x-amz-meta-8e7e69f0ae004effb9762f83b47ec392 (33) in=85b,setxattr user.rgw.x-amz-meta-a19a92d6807b426ea20422b3d4443f7f (33) in=85b,setxattr user.rgw.x-amz-meta-bf31a75e1e0944b99e114156c0bf4833 (33) in=85b,setxattr user.rgw.x-amz-meta-d1b32bdb8286468296088113447d53eb (33) in=85b,setxattr user.rgw.x-amz-meta-e8f9953146b245dbbcab7760d89c38c9 (33) in=85b,setxattr user.rgw.x-amz-meta-fef651cdf402484084f43929c2b8729e (33) in=85b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-29T03:00:07.638 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:00:07.634+0000 1694c700 -1 osd.7 176 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:103532 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~128 in=128b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,setxattr user.rgw.x-amz-meta-0e1d8fed50394e0389c1f7836d2ad89c (33) in=85b,setxattr user.rgw.x-amz-meta-2c994b45708e4e54a87086005088ae10 (33) in=85b,setxattr user.rgw.x-amz-meta-625a379df51640f48eaf87f14456b8e9 (33) in=85b,setxattr user.rgw.x-amz-meta-816362916f97407083d6d673aecbe876 (33) in=85b,setxattr user.rgw.x-amz-meta-8e7e69f0ae004effb9762f83b47ec392 (33) in=85b,setxattr user.rgw.x-amz-meta-a19a92d6807b426ea20422b3d4443f7f (33) in=85b,setxattr user.rgw.x-amz-meta-bf31a75e1e0944b99e114156c0bf4833 (33) in=85b,setxattr user.rgw.x-amz-meta-d1b32bdb8286468296088113447d53eb (33) in=85b,setxattr user.rgw.x-amz-meta-e8f9953146b245dbbcab7760d89c38c9 (33) in=85b,setxattr user.rgw.x-amz-meta-fef651cdf402484084f43929c2b8729e (33) in=85b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-29T03:00:08.657 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:00:08.654+0000 1694c700 -1 osd.7 176 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:103532 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~128 in=128b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,setxattr user.rgw.x-amz-meta-0e1d8fed50394e0389c1f7836d2ad89c (33) in=85b,setxattr user.rgw.x-amz-meta-2c994b45708e4e54a87086005088ae10 (33) in=85b,setxattr user.rgw.x-amz-meta-625a379df51640f48eaf87f14456b8e9 (33) in=85b,setxattr user.rgw.x-amz-meta-816362916f97407083d6d673aecbe876 (33) in=85b,setxattr user.rgw.x-amz-meta-8e7e69f0ae004effb9762f83b47ec392 (33) in=85b,setxattr user.rgw.x-amz-meta-a19a92d6807b426ea20422b3d4443f7f (33) in=85b,setxattr user.rgw.x-amz-meta-bf31a75e1e0944b99e114156c0bf4833 (33) in=85b,setxattr user.rgw.x-amz-meta-d1b32bdb8286468296088113447d53eb (33) in=85b,setxattr user.rgw.x-amz-meta-e8f9953146b245dbbcab7760d89c38c9 (33) in=85b,setxattr user.rgw.x-amz-meta-fef651cdf402484084f43929c2b8729e (33) in=85b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-29T03:00:09.697 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:00:09.693+0000 1694c700 -1 osd.7 176 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:103532 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~128 in=128b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,setxattr user.rgw.x-amz-meta-0e1d8fed50394e0389c1f7836d2ad89c (33) in=85b,setxattr user.rgw.x-amz-meta-2c994b45708e4e54a87086005088ae10 (33) in=85b,setxattr user.rgw.x-amz-meta-625a379df51640f48eaf87f14456b8e9 (33) in=85b,setxattr user.rgw.x-amz-meta-816362916f97407083d6d673aecbe876 (33) in=85b,setxattr user.rgw.x-amz-meta-8e7e69f0ae004effb9762f83b47ec392 (33) in=85b,setxattr user.rgw.x-amz-meta-a19a92d6807b426ea20422b3d4443f7f (33) in=85b,setxattr user.rgw.x-amz-meta-bf31a75e1e0944b99e114156c0bf4833 (33) in=85b,setxattr user.rgw.x-amz-meta-d1b32bdb8286468296088113447d53eb (33) in=85b,setxattr user.rgw.x-amz-meta-e8f9953146b245dbbcab7760d89c38c9 (33) in=85b,setxattr user.rgw.x-amz-meta-fef651cdf402484084f43929c2b8729e (33) in=85b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-29T03:00:10.732 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:00:10.728+0000 1694c700 -1 osd.7 176 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:103532 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~128 in=128b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,setxattr user.rgw.x-amz-meta-0e1d8fed50394e0389c1f7836d2ad89c (33) in=85b,setxattr user.rgw.x-amz-meta-2c994b45708e4e54a87086005088ae10 (33) in=85b,setxattr user.rgw.x-amz-meta-625a379df51640f48eaf87f14456b8e9 (33) in=85b,setxattr user.rgw.x-amz-meta-816362916f97407083d6d673aecbe876 (33) in=85b,setxattr user.rgw.x-amz-meta-8e7e69f0ae004effb9762f83b47ec392 (33) in=85b,setxattr user.rgw.x-amz-meta-a19a92d6807b426ea20422b3d4443f7f (33) in=85b,setxattr user.rgw.x-amz-meta-bf31a75e1e0944b99e114156c0bf4833 (33) in=85b,setxattr user.rgw.x-amz-meta-d1b32bdb8286468296088113447d53eb (33) in=85b,setxattr user.rgw.x-amz-meta-e8f9953146b245dbbcab7760d89c38c9 (33) in=85b,setxattr user.rgw.x-amz-meta-fef651cdf402484084f43929c2b8729e (33) in=85b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-29T03:00:11.692 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:00:11.687+0000 1694c700 -1 osd.7 176 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:103532 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~128 in=128b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,setxattr user.rgw.x-amz-meta-0e1d8fed50394e0389c1f7836d2ad89c (33) in=85b,setxattr user.rgw.x-amz-meta-2c994b45708e4e54a87086005088ae10 (33) in=85b,setxattr user.rgw.x-amz-meta-625a379df51640f48eaf87f14456b8e9 (33) in=85b,setxattr user.rgw.x-amz-meta-816362916f97407083d6d673aecbe876 (33) in=85b,setxattr user.rgw.x-amz-meta-8e7e69f0ae004effb9762f83b47ec392 (33) in=85b,setxattr user.rgw.x-amz-meta-a19a92d6807b426ea20422b3d4443f7f (33) in=85b,setxattr user.rgw.x-amz-meta-bf31a75e1e0944b99e114156c0bf4833 (33) in=85b,setxattr user.rgw.x-amz-meta-d1b32bdb8286468296088113447d53eb (33) in=85b,setxattr user.rgw.x-amz-meta-e8f9953146b245dbbcab7760d89c38c9 (33) in=85b,setxattr user.rgw.x-amz-meta-fef651cdf402484084f43929c2b8729e (33) in=85b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-29T03:00:12.691 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:00:12.687+0000 1694c700 -1 osd.7 176 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:103532 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~128 in=128b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,setxattr user.rgw.x-amz-meta-0e1d8fed50394e0389c1f7836d2ad89c (33) in=85b,setxattr user.rgw.x-amz-meta-2c994b45708e4e54a87086005088ae10 (33) in=85b,setxattr user.rgw.x-amz-meta-625a379df51640f48eaf87f14456b8e9 (33) in=85b,setxattr user.rgw.x-amz-meta-816362916f97407083d6d673aecbe876 (33) in=85b,setxattr user.rgw.x-amz-meta-8e7e69f0ae004effb9762f83b47ec392 (33) in=85b,setxattr user.rgw.x-amz-meta-a19a92d6807b426ea20422b3d4443f7f (33) in=85b,setxattr user.rgw.x-amz-meta-bf31a75e1e0944b99e114156c0bf4833 (33) in=85b,setxattr user.rgw.x-amz-meta-d1b32bdb8286468296088113447d53eb (33) in=85b,setxattr user.rgw.x-amz-meta-e8f9953146b245dbbcab7760d89c38c9 (33) in=85b,setxattr user.rgw.x-amz-meta-fef651cdf402484084f43929c2b8729e (33) in=85b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-29T03:00:20.169 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:14:02.386 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:00:20.181 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:14:02.398 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:00:20.181 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:14:02.400 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:00:20.184 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:14:02.403 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:00:20.197 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:14:02.425 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:00:20.207 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:14:02.435 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:00:20.413 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:14:02.630 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:00:20.416 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:14:02.635 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:00:20.483 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:14:02.711 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:00:25.208 INFO:teuthology.orchestra.run.smithi074.stderr:testMetadataOnPut (test.functional.tests.TestFile) ... ok 2019-11-29T03:00:37.636 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:00:37.600+0000 31f84700 -1 osd.3 180 build_incremental_map_msg missing incremental map 180 2019-11-29T03:00:37.668 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:00:37.664+0000 114ab700 -1 osd.3 180 build_incremental_map_msg missing incremental map 180 2019-11-29T03:00:37.849 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:00:37.785+0000 33f88700 -1 osd.3 180 build_incremental_map_msg missing incremental map 180 2019-11-29T03:00:38.265 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:00:38.058+0000 31f84700 -1 osd.3 180 build_incremental_map_msg missing incremental map 180 2019-11-29T03:00:38.298 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:00:38.104+0000 35f8c700 -1 osd.3 180 build_incremental_map_msg missing incremental map 180 2019-11-29T03:00:38.310 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:00:38.141+0000 35f8c700 -1 osd.3 180 build_incremental_map_msg missing incremental map 180 2019-11-29T03:00:38.424 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:00:38.356+0000 38791700 -1 osd.3 180 build_incremental_map_msg missing incremental map 180 2019-11-29T03:00:38.611 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:00:38.600+0000 38791700 -1 osd.3 180 build_incremental_map_msg missing incremental map 180 2019-11-29T03:00:42.314 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:00:42.312+0000 31783700 -1 osd.3 180 build_incremental_map_msg missing incremental map 180 2019-11-29T03:00:53.069 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:00:53.063+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:00:54.118 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:00:54.113+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:00:54.134 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:00:54.130+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:00:54.419 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:00:54.414+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:00:54.826 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:00:54.822+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:00:55.110 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:00:55.106+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:00:55.156 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:00:55.152+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:00:55.168 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:00:55.165+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:00:55.465 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:00:55.461+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:00:55.788 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:00:55.784+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:00:56.113 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:00:56.108+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:00:56.114 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:00:56.108+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:00:56.167 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:00:56.163+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:00:56.469 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:00:56.465+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:00:56.788 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:00:56.784+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:00:57.133 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:00:57.127+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:00:57.144 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:00:57.140+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:00:57.160 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:00:57.155+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:00:57.161 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:00:57.157+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:00:57.491 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:00:57.486+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:00:57.813 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:00:57.808+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:00:58.160 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:00:58.155+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:00:58.166 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:00:58.162+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:00:58.169 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:00:58.165+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:00:58.201 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:00:58.196+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:00:58.504 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:00:58.498+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:00:58.771 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:00:58.767+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:00:59.156 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:00:59.152+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:00:59.186 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:00:59.180+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:00:59.204 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:00:59.200+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:00:59.229 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:00:59.225+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:00:59.545 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:00:59.540+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:00:59.791 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:00:59.787+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:00.122 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:00.117+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:00.185 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:00.180+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:00.188 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:00.184+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:00.264 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:00.259+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:00.545 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:00.541+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:00.841 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:00.837+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:01.174 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:01.169+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:01.196 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:01.192+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:01.228 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:01.223+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:01.229 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:01.224+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:01.512 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:01.508+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:01.872 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:01.867+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:02.204 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:02.197+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:02.211 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:02.207+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:02.262 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:02.258+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:02.264 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:02.255+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:02.501 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:02.497+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:02.830 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:02.827+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:03.175 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:03.171+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:03.238 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:03.233+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:03.241 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:03.237+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:03.256 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:03.252+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:03.483 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:03.479+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:03.814 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:03.809+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:04.155 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:04.152+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:04.242 INFO:teuthology.orchestra.run.smithi074.stderr:testNameLimit (test.functional.tests.TestFile) ... ok 2019-11-29T03:01:04.258 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:04.254+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:04.263 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:04.259+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:04.272 INFO:teuthology.orchestra.run.smithi074.stderr:testNoContentLengthForPut (test.functional.tests.TestFile) ... ok 2019-11-29T03:01:04.274 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:04.269+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:04.490 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:04.486+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:04.791 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:04.786+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:05.161 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:05.156+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:05.239 INFO:teuthology.orchestra.run.smithi074.stderr:testPostOnFileThatDoesNotExist (test.functional.tests.TestFile) ... ok 2019-11-29T03:01:05.286 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:05.281+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:05.292 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:05.287+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:05.294 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:05.289+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:05.450 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:05.446+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:05.677 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:05.670+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T03:01:05.776 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:05.772+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:06.179 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:06.175+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:06.299 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:06.295+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:06.321 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:06.316+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:06.323 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:06.319+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:06.410 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:06.406+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:06.665 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:06.661+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T03:01:06.825 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:06.821+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:07.137 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:07.132+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:07.305 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:07.300+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:07.328 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:07.323+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:07.340 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:07.335+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:07.461 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:07.457+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:07.704 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:07.700+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T03:01:07.861 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:07.857+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:08.135 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:08.131+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:08.298 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:08.293+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:08.344 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:08.335+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:08.361 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:08.356+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:08.497 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:08.493+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:08.751 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:08.747+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T03:01:08.900 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:08.896+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:09.173 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:09.168+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:09.299 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:09.293+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:09.305 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:09.301+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:09.328 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:09.323+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:09.550 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:09.546+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:09.799 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:09.787+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:00:29.768735+0000 (oldest deadline 2019-11-29T03:01:09.768735+0000) 2019-11-29T03:01:09.800 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:09.794+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T03:01:09.905 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:09.900+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:10.216 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:10.212+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:10.289 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:10.284+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:10.317 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:10.312+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:10.323 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:10.317+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:10.577 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:10.572+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:10.796 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:10.792+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:00:29.768735+0000 (oldest deadline 2019-11-29T03:01:09.768735+0000) 2019-11-29T03:01:10.798 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:10.795+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T03:01:10.920 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:10.916+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:11.225 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:11.222+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:11.283 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:11.277+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:11.334 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:11.330+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:11.357 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:11.352+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:11.629 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:11.625+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:11.769 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:11.763+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:00:29.768735+0000 (oldest deadline 2019-11-29T03:01:09.768735+0000) 2019-11-29T03:01:11.774 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:11.768+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T03:01:11.899 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:11.895+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:12.257 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:12.253+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:12.288 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:12.284+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:12.378 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:12.374+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:12.382 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:12.377+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:12.631 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:12.627+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:12.732 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:12.728+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:00:29.768735+0000 (oldest deadline 2019-11-29T03:01:09.768735+0000) 2019-11-29T03:01:12.735 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:12.732+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T03:01:12.887 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:12.883+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:13.280 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:13.275+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:13.324 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:13.319+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:13.402 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:13.397+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:13.422 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:13.418+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:13.600 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:13.597+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:13.732 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:13.726+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:00:29.768735+0000 (oldest deadline 2019-11-29T03:01:09.768735+0000) 2019-11-29T03:01:13.733 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:13.728+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T03:01:13.869 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:13.864+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:14.304 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:14.300+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:14.329 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:14.325+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:14.379 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:14.374+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:14.440 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:14.434+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:14.576 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:14.572+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:14.754 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:14.750+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:00:29.768735+0000 (oldest deadline 2019-11-29T03:01:09.768735+0000) 2019-11-29T03:01:14.754 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:14.751+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T03:01:14.916 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:14.912+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:15.285 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:15.280+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:15.349 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:15.345+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:15.362 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:15.355+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:15.419 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:15.413+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:15.627 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:15.624+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:15.802 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:15.799+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:00:29.768735+0000 (oldest deadline 2019-11-29T03:01:09.768735+0000) 2019-11-29T03:01:15.802 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:15.800+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T03:01:15.960 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:15.957+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:16.268 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:16.264+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:16.309 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:16.306+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:16.349 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:16.345+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:16.392 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:16.387+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:16.674 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:16.670+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:16.843 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:16.839+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:00:29.768735+0000 (oldest deadline 2019-11-29T03:01:09.768735+0000) 2019-11-29T03:01:16.843 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:16.841+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T03:01:16.995 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:16.992+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:17.244 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:17.239+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:17.324 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:17.321+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:17.328 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:17.323+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:17.404 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:17.400+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:17.701 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:17.699+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:17.816 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:17.813+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:00:29.768735+0000 (oldest deadline 2019-11-29T03:01:09.768735+0000) 2019-11-29T03:01:17.817 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:17.814+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T03:01:18.037 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:18.034+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:18.253 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:18.249+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:18.297 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:18.292+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:18.381 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:18.376+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:18.422 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:18.418+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:18.668 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:18.665+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:18.785 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:18.781+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:00:29.768735+0000 (oldest deadline 2019-11-29T03:01:09.768735+0000) 2019-11-29T03:01:18.785 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:18.783+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T03:01:19.000 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:18.996+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:19.290 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:19.285+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:19.345 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:19.341+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:19.380 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:19.374+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:19.474 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:19.469+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:19.710 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:19.707+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:19.764 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:19.761+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:00:29.768735+0000 (oldest deadline 2019-11-29T03:01:09.768735+0000) 2019-11-29T03:01:19.765 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:19.762+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T03:01:19.956 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:19.953+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:20.245 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:20.241+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:20.342 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:20.339+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:20.362 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:20.357+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:20.450 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:20.445+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:20.710 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:20.706+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:20.784 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:20.781+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:00:29.768735+0000 (oldest deadline 2019-11-29T03:01:09.768735+0000) 2019-11-29T03:01:20.786 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:20.784+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T03:01:20.941 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:20.939+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:21.220 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:21.215+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:21.379 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:21.376+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:21.384 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:21.379+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:21.476 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:21.472+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:21.702 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:21.699+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:21.825 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:21.821+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:00:29.768735+0000 (oldest deadline 2019-11-29T03:01:09.768735+0000) 2019-11-29T03:01:21.825 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:21.823+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T03:01:21.950 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:21.947+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:22.262 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:22.257+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:22.379 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:22.375+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:22.411 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:22.408+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:22.435 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:22.429+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:22.701 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:22.698+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:22.845 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:22.842+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:00:29.768735+0000 (oldest deadline 2019-11-29T03:01:09.768735+0000) 2019-11-29T03:01:22.846 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:22.843+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T03:01:22.926 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:22.923+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:23.297 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:23.292+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:23.375 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:23.364+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:23.453 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:23.449+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:23.454 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:23.450+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:23.718 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:23.715+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:23.834 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:23.830+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:00:29.768735+0000 (oldest deadline 2019-11-29T03:01:09.768735+0000) 2019-11-29T03:01:23.835 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:23.831+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T03:01:23.917 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:23.914+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:24.332 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:24.327+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:24.406 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:24.400+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:24.442 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:24.440+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:24.443 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:24.437+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:24.673 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:24.670+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:24.872 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:24.869+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:24.888 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:24.883+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:00:29.768735+0000 (oldest deadline 2019-11-29T03:01:09.768735+0000) 2019-11-29T03:01:24.888 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:24.886+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T03:01:25.310 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:25.304+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:25.413 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:25.407+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:25.431 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:25.428+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:25.467 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:25.462+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:25.647 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:25.644+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:25.831 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:25.828+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:25.886 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:25.884+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:00:29.768735+0000 (oldest deadline 2019-11-29T03:01:09.768735+0000) 2019-11-29T03:01:25.888 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:25.886+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T03:01:26.205 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:01:26.194+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 41sec e180 v180) 2019-11-29T03:01:26.345 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:26.339+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:26.396 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:26.393+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:26.430 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:26.425+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:26.452 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:26.446+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:26.681 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:26.677+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:26.829 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:26.826+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:26.904 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:26.901+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:00:29.768735+0000 (oldest deadline 2019-11-29T03:01:09.768735+0000) 2019-11-29T03:01:26.905 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:26.901+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T03:01:27.318 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:27.311+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:27.365 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:27.361+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:27.404 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:27.399+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:27.433 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:27.428+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:27.637 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:27.634+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:27.860 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:27.858+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:27.868 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:27.865+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:00:29.768735+0000 (oldest deadline 2019-11-29T03:01:09.768735+0000) 2019-11-29T03:01:27.869 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:27.866+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T03:01:28.366 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:28.362+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:28.415 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:28.412+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:28.420 INFO:teuthology.orchestra.run.smithi074.stderr:testRangedGets (test.functional.tests.TestFile) ... ok 2019-11-29T03:01:28.440 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:28.435+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:28.457 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:28.453+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:28.628 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:28.625+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:28.870 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:28.867+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:28.909 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:28.905+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:00:29.768735+0000 (oldest deadline 2019-11-29T03:01:09.768735+0000) 2019-11-29T03:01:28.909 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:28.907+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T03:01:29.347 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:29.343+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:29.418 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:29.414+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:29.439 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:29.435+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:29.493 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:29.488+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:29.677 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:29.674+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:29.881 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:29.876+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:00:29.768735+0000 (oldest deadline 2019-11-29T03:01:09.768735+0000) 2019-11-29T03:01:29.882 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:29.878+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T03:01:29.886 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:29.882+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:30.368 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:30.363+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:30.398 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:30.394+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:30.419 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:30.415+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:30.453 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:30.448+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:30.655 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:30.651+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:30.915 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:30.911+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:00:29.768735+0000 (oldest deadline 2019-11-29T03:01:09.768735+0000) 2019-11-29T03:01:30.916 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:30.913+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T03:01:30.932 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:30.929+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:31.220 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:01:31.216+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 41sec e180 v180) 2019-11-29T03:01:31.324 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:31.319+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:31.432 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:31.428+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:31.467 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:31.462+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:31.505 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:31.501+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:31.638 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:31.634+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:31.916 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:31.911+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:31.932 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:31.928+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:00:29.768735+0000 (oldest deadline 2019-11-29T03:01:09.768735+0000) 2019-11-29T03:01:31.935 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:31.932+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T03:01:32.341 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:32.336+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:32.440 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:32.436+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:32.470 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:32.466+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:32.548 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:32.544+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:32.634 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:32.630+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:32.896 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:32.891+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:00:29.768735+0000 (oldest deadline 2019-11-29T03:01:09.768735+0000) 2019-11-29T03:01:32.897 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:32.893+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T03:01:32.969 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:32.965+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:33.300 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:33.295+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:33.409 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:33.405+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:33.439 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:33.434+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:33.510 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:33.506+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:33.607 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:33.603+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:33.852 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:33.848+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:00:29.768735+0000 (oldest deadline 2019-11-29T03:01:09.768735+0000) 2019-11-29T03:01:33.855 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:33.852+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T03:01:34.012 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:34.008+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:34.298 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:34.293+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:34.432 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:34.427+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:34.445 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:34.440+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:34.564 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:34.559+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:34.606 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:34.601+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:34.808 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:34.804+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:00:29.768735+0000 (oldest deadline 2019-11-29T03:01:09.768735+0000) 2019-11-29T03:01:34.810 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:34.807+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T03:01:34.976 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:34.972+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:35.298 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:35.292+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:35.474 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:35.470+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:35.481 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:35.474+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:35.613 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:35.608+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:35.647 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:35.643+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:35.767 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:35.761+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:00:29.768735+0000 (oldest deadline 2019-11-29T03:01:09.768735+0000) 2019-11-29T03:01:35.771 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:35.767+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T03:01:36.006 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:36.001+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:36.238 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:01:36.232+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 41sec e180 v180) 2019-11-29T03:01:36.256 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:36.250+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:36.477 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:36.474+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:36.478 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:36.472+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:36.598 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:36.593+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:36.632 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:36.629+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:36.808 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:36.804+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:00:29.768735+0000 (oldest deadline 2019-11-29T03:01:09.768735+0000) 2019-11-29T03:01:36.809 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:36.806+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T03:01:37.016 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:37.012+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:37.265 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:37.260+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:37.450 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:37.446+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:37.481 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:37.477+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:37.592 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:37.587+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:37.620 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:37.616+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:37.780 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:37.774+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:00:29.768735+0000 (oldest deadline 2019-11-29T03:01:09.768735+0000) 2019-11-29T03:01:37.781 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:37.777+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T03:01:38.011 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:38.007+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:38.293 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:38.289+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:38.501 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:38.497+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:38.514 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:38.509+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:38.587 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:38.582+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:38.663 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:38.660+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:38.829 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:38.825+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:00:29.768735+0000 (oldest deadline 2019-11-29T03:01:09.768735+0000) 2019-11-29T03:01:38.829 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:38.826+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T03:01:38.986 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:38.981+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:39.305 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:39.299+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:39.492 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:39.488+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:39.503 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:39.498+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:39.583 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:39.578+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:39.634 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:39.631+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:39.883 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:39.878+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:00:29.768735+0000 (oldest deadline 2019-11-29T03:01:09.768735+0000) 2019-11-29T03:01:39.884 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:39.879+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T03:01:39.980 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:39.977+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:40.290 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:40.285+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:40.462 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:40.457+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:40.514 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:40.509+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:40.607 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:40.603+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:40.631 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:01:40.626+0000 1694c700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.505560+0000 front 2019-11-29T03:00:12.199487+0000 (oldest deadline 2019-11-29T03:00:54.291988+0000) 2019-11-29T03:01:40.865 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:40.860+0000 1694c700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:00:29.768735+0000 (oldest deadline 2019-11-29T03:01:09.768735+0000) 2019-11-29T03:01:40.866 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:40.862+0000 1694c700 -1 osd.3 180 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T03:01:41.007 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:01:41.003+0000 1694c700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.517856+0000 front 2019-11-29T03:00:11.719612+0000 (oldest deadline 2019-11-29T03:00:54.069129+0000) 2019-11-29T03:01:41.306 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:01:41.300+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 41sec e180 v180) 2019-11-29T03:01:41.323 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:01:41.319+0000 1694c700 -1 osd.4 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:11.850832+0000 front 2019-11-29T03:00:11.852548+0000 (oldest deadline 2019-11-29T03:00:56.603070+0000) 2019-11-29T03:01:41.477 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:01:41.473+0000 1694c700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.241414+0000 front 2019-11-29T03:00:11.802657+0000 (oldest deadline 2019-11-29T03:00:52.809115+0000) 2019-11-29T03:01:41.498 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:01:41.494+0000 1694c700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:09.360709+0000 front 2019-11-29T03:00:09.496558+0000 (oldest deadline 2019-11-29T03:00:54.035305+0000) 2019-11-29T03:01:41.611 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:01:41.608+0000 1694c700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:00:12.080548+0000 front 2019-11-29T03:00:13.279727+0000 (oldest deadline 2019-11-29T03:00:54.286522+0000) 2019-11-29T03:01:41.938 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:01:41.861+0000 37f90700 -1 osd.3 181 build_incremental_map_msg missing incremental map 180 2019-11-29T03:02:04.645 INFO:teuthology.orchestra.run.smithi074.stderr:testSerialization (test.functional.tests.TestFile) ... ok 2019-11-29T03:03:04.399 INFO:teuthology.orchestra.run.smithi074.stderr:testStackedOverwrite (test.functional.tests.TestFile) ... ok 2019-11-29T03:03:04.495 INFO:teuthology.orchestra.run.smithi074.stderr:testTooLongName (test.functional.tests.TestFile) ... ok 2019-11-29T03:03:06.391 INFO:teuthology.orchestra.run.smithi074.stderr:testZeroByteFile (test.functional.tests.TestFile) ... ok 2019-11-29T03:03:14.073 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:03:14.067+0000 1694c700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:29.717107+0000 front 2019-11-29T03:02:29.737683+0000 (oldest deadline 2019-11-29T03:03:13.188746+0000) 2019-11-29T03:03:14.419 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:03:14.414+0000 1694c700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.150728+0000 front 2019-11-29T03:02:31.512577+0000 (oldest deadline 2019-11-29T03:03:13.699137+0000) 2019-11-29T03:03:15.007 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:03:15.002+0000 1694c700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.640259+0000 front 2019-11-29T03:02:30.722886+0000 (oldest deadline 2019-11-29T03:03:14.407242+0000) 2019-11-29T03:03:15.045 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:03:15.039+0000 1694c700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:29.717107+0000 front 2019-11-29T03:02:29.737683+0000 (oldest deadline 2019-11-29T03:03:13.188746+0000) 2019-11-29T03:03:15.429 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:03:15.424+0000 1694c700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.150728+0000 front 2019-11-29T03:02:31.512577+0000 (oldest deadline 2019-11-29T03:03:13.699137+0000) 2019-11-29T03:03:15.904 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:03:15.898+0000 1694c700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.267912+0000 front 2019-11-29T03:02:30.250748+0000 (oldest deadline 2019-11-29T03:03:15.525654+0000) 2019-11-29T03:03:16.033 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:03:16.028+0000 1694c700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:29.717107+0000 front 2019-11-29T03:02:29.737683+0000 (oldest deadline 2019-11-29T03:03:13.188746+0000) 2019-11-29T03:03:16.050 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:03:16.046+0000 1694c700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.640259+0000 front 2019-11-29T03:02:30.722886+0000 (oldest deadline 2019-11-29T03:03:14.407242+0000) 2019-11-29T03:03:16.405 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:03:16.398+0000 1694c700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.116146+0000 front 2019-11-29T03:02:32.113369+0000 (oldest deadline 2019-11-29T03:03:15.963835+0000) 2019-11-29T03:03:16.480 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:03:16.475+0000 1694c700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.150728+0000 front 2019-11-29T03:02:31.512577+0000 (oldest deadline 2019-11-29T03:03:13.699137+0000) 2019-11-29T03:03:16.590 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:03:16.586+0000 1694c700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.180114+0000 front 2019-11-29T03:02:32.036385+0000 (oldest deadline 2019-11-29T03:03:16.457836+0000) 2019-11-29T03:03:16.939 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:03:16.934+0000 1694c700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.267912+0000 front 2019-11-29T03:02:30.250748+0000 (oldest deadline 2019-11-29T03:03:15.525654+0000) 2019-11-29T03:03:16.991 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:03:16.986+0000 1694c700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:29.717107+0000 front 2019-11-29T03:02:29.737683+0000 (oldest deadline 2019-11-29T03:03:13.188746+0000) 2019-11-29T03:03:17.051 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:03:17.047+0000 1694c700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.640259+0000 front 2019-11-29T03:02:30.722886+0000 (oldest deadline 2019-11-29T03:03:14.407242+0000) 2019-11-29T03:03:17.416 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:03:17.410+0000 1694c700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.116146+0000 front 2019-11-29T03:02:32.113369+0000 (oldest deadline 2019-11-29T03:03:15.963835+0000) 2019-11-29T03:03:17.446 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:03:17.441+0000 1694c700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.150728+0000 front 2019-11-29T03:02:31.512577+0000 (oldest deadline 2019-11-29T03:03:13.699137+0000) 2019-11-29T03:03:17.571 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:03:17.566+0000 1694c700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.911055+0000 front 2019-11-29T03:02:32.019721+0000 (oldest deadline 2019-11-29T03:03:17.073560+0000) 2019-11-29T03:03:17.615 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:03:17.611+0000 1694c700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.180114+0000 front 2019-11-29T03:02:32.036385+0000 (oldest deadline 2019-11-29T03:03:16.457836+0000) 2019-11-29T03:03:17.988 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:03:17.983+0000 1694c700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.267912+0000 front 2019-11-29T03:02:30.250748+0000 (oldest deadline 2019-11-29T03:03:15.525654+0000) 2019-11-29T03:03:18.022 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:03:18.017+0000 1694c700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.640259+0000 front 2019-11-29T03:02:30.722886+0000 (oldest deadline 2019-11-29T03:03:14.407242+0000) 2019-11-29T03:03:18.025 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:03:18.020+0000 1694c700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:29.717107+0000 front 2019-11-29T03:02:29.737683+0000 (oldest deadline 2019-11-29T03:03:13.188746+0000) 2019-11-29T03:03:18.437 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:03:18.432+0000 1694c700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.116146+0000 front 2019-11-29T03:02:32.113369+0000 (oldest deadline 2019-11-29T03:03:15.963835+0000) 2019-11-29T03:03:18.449 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:03:18.444+0000 1694c700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.150728+0000 front 2019-11-29T03:02:31.512577+0000 (oldest deadline 2019-11-29T03:03:13.699137+0000) 2019-11-29T03:03:18.590 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:03:18.587+0000 1694c700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.180114+0000 front 2019-11-29T03:02:32.036385+0000 (oldest deadline 2019-11-29T03:03:16.457836+0000) 2019-11-29T03:03:18.599 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:03:18.595+0000 1694c700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.911055+0000 front 2019-11-29T03:02:32.019721+0000 (oldest deadline 2019-11-29T03:03:17.073560+0000) 2019-11-29T03:03:18.978 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:03:18.974+0000 1694c700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.640259+0000 front 2019-11-29T03:02:30.722886+0000 (oldest deadline 2019-11-29T03:03:14.407242+0000) 2019-11-29T03:03:19.038 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:03:19.033+0000 1694c700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.267912+0000 front 2019-11-29T03:02:30.250748+0000 (oldest deadline 2019-11-29T03:03:15.525654+0000) 2019-11-29T03:03:19.044 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:03:19.038+0000 1694c700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:29.717107+0000 front 2019-11-29T03:02:29.737683+0000 (oldest deadline 2019-11-29T03:03:13.188746+0000) 2019-11-29T03:03:19.430 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:03:19.425+0000 1694c700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.150728+0000 front 2019-11-29T03:02:31.512577+0000 (oldest deadline 2019-11-29T03:03:13.699137+0000) 2019-11-29T03:03:19.456 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:03:19.451+0000 1694c700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.116146+0000 front 2019-11-29T03:02:32.113369+0000 (oldest deadline 2019-11-29T03:03:15.963835+0000) 2019-11-29T03:03:19.629 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:03:19.625+0000 1694c700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.911055+0000 front 2019-11-29T03:02:32.019721+0000 (oldest deadline 2019-11-29T03:03:17.073560+0000) 2019-11-29T03:03:19.630 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:03:19.626+0000 1694c700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.180114+0000 front 2019-11-29T03:02:32.036385+0000 (oldest deadline 2019-11-29T03:03:16.457836+0000) 2019-11-29T03:03:20.011 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:03:20.007+0000 1694c700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.640259+0000 front 2019-11-29T03:02:30.722886+0000 (oldest deadline 2019-11-29T03:03:14.407242+0000) 2019-11-29T03:03:20.082 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:03:20.077+0000 1694c700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.267912+0000 front 2019-11-29T03:02:30.250748+0000 (oldest deadline 2019-11-29T03:03:15.525654+0000) 2019-11-29T03:03:20.094 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:03:20.090+0000 1694c700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:29.717107+0000 front 2019-11-29T03:02:29.737683+0000 (oldest deadline 2019-11-29T03:03:13.188746+0000) 2019-11-29T03:03:20.412 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:03:20.406+0000 1694c700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.150728+0000 front 2019-11-29T03:02:31.512577+0000 (oldest deadline 2019-11-29T03:03:13.699137+0000) 2019-11-29T03:03:20.413 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:03:20.408+0000 1694c700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.116146+0000 front 2019-11-29T03:02:32.113369+0000 (oldest deadline 2019-11-29T03:03:15.963835+0000) 2019-11-29T03:03:20.620 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:03:20.615+0000 1694c700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.911055+0000 front 2019-11-29T03:02:32.019721+0000 (oldest deadline 2019-11-29T03:03:17.073560+0000) 2019-11-29T03:03:20.653 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:03:20.646+0000 1694c700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.180114+0000 front 2019-11-29T03:02:32.036385+0000 (oldest deadline 2019-11-29T03:03:16.457836+0000) 2019-11-29T03:03:20.997 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:03:20.993+0000 1694c700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.640259+0000 front 2019-11-29T03:02:30.722886+0000 (oldest deadline 2019-11-29T03:03:14.407242+0000) 2019-11-29T03:03:21.119 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:03:21.114+0000 1694c700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.267912+0000 front 2019-11-29T03:02:30.250748+0000 (oldest deadline 2019-11-29T03:03:15.525654+0000) 2019-11-29T03:03:21.130 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:03:21.124+0000 1694c700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:29.717107+0000 front 2019-11-29T03:02:29.737683+0000 (oldest deadline 2019-11-29T03:03:13.188746+0000) 2019-11-29T03:03:21.381 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:03:21.376+0000 1694c700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.150728+0000 front 2019-11-29T03:02:31.512577+0000 (oldest deadline 2019-11-29T03:03:13.699137+0000) 2019-11-29T03:03:21.382 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:03:21.376+0000 1694c700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.116146+0000 front 2019-11-29T03:02:32.113369+0000 (oldest deadline 2019-11-29T03:03:15.963835+0000) 2019-11-29T03:03:21.652 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:03:21.648+0000 1694c700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.911055+0000 front 2019-11-29T03:02:32.019721+0000 (oldest deadline 2019-11-29T03:03:17.073560+0000) 2019-11-29T03:03:21.654 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:03:21.650+0000 1694c700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.180114+0000 front 2019-11-29T03:02:32.036385+0000 (oldest deadline 2019-11-29T03:03:16.457836+0000) 2019-11-29T03:03:21.851 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:17:04.069 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:03:21.858 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:17:04.076 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:03:21.878 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:17:04.097 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:03:21.901 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:17:04.120 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:03:21.923 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:17:04.152 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:03:21.929 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:17:04.158 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:03:21.954 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:03:21.951+0000 1694c700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.640259+0000 front 2019-11-29T03:02:30.722886+0000 (oldest deadline 2019-11-29T03:03:14.407242+0000) 2019-11-29T03:03:22.085 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:03:22.080+0000 1694c700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.267912+0000 front 2019-11-29T03:02:30.250748+0000 (oldest deadline 2019-11-29T03:03:15.525654+0000) 2019-11-29T03:03:22.134 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:17:04.352 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:03:22.162 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:17:04.381 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:03:22.169 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:17:04.398 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:03:22.176 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:03:22.172+0000 1694c700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:29.717107+0000 front 2019-11-29T03:02:29.737683+0000 (oldest deadline 2019-11-29T03:03:13.188746+0000) 2019-11-29T03:03:22.354 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:03:22.349+0000 1694c700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.150728+0000 front 2019-11-29T03:02:31.512577+0000 (oldest deadline 2019-11-29T03:03:13.699137+0000) 2019-11-29T03:03:22.424 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:03:22.420+0000 1694c700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.116146+0000 front 2019-11-29T03:02:32.113369+0000 (oldest deadline 2019-11-29T03:03:15.963835+0000) 2019-11-29T03:03:22.655 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:03:22.651+0000 1694c700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.180114+0000 front 2019-11-29T03:02:32.036385+0000 (oldest deadline 2019-11-29T03:03:16.457836+0000) 2019-11-29T03:03:22.694 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:03:22.691+0000 1694c700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.911055+0000 front 2019-11-29T03:02:32.019721+0000 (oldest deadline 2019-11-29T03:03:17.073560+0000) 2019-11-29T03:03:22.990 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:03:22.987+0000 1694c700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.640259+0000 front 2019-11-29T03:02:30.722886+0000 (oldest deadline 2019-11-29T03:03:14.407242+0000) 2019-11-29T03:03:23.069 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:03:23.064+0000 1694c700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.267912+0000 front 2019-11-29T03:02:30.250748+0000 (oldest deadline 2019-11-29T03:03:15.525654+0000) 2019-11-29T03:03:23.196 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:03:23.191+0000 1694c700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:29.717107+0000 front 2019-11-29T03:02:29.737683+0000 (oldest deadline 2019-11-29T03:03:13.188746+0000) 2019-11-29T03:03:23.337 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:03:23.332+0000 1694c700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.150728+0000 front 2019-11-29T03:02:31.512577+0000 (oldest deadline 2019-11-29T03:03:13.699137+0000) 2019-11-29T03:03:23.410 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:03:23.405+0000 1694c700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.116146+0000 front 2019-11-29T03:02:32.113369+0000 (oldest deadline 2019-11-29T03:03:15.963835+0000) 2019-11-29T03:03:23.693 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:03:23.689+0000 1694c700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.180114+0000 front 2019-11-29T03:02:32.036385+0000 (oldest deadline 2019-11-29T03:03:16.457836+0000) 2019-11-29T03:03:23.704 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:03:23.700+0000 1694c700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.911055+0000 front 2019-11-29T03:02:32.019721+0000 (oldest deadline 2019-11-29T03:03:17.073560+0000) 2019-11-29T03:03:23.966 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:03:23.961+0000 1694c700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.640259+0000 front 2019-11-29T03:02:30.722886+0000 (oldest deadline 2019-11-29T03:03:14.407242+0000) 2019-11-29T03:03:24.070 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:03:24.064+0000 1694c700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.267912+0000 front 2019-11-29T03:02:30.250748+0000 (oldest deadline 2019-11-29T03:03:15.525654+0000) 2019-11-29T03:03:24.194 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:03:24.189+0000 1694c700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:29.717107+0000 front 2019-11-29T03:02:29.737683+0000 (oldest deadline 2019-11-29T03:03:13.188746+0000) 2019-11-29T03:03:24.304 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:03:24.299+0000 1694c700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.150728+0000 front 2019-11-29T03:02:31.512577+0000 (oldest deadline 2019-11-29T03:03:13.699137+0000) 2019-11-29T03:03:24.365 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:03:24.360+0000 1694c700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.116146+0000 front 2019-11-29T03:02:32.113369+0000 (oldest deadline 2019-11-29T03:03:15.963835+0000) 2019-11-29T03:03:24.728 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:03:24.724+0000 1694c700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.911055+0000 front 2019-11-29T03:02:32.019721+0000 (oldest deadline 2019-11-29T03:03:17.073560+0000) 2019-11-29T03:03:24.732 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:03:24.728+0000 1694c700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.180114+0000 front 2019-11-29T03:02:32.036385+0000 (oldest deadline 2019-11-29T03:03:16.457836+0000) 2019-11-29T03:03:25.021 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:03:25.015+0000 1694c700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.640259+0000 front 2019-11-29T03:02:30.722886+0000 (oldest deadline 2019-11-29T03:03:14.407242+0000) 2019-11-29T03:03:25.116 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:03:25.111+0000 1694c700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.267912+0000 front 2019-11-29T03:02:30.250748+0000 (oldest deadline 2019-11-29T03:03:15.525654+0000) 2019-11-29T03:03:25.244 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:03:25.239+0000 1694c700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:29.717107+0000 front 2019-11-29T03:02:29.737683+0000 (oldest deadline 2019-11-29T03:03:13.188746+0000) 2019-11-29T03:03:25.342 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:03:25.336+0000 1694c700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.150728+0000 front 2019-11-29T03:02:31.512577+0000 (oldest deadline 2019-11-29T03:03:13.699137+0000) 2019-11-29T03:03:25.411 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:03:25.405+0000 1694c700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.116146+0000 front 2019-11-29T03:02:32.113369+0000 (oldest deadline 2019-11-29T03:03:15.963835+0000) 2019-11-29T03:03:25.730 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:03:25.724+0000 1694c700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.180114+0000 front 2019-11-29T03:02:32.036385+0000 (oldest deadline 2019-11-29T03:03:16.457836+0000) 2019-11-29T03:03:25.774 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:03:25.771+0000 1694c700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.911055+0000 front 2019-11-29T03:02:32.019721+0000 (oldest deadline 2019-11-29T03:03:17.073560+0000) 2019-11-29T03:03:26.068 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:03:26.063+0000 1694c700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.640259+0000 front 2019-11-29T03:02:30.722886+0000 (oldest deadline 2019-11-29T03:03:14.407242+0000) 2019-11-29T03:03:26.173 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:03:26.166+0000 1694c700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.267912+0000 front 2019-11-29T03:02:30.250748+0000 (oldest deadline 2019-11-29T03:03:15.525654+0000) 2019-11-29T03:03:26.231 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:03:26.226+0000 1694c700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:29.717107+0000 front 2019-11-29T03:02:29.737683+0000 (oldest deadline 2019-11-29T03:03:13.188746+0000) 2019-11-29T03:03:26.314 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:03:26.308+0000 1694c700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.150728+0000 front 2019-11-29T03:02:31.512577+0000 (oldest deadline 2019-11-29T03:03:13.699137+0000) 2019-11-29T03:03:26.398 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:03:26.393+0000 1694c700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.116146+0000 front 2019-11-29T03:02:32.113369+0000 (oldest deadline 2019-11-29T03:03:15.963835+0000) 2019-11-29T03:03:26.691 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:03:26.687+0000 1694c700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.180114+0000 front 2019-11-29T03:02:32.036385+0000 (oldest deadline 2019-11-29T03:03:16.457836+0000) 2019-11-29T03:03:26.794 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:03:26.790+0000 1694c700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.911055+0000 front 2019-11-29T03:02:32.019721+0000 (oldest deadline 2019-11-29T03:03:17.073560+0000) 2019-11-29T03:03:27.042 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:03:27.037+0000 1694c700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.640259+0000 front 2019-11-29T03:02:30.722886+0000 (oldest deadline 2019-11-29T03:03:14.407242+0000) 2019-11-29T03:03:27.165 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:03:27.160+0000 1694c700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.267912+0000 front 2019-11-29T03:02:30.250748+0000 (oldest deadline 2019-11-29T03:03:15.525654+0000) 2019-11-29T03:03:27.276 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:03:27.270+0000 1694c700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:29.717107+0000 front 2019-11-29T03:02:29.737683+0000 (oldest deadline 2019-11-29T03:03:13.188746+0000) 2019-11-29T03:03:27.355 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:03:27.349+0000 1694c700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.150728+0000 front 2019-11-29T03:02:31.512577+0000 (oldest deadline 2019-11-29T03:03:13.699137+0000) 2019-11-29T03:03:27.365 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:03:27.360+0000 1694c700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.116146+0000 front 2019-11-29T03:02:32.113369+0000 (oldest deadline 2019-11-29T03:03:15.963835+0000) 2019-11-29T03:03:27.689 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:03:27.684+0000 1694c700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.180114+0000 front 2019-11-29T03:02:32.036385+0000 (oldest deadline 2019-11-29T03:03:16.457836+0000) 2019-11-29T03:03:27.812 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:03:27.807+0000 1694c700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.911055+0000 front 2019-11-29T03:02:32.019721+0000 (oldest deadline 2019-11-29T03:03:17.073560+0000) 2019-11-29T03:03:28.066 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:03:28.061+0000 1694c700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.640259+0000 front 2019-11-29T03:02:30.722886+0000 (oldest deadline 2019-11-29T03:03:14.407242+0000) 2019-11-29T03:03:28.172 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:03:28.167+0000 1694c700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.267912+0000 front 2019-11-29T03:02:30.250748+0000 (oldest deadline 2019-11-29T03:03:15.525654+0000) 2019-11-29T03:03:28.316 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:03:28.310+0000 1694c700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:29.717107+0000 front 2019-11-29T03:02:29.737683+0000 (oldest deadline 2019-11-29T03:03:13.188746+0000) 2019-11-29T03:03:28.344 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:03:28.338+0000 1694c700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.150728+0000 front 2019-11-29T03:02:31.512577+0000 (oldest deadline 2019-11-29T03:03:13.699137+0000) 2019-11-29T03:03:28.398 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:03:28.393+0000 1694c700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.116146+0000 front 2019-11-29T03:02:32.113369+0000 (oldest deadline 2019-11-29T03:03:15.963835+0000) 2019-11-29T03:03:28.738 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:03:28.734+0000 1694c700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.180114+0000 front 2019-11-29T03:02:32.036385+0000 (oldest deadline 2019-11-29T03:03:16.457836+0000) 2019-11-29T03:03:28.825 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:03:28.821+0000 1694c700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.911055+0000 front 2019-11-29T03:02:32.019721+0000 (oldest deadline 2019-11-29T03:03:17.073560+0000) 2019-11-29T03:03:29.097 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:03:29.093+0000 1694c700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.640259+0000 front 2019-11-29T03:02:30.722886+0000 (oldest deadline 2019-11-29T03:03:14.407242+0000) 2019-11-29T03:03:29.198 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:03:29.192+0000 1694c700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.267912+0000 front 2019-11-29T03:02:30.250748+0000 (oldest deadline 2019-11-29T03:03:15.525654+0000) 2019-11-29T03:03:29.275 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:03:29.269+0000 1694c700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:29.717107+0000 front 2019-11-29T03:02:29.737683+0000 (oldest deadline 2019-11-29T03:03:13.188746+0000) 2019-11-29T03:03:29.399 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:03:29.393+0000 1694c700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.150728+0000 front 2019-11-29T03:02:31.512577+0000 (oldest deadline 2019-11-29T03:03:13.699137+0000) 2019-11-29T03:03:29.403 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:03:29.396+0000 1694c700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.116146+0000 front 2019-11-29T03:02:32.113369+0000 (oldest deadline 2019-11-29T03:03:15.963835+0000) 2019-11-29T03:03:29.714 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:03:29.710+0000 1694c700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.180114+0000 front 2019-11-29T03:02:32.036385+0000 (oldest deadline 2019-11-29T03:03:16.457836+0000) 2019-11-29T03:03:29.839 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:03:29.834+0000 1694c700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.911055+0000 front 2019-11-29T03:02:32.019721+0000 (oldest deadline 2019-11-29T03:03:17.073560+0000) 2019-11-29T03:03:30.139 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:03:30.135+0000 1694c700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.640259+0000 front 2019-11-29T03:02:30.722886+0000 (oldest deadline 2019-11-29T03:03:14.407242+0000) 2019-11-29T03:03:30.176 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:03:30.169+0000 1694c700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.267912+0000 front 2019-11-29T03:02:30.250748+0000 (oldest deadline 2019-11-29T03:03:15.525654+0000) 2019-11-29T03:03:30.304 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:03:30.298+0000 1694c700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:29.717107+0000 front 2019-11-29T03:02:29.737683+0000 (oldest deadline 2019-11-29T03:03:13.188746+0000) 2019-11-29T03:03:30.388 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:03:30.371+0000 1694c700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.150728+0000 front 2019-11-29T03:02:31.512577+0000 (oldest deadline 2019-11-29T03:03:13.699137+0000) 2019-11-29T03:03:30.440 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:03:30.434+0000 1694c700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.116146+0000 front 2019-11-29T03:02:32.113369+0000 (oldest deadline 2019-11-29T03:03:15.963835+0000) 2019-11-29T03:03:30.752 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:03:30.748+0000 1694c700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.180114+0000 front 2019-11-29T03:02:32.036385+0000 (oldest deadline 2019-11-29T03:03:16.457836+0000) 2019-11-29T03:03:30.880 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:03:30.875+0000 1694c700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.911055+0000 front 2019-11-29T03:02:32.019721+0000 (oldest deadline 2019-11-29T03:03:17.073560+0000) 2019-11-29T03:03:31.110 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:03:31.106+0000 1694c700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.640259+0000 front 2019-11-29T03:02:30.722886+0000 (oldest deadline 2019-11-29T03:03:14.407242+0000) 2019-11-29T03:03:31.179 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:03:31.174+0000 1694c700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.267912+0000 front 2019-11-29T03:02:30.250748+0000 (oldest deadline 2019-11-29T03:03:15.525654+0000) 2019-11-29T03:03:31.328 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:03:31.323+0000 1694c700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:29.717107+0000 front 2019-11-29T03:02:29.737683+0000 (oldest deadline 2019-11-29T03:03:13.188746+0000) 2019-11-29T03:03:31.371 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:03:31.364+0000 1694c700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.150728+0000 front 2019-11-29T03:02:31.512577+0000 (oldest deadline 2019-11-29T03:03:13.699137+0000) 2019-11-29T03:03:31.422 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:03:31.417+0000 1694c700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.116146+0000 front 2019-11-29T03:02:32.113369+0000 (oldest deadline 2019-11-29T03:03:15.963835+0000) 2019-11-29T03:03:31.760 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:03:31.758+0000 1694c700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.180114+0000 front 2019-11-29T03:02:32.036385+0000 (oldest deadline 2019-11-29T03:03:16.457836+0000) 2019-11-29T03:03:31.926 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:03:31.923+0000 1694c700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.911055+0000 front 2019-11-29T03:02:32.019721+0000 (oldest deadline 2019-11-29T03:03:17.073560+0000) 2019-11-29T03:03:32.113 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:03:32.110+0000 1694c700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.640259+0000 front 2019-11-29T03:02:30.722886+0000 (oldest deadline 2019-11-29T03:03:14.407242+0000) 2019-11-29T03:03:32.188 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:03:32.182+0000 1694c700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.267912+0000 front 2019-11-29T03:02:30.250748+0000 (oldest deadline 2019-11-29T03:03:15.525654+0000) 2019-11-29T03:03:32.306 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:03:32.300+0000 1694c700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:29.717107+0000 front 2019-11-29T03:02:29.737683+0000 (oldest deadline 2019-11-29T03:03:13.188746+0000) 2019-11-29T03:03:32.357 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:03:32.352+0000 1694c700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.150728+0000 front 2019-11-29T03:02:31.512577+0000 (oldest deadline 2019-11-29T03:03:13.699137+0000) 2019-11-29T03:03:32.462 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:03:32.457+0000 1694c700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.116146+0000 front 2019-11-29T03:02:32.113369+0000 (oldest deadline 2019-11-29T03:03:15.963835+0000) 2019-11-29T03:03:32.783 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:03:32.779+0000 1694c700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.180114+0000 front 2019-11-29T03:02:32.036385+0000 (oldest deadline 2019-11-29T03:03:16.457836+0000) 2019-11-29T03:03:32.898 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:03:32.895+0000 1694c700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.911055+0000 front 2019-11-29T03:02:32.019721+0000 (oldest deadline 2019-11-29T03:03:17.073560+0000) 2019-11-29T03:03:33.078 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:03:33.074+0000 1694c700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.640259+0000 front 2019-11-29T03:02:30.722886+0000 (oldest deadline 2019-11-29T03:03:14.407242+0000) 2019-11-29T03:03:33.206 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:03:33.201+0000 1694c700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.267912+0000 front 2019-11-29T03:02:30.250748+0000 (oldest deadline 2019-11-29T03:03:15.525654+0000) 2019-11-29T03:03:33.282 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:03:33.276+0000 1694c700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:29.717107+0000 front 2019-11-29T03:02:29.737683+0000 (oldest deadline 2019-11-29T03:03:13.188746+0000) 2019-11-29T03:03:33.378 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:03:33.373+0000 1694c700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.150728+0000 front 2019-11-29T03:02:31.512577+0000 (oldest deadline 2019-11-29T03:03:13.699137+0000) 2019-11-29T03:03:33.460 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:03:33.454+0000 1694c700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.116146+0000 front 2019-11-29T03:02:32.113369+0000 (oldest deadline 2019-11-29T03:03:15.963835+0000) 2019-11-29T03:03:33.749 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:03:33.745+0000 1694c700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.180114+0000 front 2019-11-29T03:02:32.036385+0000 (oldest deadline 2019-11-29T03:03:16.457836+0000) 2019-11-29T03:03:33.927 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:03:33.924+0000 1694c700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.911055+0000 front 2019-11-29T03:02:32.019721+0000 (oldest deadline 2019-11-29T03:03:17.073560+0000) 2019-11-29T03:03:34.115 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:03:34.111+0000 1694c700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.640259+0000 front 2019-11-29T03:02:30.722886+0000 (oldest deadline 2019-11-29T03:03:14.407242+0000) 2019-11-29T03:03:34.233 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:03:34.227+0000 1694c700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.267912+0000 front 2019-11-29T03:02:30.250748+0000 (oldest deadline 2019-11-29T03:03:15.525654+0000) 2019-11-29T03:03:34.265 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:03:34.259+0000 1694c700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:29.717107+0000 front 2019-11-29T03:02:29.737683+0000 (oldest deadline 2019-11-29T03:03:13.188746+0000) 2019-11-29T03:03:34.358 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:03:34.352+0000 1694c700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.150728+0000 front 2019-11-29T03:02:31.512577+0000 (oldest deadline 2019-11-29T03:03:13.699137+0000) 2019-11-29T03:03:34.437 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:03:34.431+0000 1694c700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.116146+0000 front 2019-11-29T03:02:32.113369+0000 (oldest deadline 2019-11-29T03:03:15.963835+0000) 2019-11-29T03:03:34.709 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:03:34.705+0000 1694c700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.180114+0000 front 2019-11-29T03:02:32.036385+0000 (oldest deadline 2019-11-29T03:03:16.457836+0000) 2019-11-29T03:03:34.949 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:03:34.946+0000 1694c700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.911055+0000 front 2019-11-29T03:02:32.019721+0000 (oldest deadline 2019-11-29T03:03:17.073560+0000) 2019-11-29T03:03:35.161 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:03:35.158+0000 1694c700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.640259+0000 front 2019-11-29T03:02:30.722886+0000 (oldest deadline 2019-11-29T03:03:14.407242+0000) 2019-11-29T03:03:35.240 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:03:35.235+0000 1694c700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.267912+0000 front 2019-11-29T03:02:30.250748+0000 (oldest deadline 2019-11-29T03:03:15.525654+0000) 2019-11-29T03:03:35.270 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:03:35.265+0000 1694c700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:29.717107+0000 front 2019-11-29T03:02:29.737683+0000 (oldest deadline 2019-11-29T03:03:13.188746+0000) 2019-11-29T03:03:35.389 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:03:35.383+0000 1694c700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.150728+0000 front 2019-11-29T03:02:31.512577+0000 (oldest deadline 2019-11-29T03:03:13.699137+0000) 2019-11-29T03:03:35.410 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:03:35.404+0000 1694c700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.116146+0000 front 2019-11-29T03:02:32.113369+0000 (oldest deadline 2019-11-29T03:03:15.963835+0000) 2019-11-29T03:03:35.710 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:03:35.706+0000 1694c700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.180114+0000 front 2019-11-29T03:02:32.036385+0000 (oldest deadline 2019-11-29T03:03:16.457836+0000) 2019-11-29T03:03:35.949 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:03:35.945+0000 1694c700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.911055+0000 front 2019-11-29T03:02:32.019721+0000 (oldest deadline 2019-11-29T03:03:17.073560+0000) 2019-11-29T03:03:36.115 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:03:36.112+0000 1694c700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.640259+0000 front 2019-11-29T03:02:30.722886+0000 (oldest deadline 2019-11-29T03:03:14.407242+0000) 2019-11-29T03:03:36.257 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:03:36.252+0000 1694c700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.267912+0000 front 2019-11-29T03:02:30.250748+0000 (oldest deadline 2019-11-29T03:03:15.525654+0000) 2019-11-29T03:03:36.269 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:03:36.264+0000 1694c700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:29.717107+0000 front 2019-11-29T03:02:29.737683+0000 (oldest deadline 2019-11-29T03:03:13.188746+0000) 2019-11-29T03:03:36.372 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:03:36.367+0000 1694c700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.116146+0000 front 2019-11-29T03:02:32.113369+0000 (oldest deadline 2019-11-29T03:03:15.963835+0000) 2019-11-29T03:03:36.379 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:03:36.374+0000 1694c700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.150728+0000 front 2019-11-29T03:02:31.512577+0000 (oldest deadline 2019-11-29T03:03:13.699137+0000) 2019-11-29T03:03:36.705 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:03:36.702+0000 1694c700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.180114+0000 front 2019-11-29T03:02:32.036385+0000 (oldest deadline 2019-11-29T03:03:16.457836+0000) 2019-11-29T03:03:36.990 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:03:36.987+0000 1694c700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.911055+0000 front 2019-11-29T03:02:32.019721+0000 (oldest deadline 2019-11-29T03:03:17.073560+0000) 2019-11-29T03:03:37.075 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:03:37.072+0000 1694c700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.640259+0000 front 2019-11-29T03:02:30.722886+0000 (oldest deadline 2019-11-29T03:03:14.407242+0000) 2019-11-29T03:03:37.257 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:03:37.252+0000 1694c700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:29.717107+0000 front 2019-11-29T03:02:29.737683+0000 (oldest deadline 2019-11-29T03:03:13.188746+0000) 2019-11-29T03:03:37.307 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:03:37.299+0000 1694c700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.267912+0000 front 2019-11-29T03:02:30.250748+0000 (oldest deadline 2019-11-29T03:03:15.525654+0000) 2019-11-29T03:03:37.409 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:03:37.404+0000 1694c700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.116146+0000 front 2019-11-29T03:02:32.113369+0000 (oldest deadline 2019-11-29T03:03:15.963835+0000) 2019-11-29T03:03:37.422 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:03:37.417+0000 1694c700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.150728+0000 front 2019-11-29T03:02:31.512577+0000 (oldest deadline 2019-11-29T03:03:13.699137+0000) 2019-11-29T03:03:37.731 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:03:37.729+0000 1694c700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.180114+0000 front 2019-11-29T03:02:32.036385+0000 (oldest deadline 2019-11-29T03:03:16.457836+0000) 2019-11-29T03:03:37.953 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:03:37.949+0000 1694c700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.911055+0000 front 2019-11-29T03:02:32.019721+0000 (oldest deadline 2019-11-29T03:03:17.073560+0000) 2019-11-29T03:03:38.065 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:03:38.062+0000 1694c700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.640259+0000 front 2019-11-29T03:02:30.722886+0000 (oldest deadline 2019-11-29T03:03:14.407242+0000) 2019-11-29T03:03:38.246 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:03:38.240+0000 1694c700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:29.717107+0000 front 2019-11-29T03:02:29.737683+0000 (oldest deadline 2019-11-29T03:03:13.188746+0000) 2019-11-29T03:03:38.348 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:03:38.342+0000 1694c700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.267912+0000 front 2019-11-29T03:02:30.250748+0000 (oldest deadline 2019-11-29T03:03:15.525654+0000) 2019-11-29T03:03:38.381 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:03:38.376+0000 1694c700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.150728+0000 front 2019-11-29T03:02:31.512577+0000 (oldest deadline 2019-11-29T03:03:13.699137+0000) 2019-11-29T03:03:38.408 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:03:38.402+0000 1694c700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.116146+0000 front 2019-11-29T03:02:32.113369+0000 (oldest deadline 2019-11-29T03:03:15.963835+0000) 2019-11-29T03:03:38.737 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:03:38.733+0000 1694c700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.180114+0000 front 2019-11-29T03:02:32.036385+0000 (oldest deadline 2019-11-29T03:03:16.457836+0000) 2019-11-29T03:03:38.997 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:03:38.994+0000 1694c700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.911055+0000 front 2019-11-29T03:02:32.019721+0000 (oldest deadline 2019-11-29T03:03:17.073560+0000) 2019-11-29T03:03:39.051 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:03:39.049+0000 1694c700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.640259+0000 front 2019-11-29T03:02:30.722886+0000 (oldest deadline 2019-11-29T03:03:14.407242+0000) 2019-11-29T03:03:39.271 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:03:39.266+0000 1694c700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:29.717107+0000 front 2019-11-29T03:02:29.737683+0000 (oldest deadline 2019-11-29T03:03:13.188746+0000) 2019-11-29T03:03:39.339 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:03:39.332+0000 1694c700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.150728+0000 front 2019-11-29T03:02:31.512577+0000 (oldest deadline 2019-11-29T03:03:13.699137+0000) 2019-11-29T03:03:39.354 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:03:39.349+0000 1694c700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.267912+0000 front 2019-11-29T03:02:30.250748+0000 (oldest deadline 2019-11-29T03:03:15.525654+0000) 2019-11-29T03:03:39.420 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:03:39.414+0000 1694c700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.116146+0000 front 2019-11-29T03:02:32.113369+0000 (oldest deadline 2019-11-29T03:03:15.963835+0000) 2019-11-29T03:03:39.736 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:03:39.732+0000 1694c700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.180114+0000 front 2019-11-29T03:02:32.036385+0000 (oldest deadline 2019-11-29T03:03:16.457836+0000) 2019-11-29T03:03:39.992 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:03:39.988+0000 1694c700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.911055+0000 front 2019-11-29T03:02:32.019721+0000 (oldest deadline 2019-11-29T03:03:17.073560+0000) 2019-11-29T03:03:40.106 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:03:40.103+0000 1694c700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.640259+0000 front 2019-11-29T03:02:30.722886+0000 (oldest deadline 2019-11-29T03:03:14.407242+0000) 2019-11-29T03:03:40.310 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:03:40.304+0000 1694c700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.267912+0000 front 2019-11-29T03:02:30.250748+0000 (oldest deadline 2019-11-29T03:03:15.525654+0000) 2019-11-29T03:03:40.317 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:03:40.311+0000 1694c700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:29.717107+0000 front 2019-11-29T03:02:29.737683+0000 (oldest deadline 2019-11-29T03:03:13.188746+0000) 2019-11-29T03:03:40.363 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:03:40.357+0000 1694c700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.150728+0000 front 2019-11-29T03:02:31.512577+0000 (oldest deadline 2019-11-29T03:03:13.699137+0000) 2019-11-29T03:03:40.472 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:03:40.467+0000 1694c700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.116146+0000 front 2019-11-29T03:02:32.113369+0000 (oldest deadline 2019-11-29T03:03:15.963835+0000) 2019-11-29T03:03:40.766 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:03:40.762+0000 1694c700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.180114+0000 front 2019-11-29T03:02:32.036385+0000 (oldest deadline 2019-11-29T03:03:16.457836+0000) 2019-11-29T03:03:40.958 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:03:40.955+0000 1694c700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.911055+0000 front 2019-11-29T03:02:32.019721+0000 (oldest deadline 2019-11-29T03:03:17.073560+0000) 2019-11-29T03:03:41.149 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:03:41.146+0000 1694c700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.640259+0000 front 2019-11-29T03:02:30.722886+0000 (oldest deadline 2019-11-29T03:03:14.407242+0000) 2019-11-29T03:03:41.326 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:03:41.320+0000 1694c700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.267912+0000 front 2019-11-29T03:02:30.250748+0000 (oldest deadline 2019-11-29T03:03:15.525654+0000) 2019-11-29T03:03:41.334 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:03:41.329+0000 1694c700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:29.717107+0000 front 2019-11-29T03:02:29.737683+0000 (oldest deadline 2019-11-29T03:03:13.188746+0000) 2019-11-29T03:03:41.395 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:03:41.389+0000 1694c700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.150728+0000 front 2019-11-29T03:02:31.512577+0000 (oldest deadline 2019-11-29T03:03:13.699137+0000) 2019-11-29T03:03:41.454 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:03:41.449+0000 1694c700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.116146+0000 front 2019-11-29T03:02:32.113369+0000 (oldest deadline 2019-11-29T03:03:15.963835+0000) 2019-11-29T03:03:41.746 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:03:41.742+0000 1694c700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.180114+0000 front 2019-11-29T03:02:32.036385+0000 (oldest deadline 2019-11-29T03:03:16.457836+0000) 2019-11-29T03:03:41.912 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:03:41.909+0000 1694c700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.911055+0000 front 2019-11-29T03:02:32.019721+0000 (oldest deadline 2019-11-29T03:03:17.073560+0000) 2019-11-29T03:03:42.190 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:03:42.186+0000 1694c700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.640259+0000 front 2019-11-29T03:02:30.722886+0000 (oldest deadline 2019-11-29T03:03:14.407242+0000) 2019-11-29T03:03:42.318 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:03:42.313+0000 1694c700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:29.717107+0000 front 2019-11-29T03:02:29.737683+0000 (oldest deadline 2019-11-29T03:03:13.188746+0000) 2019-11-29T03:03:42.358 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:03:42.353+0000 1694c700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.267912+0000 front 2019-11-29T03:02:30.250748+0000 (oldest deadline 2019-11-29T03:03:15.525654+0000) 2019-11-29T03:03:42.398 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:03:42.393+0000 1694c700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.150728+0000 front 2019-11-29T03:02:31.512577+0000 (oldest deadline 2019-11-29T03:03:13.699137+0000) 2019-11-29T03:03:42.473 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:03:42.467+0000 1694c700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.116146+0000 front 2019-11-29T03:02:32.113369+0000 (oldest deadline 2019-11-29T03:03:15.963835+0000) 2019-11-29T03:03:42.789 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:03:42.787+0000 1694c700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.180114+0000 front 2019-11-29T03:02:32.036385+0000 (oldest deadline 2019-11-29T03:03:16.457836+0000) 2019-11-29T03:03:42.920 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:03:42.916+0000 1694c700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.911055+0000 front 2019-11-29T03:02:32.019721+0000 (oldest deadline 2019-11-29T03:03:17.073560+0000) 2019-11-29T03:03:43.173 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:03:43.169+0000 1694c700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.640259+0000 front 2019-11-29T03:02:30.722886+0000 (oldest deadline 2019-11-29T03:03:14.407242+0000) 2019-11-29T03:03:43.354 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:03:43.348+0000 1694c700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:29.717107+0000 front 2019-11-29T03:02:29.737683+0000 (oldest deadline 2019-11-29T03:03:13.188746+0000) 2019-11-29T03:03:43.367 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:03:43.361+0000 1694c700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.150728+0000 front 2019-11-29T03:02:31.512577+0000 (oldest deadline 2019-11-29T03:03:13.699137+0000) 2019-11-29T03:03:43.380 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:03:43.375+0000 1694c700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.267912+0000 front 2019-11-29T03:02:30.250748+0000 (oldest deadline 2019-11-29T03:03:15.525654+0000) 2019-11-29T03:03:43.489 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:03:43.483+0000 1694c700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.116146+0000 front 2019-11-29T03:02:32.113369+0000 (oldest deadline 2019-11-29T03:03:15.963835+0000) 2019-11-29T03:03:43.774 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:03:43.770+0000 1694c700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.180114+0000 front 2019-11-29T03:02:32.036385+0000 (oldest deadline 2019-11-29T03:03:16.457836+0000) 2019-11-29T03:03:43.964 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:03:43.962+0000 1694c700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.911055+0000 front 2019-11-29T03:02:32.019721+0000 (oldest deadline 2019-11-29T03:03:17.073560+0000) 2019-11-29T03:03:44.141 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:03:44.137+0000 1694c700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.640259+0000 front 2019-11-29T03:02:30.722886+0000 (oldest deadline 2019-11-29T03:03:14.407242+0000) 2019-11-29T03:03:44.353 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:03:44.347+0000 1694c700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.267912+0000 front 2019-11-29T03:02:30.250748+0000 (oldest deadline 2019-11-29T03:03:15.525654+0000) 2019-11-29T03:03:44.356 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:03:44.350+0000 1694c700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.150728+0000 front 2019-11-29T03:02:31.512577+0000 (oldest deadline 2019-11-29T03:03:13.699137+0000) 2019-11-29T03:03:44.385 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:03:44.380+0000 1694c700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:29.717107+0000 front 2019-11-29T03:02:29.737683+0000 (oldest deadline 2019-11-29T03:03:13.188746+0000) 2019-11-29T03:03:44.475 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:03:44.469+0000 1694c700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.116146+0000 front 2019-11-29T03:02:32.113369+0000 (oldest deadline 2019-11-29T03:03:15.963835+0000) 2019-11-29T03:03:44.757 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:03:44.746+0000 1694c700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.180114+0000 front 2019-11-29T03:02:32.036385+0000 (oldest deadline 2019-11-29T03:03:16.457836+0000) 2019-11-29T03:03:44.926 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:03:44.923+0000 1694c700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.911055+0000 front 2019-11-29T03:02:32.019721+0000 (oldest deadline 2019-11-29T03:03:17.073560+0000) 2019-11-29T03:03:45.154 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:03:45.150+0000 1694c700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.640259+0000 front 2019-11-29T03:02:30.722886+0000 (oldest deadline 2019-11-29T03:03:14.407242+0000) 2019-11-29T03:03:45.363 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:03:45.357+0000 1694c700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:29.717107+0000 front 2019-11-29T03:02:29.737683+0000 (oldest deadline 2019-11-29T03:03:13.188746+0000) 2019-11-29T03:03:45.388 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:03:45.383+0000 1694c700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.150728+0000 front 2019-11-29T03:02:31.512577+0000 (oldest deadline 2019-11-29T03:03:13.699137+0000) 2019-11-29T03:03:45.400 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:03:45.394+0000 1694c700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.267912+0000 front 2019-11-29T03:02:30.250748+0000 (oldest deadline 2019-11-29T03:03:15.525654+0000) 2019-11-29T03:03:45.528 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:03:45.523+0000 1694c700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.116146+0000 front 2019-11-29T03:02:32.113369+0000 (oldest deadline 2019-11-29T03:03:15.963835+0000) 2019-11-29T03:03:45.712 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:03:45.707+0000 1694c700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.180114+0000 front 2019-11-29T03:02:32.036385+0000 (oldest deadline 2019-11-29T03:03:16.457836+0000) 2019-11-29T03:03:45.939 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:03:45.935+0000 1694c700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.911055+0000 front 2019-11-29T03:02:32.019721+0000 (oldest deadline 2019-11-29T03:03:17.073560+0000) 2019-11-29T03:03:46.177 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:03:46.173+0000 1694c700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.640259+0000 front 2019-11-29T03:02:30.722886+0000 (oldest deadline 2019-11-29T03:03:14.407242+0000) 2019-11-29T03:03:46.396 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:03:46.389+0000 1694c700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.150728+0000 front 2019-11-29T03:02:31.512577+0000 (oldest deadline 2019-11-29T03:03:13.699137+0000) 2019-11-29T03:03:46.401 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:03:46.395+0000 1694c700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:29.717107+0000 front 2019-11-29T03:02:29.737683+0000 (oldest deadline 2019-11-29T03:03:13.188746+0000) 2019-11-29T03:03:46.415 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:03:46.409+0000 1694c700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.267912+0000 front 2019-11-29T03:02:30.250748+0000 (oldest deadline 2019-11-29T03:03:15.525654+0000) 2019-11-29T03:03:46.515 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:03:46.508+0000 1694c700 -1 osd.5 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:32.116146+0000 front 2019-11-29T03:02:32.113369+0000 (oldest deadline 2019-11-29T03:03:15.963835+0000) 2019-11-29T03:03:46.760 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:03:46.757+0000 1694c700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.180114+0000 front 2019-11-29T03:02:32.036385+0000 (oldest deadline 2019-11-29T03:03:16.457836+0000) 2019-11-29T03:03:46.907 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:03:46.894+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.74:6802/10096,v1:172.21.15.74:6803/10096] for 44sec e185 v185) 2019-11-29T03:03:46.968 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:03:46.964+0000 1694c700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:31.911055+0000 front 2019-11-29T03:02:32.019721+0000 (oldest deadline 2019-11-29T03:03:17.073560+0000) 2019-11-29T03:03:47.137 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:03:47.133+0000 1694c700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:02:30.640259+0000 front 2019-11-29T03:02:30.722886+0000 (oldest deadline 2019-11-29T03:03:14.407242+0000) 2019-11-29T03:04:12.187 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:17:54.405 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:04:12.198 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:17:54.415 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:04:12.212 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:17:54.431 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:04:12.218 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:17:54.437 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:04:12.219 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:17:54.448 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:04:12.230 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:17:54.458 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:04:12.262 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:17:54.480 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:04:12.306 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:17:54.525 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:04:12.340 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:17:54.568 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:04:27.611 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:04:27.535+0000 38f92700 -1 osd.3 191 build_incremental_map_msg missing incremental map 191 2019-11-29T03:04:27.619 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:04:27.553+0000 34f8a700 -1 osd.3 191 build_incremental_map_msg missing incremental map 191 2019-11-29T03:04:27.741 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:04:27.583+0000 34789700 -1 osd.3 191 build_incremental_map_msg missing incremental map 191 2019-11-29T03:04:29.371 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:04:29.331+0000 34789700 -1 osd.3 191 build_incremental_map_msg missing incremental map 191 2019-11-29T03:04:44.283 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:04:44.280+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:04:44.300 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:04:44.295+0000 1694c700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.764601+0000 front 2019-11-29T03:04:03.691646+0000 (oldest deadline 2019-11-29T03:04:44.162064+0000) 2019-11-29T03:04:44.569 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:04:44.566+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:04:45.245 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:04:45.241+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:04:45.269 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:04:45.264+0000 1694c700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.764601+0000 front 2019-11-29T03:04:03.691646+0000 (oldest deadline 2019-11-29T03:04:44.162064+0000) 2019-11-29T03:04:45.586 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:04:45.581+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:04:46.262 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:04:46.257+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:04:46.293 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:04:46.288+0000 1694c700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.764601+0000 front 2019-11-29T03:04:03.691646+0000 (oldest deadline 2019-11-29T03:04:44.162064+0000) 2019-11-29T03:04:46.550 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:04:46.545+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:04:46.568 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:04:46.564+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:04:47.290 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:04:47.286+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:04:47.304 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:04:47.298+0000 1694c700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.764601+0000 front 2019-11-29T03:04:03.691646+0000 (oldest deadline 2019-11-29T03:04:44.162064+0000) 2019-11-29T03:04:47.528 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:04:47.524+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:04:47.531 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:04:47.527+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:04:47.566 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:04:47.562+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:04:47.808 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:04:47.803+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:04:48.299 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:04:48.295+0000 1694c700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.764601+0000 front 2019-11-29T03:04:03.691646+0000 (oldest deadline 2019-11-29T03:04:44.162064+0000) 2019-11-29T03:04:48.332 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:04:48.328+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:04:48.505 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:04:48.500+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:04:48.528 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:04:48.521+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:04:48.550 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:04:48.546+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:04:48.854 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:04:48.849+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:04:49.343 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:04:49.338+0000 1694c700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.764601+0000 front 2019-11-29T03:04:03.691646+0000 (oldest deadline 2019-11-29T03:04:44.162064+0000) 2019-11-29T03:04:49.376 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:04:49.372+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:04:49.506 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:04:49.500+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:04:49.539 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:04:49.534+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:04:49.601 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:04:49.596+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:04:49.837 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:04:49.832+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:04:50.348 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:04:50.344+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:04:50.368 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:04:50.363+0000 1694c700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.764601+0000 front 2019-11-29T03:04:03.691646+0000 (oldest deadline 2019-11-29T03:04:44.162064+0000) 2019-11-29T03:04:50.514 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:04:50.510+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:04:50.519 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:04:50.515+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:04:50.657 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:04:50.649+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:04:50.802 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:04:50.799+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:04:51.369 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:04:51.363+0000 1694c700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.764601+0000 front 2019-11-29T03:04:03.691646+0000 (oldest deadline 2019-11-29T03:04:44.162064+0000) 2019-11-29T03:04:51.372 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:04:51.368+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:04:51.484 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:04:51.481+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:04:51.517 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:04:51.512+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:04:51.676 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:04:51.671+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:04:51.822 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:04:51.817+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:04:52.199 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:04:52.196+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:104421 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821600288 gen 61] snapc 0=[] ondisk+write+known_if_redirected e189) 2019-11-29T03:04:52.384 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:04:52.379+0000 1694c700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.764601+0000 front 2019-11-29T03:04:03.691646+0000 (oldest deadline 2019-11-29T03:04:44.162064+0000) 2019-11-29T03:04:52.392 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:04:52.388+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:04:52.463 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:04:52.457+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:04:52.481 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:04:52.476+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:04:52.693 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:04:52.689+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:04:52.842 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:04:52.838+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:04:53.225 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:04:53.222+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:104421 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821600288 gen 61] snapc 0=[] ondisk+write+known_if_redirected e189) 2019-11-29T03:04:53.339 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:04:53.334+0000 1694c700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.764601+0000 front 2019-11-29T03:04:03.691646+0000 (oldest deadline 2019-11-29T03:04:44.162064+0000) 2019-11-29T03:04:53.357 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:04:53.353+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:04:53.456 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:04:53.452+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:04:53.508 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:04:53.502+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:04:53.692 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:04:53.684+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:04:53.842 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:04:53.835+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:04:54.186 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:04:54.183+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-29T03:04:54.341 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:04:54.336+0000 1694c700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.764601+0000 front 2019-11-29T03:04:03.691646+0000 (oldest deadline 2019-11-29T03:04:44.162064+0000) 2019-11-29T03:04:54.380 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:04:54.376+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:04:54.417 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:04:54.413+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:04:54.545 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:04:54.541+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:04:54.746 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:04:54.741+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:04:54.822 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:04:54.818+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:04:55.172 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:04:55.168+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-29T03:04:55.374 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:04:55.369+0000 1694c700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.764601+0000 front 2019-11-29T03:04:03.691646+0000 (oldest deadline 2019-11-29T03:04:44.162064+0000) 2019-11-29T03:04:55.380 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:04:55.375+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:04:55.384 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:04:55.380+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:04:55.529 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:04:55.523+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:04:55.728 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:04:55.723+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:04:55.843 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:04:55.840+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:04:56.206 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:04:56.203+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-29T03:04:56.340 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:04:56.336+0000 1694c700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.764601+0000 front 2019-11-29T03:04:03.691646+0000 (oldest deadline 2019-11-29T03:04:44.162064+0000) 2019-11-29T03:04:56.361 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:04:56.357+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:04:56.364 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:04:56.361+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:04:56.580 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:04:56.574+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:04:56.769 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:04:56.763+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:04:56.888 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:04:56.884+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:04:57.166 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:04:57.163+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-29T03:04:57.208 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:18:39.426 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:04:57.246 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:18:39.464 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:04:57.249 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:18:39.468 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:04:57.253 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:18:39.472 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:04:57.253 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:18:39.481 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:04:57.258 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:18:39.487 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:04:57.333 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:18:39.552 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:04:57.335 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:18:39.553 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:04:57.338 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:04:57.332+0000 1694c700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.764601+0000 front 2019-11-29T03:04:03.691646+0000 (oldest deadline 2019-11-29T03:04:44.162064+0000) 2019-11-29T03:04:57.350 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:18:39.578 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:04:57.350 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:04:57.346+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:04:57.372 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:04:57.369+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:04:57.612 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:04:57.607+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:04:57.818 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:04:57.814+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:04:57.888 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:04:57.885+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:04:58.153 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:04:58.146+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-29T03:04:58.315 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:04:58.312+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:04:58.318 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:04:58.313+0000 1694c700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.764601+0000 front 2019-11-29T03:04:03.691646+0000 (oldest deadline 2019-11-29T03:04:44.162064+0000) 2019-11-29T03:04:58.370 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:04:58.366+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:04:58.646 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:04:58.642+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:04:58.778 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:04:58.774+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:04:58.878 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:04:58.875+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:04:59.189 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:04:59.186+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-29T03:04:59.324 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:04:59.319+0000 1694c700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.764601+0000 front 2019-11-29T03:04:03.691646+0000 (oldest deadline 2019-11-29T03:04:44.162064+0000) 2019-11-29T03:04:59.330 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:04:59.326+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:04:59.392 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:04:59.389+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:04:59.694 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:04:59.689+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:04:59.800 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:04:59.792+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:04:59.911 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:04:59.906+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:05:00.175 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:00.172+0000 1694c700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:04:20.097183+0000 (oldest deadline 2019-11-29T03:05:00.097183+0000) 2019-11-29T03:05:00.178 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:00.174+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-29T03:05:00.327 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:05:00.322+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:05:00.352 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:05:00.348+0000 1694c700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.764601+0000 front 2019-11-29T03:04:03.691646+0000 (oldest deadline 2019-11-29T03:04:44.162064+0000) 2019-11-29T03:05:00.394 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:05:00.389+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:05:00.664 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:05:00.659+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:05:00.775 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:05:00.770+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:05:00.917 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:05:00.913+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:05:01.150 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:01.146+0000 1694c700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:04:20.097183+0000 (oldest deadline 2019-11-29T03:05:00.097183+0000) 2019-11-29T03:05:01.151 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:01.148+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-29T03:05:01.288 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:05:01.284+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:05:01.334 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:05:01.329+0000 1694c700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.764601+0000 front 2019-11-29T03:04:03.691646+0000 (oldest deadline 2019-11-29T03:04:44.162064+0000) 2019-11-29T03:05:01.386 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:05:01.383+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:05:01.698 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:05:01.692+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:05:01.736 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:05:01.730+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:05:01.946 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:05:01.942+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:05:02.128 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:02.123+0000 1694c700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:04:20.097183+0000 (oldest deadline 2019-11-29T03:05:00.097183+0000) 2019-11-29T03:05:02.128 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:02.124+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-29T03:05:02.257 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:05:02.254+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:05:02.359 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:05:02.354+0000 1694c700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.764601+0000 front 2019-11-29T03:04:03.691646+0000 (oldest deadline 2019-11-29T03:04:44.162064+0000) 2019-11-29T03:05:02.427 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:05:02.425+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:05:02.679 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:05:02.674+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:05:02.696 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:05:02.691+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:05:02.915 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:05:02.912+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:05:03.113 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:03.109+0000 1694c700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:04:20.097183+0000 (oldest deadline 2019-11-29T03:05:00.097183+0000) 2019-11-29T03:05:03.114 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:03.111+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-29T03:05:03.249 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:05:03.247+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:05:03.326 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:05:03.320+0000 1694c700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.764601+0000 front 2019-11-29T03:04:03.691646+0000 (oldest deadline 2019-11-29T03:04:44.162064+0000) 2019-11-29T03:05:03.454 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:05:03.445+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:05:03.660 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:05:03.655+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:05:03.716 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:05:03.712+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:05:03.899 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:05:03.897+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:05:04.112 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:04.108+0000 1694c700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:04:20.097183+0000 (oldest deadline 2019-11-29T03:05:00.097183+0000) 2019-11-29T03:05:04.113 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:04.111+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-29T03:05:04.214 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:05:04.210+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:05:04.342 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:05:04.335+0000 1694c700 -1 osd.4 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.764601+0000 front 2019-11-29T03:04:03.691646+0000 (oldest deadline 2019-11-29T03:04:44.162064+0000) 2019-11-29T03:05:04.498 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:05:04.496+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:05:04.644 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:05:04.639+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:05:04.736 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:05:04.726+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:05:04.861 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:05:04.858+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:05:05.126 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:05.123+0000 1694c700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:04:20.097183+0000 (oldest deadline 2019-11-29T03:05:00.097183+0000) 2019-11-29T03:05:05.128 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:05.126+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-29T03:05:05.248 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:05:05.245+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:05:05.462 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:05:05.459+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:05:05.606 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:05:05.602+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:05:05.698 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:05:05.692+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:05:05.875 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:05:05.871+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:05:06.173 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:06.170+0000 1694c700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:04:20.097183+0000 (oldest deadline 2019-11-29T03:05:00.097183+0000) 2019-11-29T03:05:06.174 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:06.171+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-29T03:05:06.292 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:05:06.290+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:05:06.498 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:05:06.495+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:05:06.649 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:05:06.644+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:05:06.669 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:05:06.664+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:05:06.906 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:05:06.903+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:05:07.149 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:07.146+0000 1694c700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:04:20.097183+0000 (oldest deadline 2019-11-29T03:05:00.097183+0000) 2019-11-29T03:05:07.152 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:07.150+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-29T03:05:07.315 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:05:07.312+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:05:07.462 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:05:07.459+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:05:07.647 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:05:07.642+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:05:07.696 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:05:07.675+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:05:07.929 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:05:07.927+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:05:08.148 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:08.144+0000 1694c700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:04:20.097183+0000 (oldest deadline 2019-11-29T03:05:00.097183+0000) 2019-11-29T03:05:08.149 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:08.146+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-29T03:05:08.342 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:05:08.338+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:05:08.418 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:05:08.415+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:05:08.617 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:05:08.611+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:05:08.704 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:05:08.699+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:05:08.940 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:05:08.937+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:05:09.121 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:09.119+0000 1694c700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:04:20.097183+0000 (oldest deadline 2019-11-29T03:05:00.097183+0000) 2019-11-29T03:05:09.124 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:09.122+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-29T03:05:09.371 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:05:09.367+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:05:09.388 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:05:09.384+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:05:09.640 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:05:09.634+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:05:09.666 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:05:09.661+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:05:09.985 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:05:09.982+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:05:10.079 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:10.075+0000 1694c700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:04:20.097183+0000 (oldest deadline 2019-11-29T03:05:00.097183+0000) 2019-11-29T03:05:10.079 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:10.077+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-29T03:05:10.339 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:05:10.336+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:05:10.395 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:05:10.392+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:05:10.661 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:05:10.656+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:05:10.665 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:05:10.659+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:05:10.942 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:05:10.939+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:05:11.037 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:11.033+0000 1694c700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:04:20.097183+0000 (oldest deadline 2019-11-29T03:05:00.097183+0000) 2019-11-29T03:05:11.038 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:11.035+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-29T03:05:11.362 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:05:11.358+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:05:11.433 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:05:11.431+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:05:11.655 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:05:11.650+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:05:11.675 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:05:11.669+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:05:11.993 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:05:11.985+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:05:12.047 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:12.043+0000 1694c700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:04:20.097183+0000 (oldest deadline 2019-11-29T03:05:00.097183+0000) 2019-11-29T03:05:12.047 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:12.045+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-29T03:05:12.365 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:05:12.362+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:05:12.441 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:05:12.438+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:05:12.705 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:05:12.701+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:05:12.716 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:05:12.711+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:05:13.007 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:05:13.003+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:05:13.064 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:13.060+0000 1694c700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:04:20.097183+0000 (oldest deadline 2019-11-29T03:05:00.097183+0000) 2019-11-29T03:05:13.064 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:13.062+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-29T03:05:13.403 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:05:13.398+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:05:13.430 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:05:13.428+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:05:13.742 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:05:13.738+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:05:13.747 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:05:13.743+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:05:14.047 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:05:14.044+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:05:14.056 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:14.051+0000 1694c700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:04:20.097183+0000 (oldest deadline 2019-11-29T03:05:00.097183+0000) 2019-11-29T03:05:14.057 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:14.054+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-29T03:05:14.422 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:05:14.420+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:05:14.476 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:05:14.472+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:05:14.750 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:05:14.744+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:05:14.758 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:05:14.754+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:05:15.012 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:15.009+0000 1694c700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:04:20.097183+0000 (oldest deadline 2019-11-29T03:05:00.097183+0000) 2019-11-29T03:05:15.014 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:15.012+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-29T03:05:15.033 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:05:15.030+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:05:15.399 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:05:15.396+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:05:15.486 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:05:15.483+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:05:15.747 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:05:15.742+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:05:15.779 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:05:15.774+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:05:16.068 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:16.063+0000 1694c700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:04:20.097183+0000 (oldest deadline 2019-11-29T03:05:00.097183+0000) 2019-11-29T03:05:16.069 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:16.066+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-29T03:05:16.071 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:05:16.068+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:05:16.361 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:05:16.357+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:05:16.505 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:05:16.500+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:05:16.758 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:05:16.753+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:05:16.821 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:05:16.817+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:05:17.028 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:17.025+0000 1694c700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:04:20.097183+0000 (oldest deadline 2019-11-29T03:05:00.097183+0000) 2019-11-29T03:05:17.030 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:17.027+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-29T03:05:17.083 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:05:17.079+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:05:17.396 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:05:17.393+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:05:17.495 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:05:17.491+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:05:17.732 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:05:17.727+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:05:17.808 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:05:17.803+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:05:18.060 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:18.055+0000 1694c700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:04:20.097183+0000 (oldest deadline 2019-11-29T03:05:00.097183+0000) 2019-11-29T03:05:18.061 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:18.057+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-29T03:05:18.140 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:05:18.134+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:05:18.399 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:05:18.395+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:05:18.516 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:05:18.512+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:05:18.702 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:05:18.697+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:05:18.826 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:05:18.821+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:05:19.070 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:19.065+0000 1694c700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:04:20.097183+0000 (oldest deadline 2019-11-29T03:05:00.097183+0000) 2019-11-29T03:05:19.071 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:19.067+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-29T03:05:19.121 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:05:19.117+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:05:19.432 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:05:19.428+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:05:19.488 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:05:19.484+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:05:19.718 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:05:19.713+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:05:19.797 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:05:19.792+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:05:20.072 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:20.068+0000 1694c700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:04:20.097183+0000 (oldest deadline 2019-11-29T03:05:00.097183+0000) 2019-11-29T03:05:20.073 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:20.069+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-29T03:05:20.143 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:05:20.140+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:05:20.443 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:05:20.439+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:05:20.536 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:05:20.531+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:05:20.705 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:05:20.699+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:05:20.823 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:05:20.817+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:05:21.072 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:21.068+0000 1694c700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:04:20.097183+0000 (oldest deadline 2019-11-29T03:05:00.097183+0000) 2019-11-29T03:05:21.075 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:21.072+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-29T03:05:21.132 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:05:21.129+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:05:21.428 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:05:21.423+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:05:21.538 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:05:21.533+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:05:21.701 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:05:21.694+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:05:21.859 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:05:21.853+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:05:22.073 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:22.069+0000 1694c700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:04:20.097183+0000 (oldest deadline 2019-11-29T03:05:00.097183+0000) 2019-11-29T03:05:22.075 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:22.072+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-29T03:05:22.149 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:05:22.145+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:05:22.287 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:05:22.281+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 43sec e191 v191) 2019-11-29T03:05:22.436 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:05:22.433+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:05:22.569 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:05:22.565+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:05:22.752 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:05:22.745+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:05:22.884 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:05:22.877+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:05:23.109 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:23.104+0000 1694c700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:04:20.097183+0000 (oldest deadline 2019-11-29T03:05:00.097183+0000) 2019-11-29T03:05:23.109 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:23.106+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-29T03:05:23.189 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:05:23.185+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:05:23.470 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:05:23.465+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:05:23.615 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:05:23.610+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:05:23.764 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:05:23.760+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:05:23.872 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:05:23.867+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:05:24.077 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:24.073+0000 1694c700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:04:20.097183+0000 (oldest deadline 2019-11-29T03:05:00.097183+0000) 2019-11-29T03:05:24.080 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:24.077+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-29T03:05:24.182 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:05:24.179+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:05:24.494 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:05:24.490+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:05:24.573 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:05:24.569+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:05:24.794 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:05:24.790+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:05:24.883 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:05:24.879+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:05:25.103 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:25.099+0000 1694c700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:04:20.097183+0000 (oldest deadline 2019-11-29T03:05:00.097183+0000) 2019-11-29T03:05:25.107 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:25.103+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-29T03:05:25.228 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:05:25.223+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:05:25.468 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:05:25.464+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:05:25.548 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:05:25.544+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:05:25.813 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:05:25.808+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:05:25.928 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:05:25.923+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:05:26.118 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:26.113+0000 1694c700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:04:20.097183+0000 (oldest deadline 2019-11-29T03:05:00.097183+0000) 2019-11-29T03:05:26.118 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:26.114+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-29T03:05:26.273 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:05:26.269+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:05:26.427 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:05:26.423+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:05:26.542 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:05:26.538+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:05:26.865 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:05:26.861+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:05:26.922 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:05:26.917+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:05:27.075 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:27.070+0000 1694c700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:04:20.097183+0000 (oldest deadline 2019-11-29T03:05:00.097183+0000) 2019-11-29T03:05:27.075 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:27.071+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-29T03:05:27.290 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:05:27.286+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:05:27.301 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:05:27.297+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 43sec e191 v191) 2019-11-29T03:05:27.400 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:05:27.397+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:05:27.511 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:05:27.508+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:05:27.833 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:05:27.828+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:05:27.916 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:05:27.912+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:05:28.029 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:28.026+0000 1694c700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:04:20.097183+0000 (oldest deadline 2019-11-29T03:05:00.097183+0000) 2019-11-29T03:05:28.031 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:28.029+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-29T03:05:28.247 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:05:28.242+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:05:28.436 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:05:28.432+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:05:28.521 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:05:28.518+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:05:28.875 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:05:28.870+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:05:28.903 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:05:28.898+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:05:29.080 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:29.075+0000 1694c700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:04:20.097183+0000 (oldest deadline 2019-11-29T03:05:00.097183+0000) 2019-11-29T03:05:29.081 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:29.077+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-29T03:05:29.288 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:05:29.284+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:05:29.422 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:05:29.418+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:05:29.522 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:05:29.518+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:05:29.839 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:05:29.834+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:05:29.890 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:05:29.887+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:05:30.132 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:30.128+0000 1694c700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:04:20.097183+0000 (oldest deadline 2019-11-29T03:05:00.097183+0000) 2019-11-29T03:05:30.134 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:30.131+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-29T03:05:30.340 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:05:30.336+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:05:30.412 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:05:30.409+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:05:30.480 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:05:30.475+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:05:30.882 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:05:30.878+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:05:30.892 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:05:30.888+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:05:31.115 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:31.110+0000 1694c700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:04:20.097183+0000 (oldest deadline 2019-11-29T03:05:00.097183+0000) 2019-11-29T03:05:31.117 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:31.113+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-29T03:05:31.377 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:05:31.372+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:05:31.446 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:05:31.442+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:05:31.491 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:05:31.487+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:05:31.906 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:05:31.901+0000 1694c700 -1 osd.6 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.295499+0000 front 2019-11-29T03:04:03.061259+0000 (oldest deadline 2019-11-29T03:04:46.960513+0000) 2019-11-29T03:05:31.942 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:05:31.937+0000 1694c700 -1 osd.7 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:03:59.844356+0000 front 2019-11-29T03:03:59.809451+0000 (oldest deadline 2019-11-29T03:04:45.564558+0000) 2019-11-29T03:05:32.070 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:32.065+0000 1694c700 -1 osd.3 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:04:20.097183+0000 (oldest deadline 2019-11-29T03:05:00.097183+0000) 2019-11-29T03:05:32.071 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:32.067+0000 1694c700 -1 osd.3 191 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-29T03:05:32.342 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:05:32.338+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 43sec e191 v191) 2019-11-29T03:05:32.354 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:05:32.351+0000 1694c700 -1 osd.1 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:02.266900+0000 front 2019-11-29T03:04:02.223375+0000 (oldest deadline 2019-11-29T03:04:46.885348+0000) 2019-11-29T03:05:32.473 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:05:32.469+0000 1694c700 -1 osd.0 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:04.025960+0000 front 2019-11-29T03:04:04.069534+0000 (oldest deadline 2019-11-29T03:04:43.494897+0000) 2019-11-29T03:05:32.494 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:05:32.480+0000 1694c700 -1 osd.2 191 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:04:03.938360+0000 front 2019-11-29T03:03:58.033926+0000 (oldest deadline 2019-11-29T03:04:43.798893+0000) 2019-11-29T03:05:32.974 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:05:32.780+0000 37f90700 -1 osd.3 192 build_incremental_map_msg missing incremental map 191 2019-11-29T03:07:04.179 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:07:04.175+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.827176+0000 front 2019-11-29T03:06:24.075515+0000 (oldest deadline 2019-11-29T03:07:04.029714+0000) 2019-11-29T03:07:05.039 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:07:05.034+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:18.729009+0000 front 2019-11-29T03:06:18.665591+0000 (oldest deadline 2019-11-29T03:07:04.541552+0000) 2019-11-29T03:07:05.218 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:07:05.213+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.827176+0000 front 2019-11-29T03:06:24.075515+0000 (oldest deadline 2019-11-29T03:07:04.029714+0000) 2019-11-29T03:07:05.823 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:07:05.817+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.396288+0000 front 2019-11-29T03:06:21.468791+0000 (oldest deadline 2019-11-29T03:07:04.816402+0000) 2019-11-29T03:07:06.006 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:07:06.001+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:18.729009+0000 front 2019-11-29T03:06:18.665591+0000 (oldest deadline 2019-11-29T03:07:04.541552+0000) 2019-11-29T03:07:06.149 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:07:06.145+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:20.508939+0000 front 2019-11-29T03:06:20.341925+0000 (oldest deadline 2019-11-29T03:07:05.603505+0000) 2019-11-29T03:07:06.182 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:07:06.179+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.827176+0000 front 2019-11-29T03:06:24.075515+0000 (oldest deadline 2019-11-29T03:07:04.029714+0000) 2019-11-29T03:07:06.856 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:07:06.851+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.396288+0000 front 2019-11-29T03:06:21.468791+0000 (oldest deadline 2019-11-29T03:07:04.816402+0000) 2019-11-29T03:07:07.044 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:07:07.040+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:18.729009+0000 front 2019-11-29T03:06:18.665591+0000 (oldest deadline 2019-11-29T03:07:04.541552+0000) 2019-11-29T03:07:07.101 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:07:07.098+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:20.508939+0000 front 2019-11-29T03:06:20.341925+0000 (oldest deadline 2019-11-29T03:07:05.603505+0000) 2019-11-29T03:07:07.187 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:07:07.182+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.215370+0000 front 2019-11-29T03:06:23.217276+0000 (oldest deadline 2019-11-29T03:07:06.687836+0000) 2019-11-29T03:07:07.194 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:07:07.191+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.827176+0000 front 2019-11-29T03:06:24.075515+0000 (oldest deadline 2019-11-29T03:07:04.029714+0000) 2019-11-29T03:07:07.859 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:07:07.853+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.492750+0000 front 2019-11-29T03:06:23.490489+0000 (oldest deadline 2019-11-29T03:07:06.883748+0000) 2019-11-29T03:07:07.896 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:07:07.890+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.396288+0000 front 2019-11-29T03:06:21.468791+0000 (oldest deadline 2019-11-29T03:07:04.816402+0000) 2019-11-29T03:07:08.010 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:07:08.006+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:18.729009+0000 front 2019-11-29T03:06:18.665591+0000 (oldest deadline 2019-11-29T03:07:04.541552+0000) 2019-11-29T03:07:08.059 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:08.052+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:22.077943+0000 front 2019-11-29T03:06:22.254576+0000 (oldest deadline 2019-11-29T03:07:07.937050+0000) 2019-11-29T03:07:08.144 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:07:08.140+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:20.508939+0000 front 2019-11-29T03:06:20.341925+0000 (oldest deadline 2019-11-29T03:07:05.603505+0000) 2019-11-29T03:07:08.202 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:07:08.197+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.215370+0000 front 2019-11-29T03:06:23.217276+0000 (oldest deadline 2019-11-29T03:07:06.687836+0000) 2019-11-29T03:07:08.245 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:07:08.241+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.827176+0000 front 2019-11-29T03:06:24.075515+0000 (oldest deadline 2019-11-29T03:07:04.029714+0000) 2019-11-29T03:07:08.871 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:07:08.865+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.492750+0000 front 2019-11-29T03:06:23.490489+0000 (oldest deadline 2019-11-29T03:07:06.883748+0000) 2019-11-29T03:07:08.911 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:07:08.904+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.396288+0000 front 2019-11-29T03:06:21.468791+0000 (oldest deadline 2019-11-29T03:07:04.816402+0000) 2019-11-29T03:07:08.965 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:07:08.962+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:18.729009+0000 front 2019-11-29T03:06:18.665591+0000 (oldest deadline 2019-11-29T03:07:04.541552+0000) 2019-11-29T03:07:09.061 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:09.055+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:22.077943+0000 front 2019-11-29T03:06:22.254576+0000 (oldest deadline 2019-11-29T03:07:07.937050+0000) 2019-11-29T03:07:09.118 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:07:09.115+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:20.508939+0000 front 2019-11-29T03:06:20.341925+0000 (oldest deadline 2019-11-29T03:07:05.603505+0000) 2019-11-29T03:07:09.175 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:07:09.170+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.215370+0000 front 2019-11-29T03:06:23.217276+0000 (oldest deadline 2019-11-29T03:07:06.687836+0000) 2019-11-29T03:07:09.201 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:07:09.198+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.827176+0000 front 2019-11-29T03:06:24.075515+0000 (oldest deadline 2019-11-29T03:07:04.029714+0000) 2019-11-29T03:07:09.849 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:07:09.844+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.492750+0000 front 2019-11-29T03:06:23.490489+0000 (oldest deadline 2019-11-29T03:07:06.883748+0000) 2019-11-29T03:07:09.933 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:07:09.927+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.396288+0000 front 2019-11-29T03:06:21.468791+0000 (oldest deadline 2019-11-29T03:07:04.816402+0000) 2019-11-29T03:07:10.017 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:07:10.013+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:18.729009+0000 front 2019-11-29T03:06:18.665591+0000 (oldest deadline 2019-11-29T03:07:04.541552+0000) 2019-11-29T03:07:10.110 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:10.105+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:22.077943+0000 front 2019-11-29T03:06:22.254576+0000 (oldest deadline 2019-11-29T03:07:07.937050+0000) 2019-11-29T03:07:10.133 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:07:10.127+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.215370+0000 front 2019-11-29T03:06:23.217276+0000 (oldest deadline 2019-11-29T03:07:06.687836+0000) 2019-11-29T03:07:10.146 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:07:10.143+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:20.508939+0000 front 2019-11-29T03:06:20.341925+0000 (oldest deadline 2019-11-29T03:07:05.603505+0000) 2019-11-29T03:07:10.250 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:07:10.246+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.827176+0000 front 2019-11-29T03:06:24.075515+0000 (oldest deadline 2019-11-29T03:07:04.029714+0000) 2019-11-29T03:07:10.866 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:07:10.860+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.492750+0000 front 2019-11-29T03:06:23.490489+0000 (oldest deadline 2019-11-29T03:07:06.883748+0000) 2019-11-29T03:07:10.971 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:07:10.965+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.396288+0000 front 2019-11-29T03:06:21.468791+0000 (oldest deadline 2019-11-29T03:07:04.816402+0000) 2019-11-29T03:07:11.047 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:07:11.043+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:18.729009+0000 front 2019-11-29T03:06:18.665591+0000 (oldest deadline 2019-11-29T03:07:04.541552+0000) 2019-11-29T03:07:11.071 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:11.065+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:22.077943+0000 front 2019-11-29T03:06:22.254576+0000 (oldest deadline 2019-11-29T03:07:07.937050+0000) 2019-11-29T03:07:11.142 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:07:11.136+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.215370+0000 front 2019-11-29T03:06:23.217276+0000 (oldest deadline 2019-11-29T03:07:06.687836+0000) 2019-11-29T03:07:11.159 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:07:11.155+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:20.508939+0000 front 2019-11-29T03:06:20.341925+0000 (oldest deadline 2019-11-29T03:07:05.603505+0000) 2019-11-29T03:07:11.271 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:07:11.267+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.827176+0000 front 2019-11-29T03:06:24.075515+0000 (oldest deadline 2019-11-29T03:07:04.029714+0000) 2019-11-29T03:07:11.838 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:07:11.832+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.492750+0000 front 2019-11-29T03:06:23.490489+0000 (oldest deadline 2019-11-29T03:07:06.883748+0000) 2019-11-29T03:07:12.010 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:07:12.005+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.396288+0000 front 2019-11-29T03:06:21.468791+0000 (oldest deadline 2019-11-29T03:07:04.816402+0000) 2019-11-29T03:07:12.021 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:07:12.018+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:18.729009+0000 front 2019-11-29T03:06:18.665591+0000 (oldest deadline 2019-11-29T03:07:04.541552+0000) 2019-11-29T03:07:12.031 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:12.026+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:22.077943+0000 front 2019-11-29T03:06:22.254576+0000 (oldest deadline 2019-11-29T03:07:07.937050+0000) 2019-11-29T03:07:12.134 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:07:12.129+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.215370+0000 front 2019-11-29T03:06:23.217276+0000 (oldest deadline 2019-11-29T03:07:06.687836+0000) 2019-11-29T03:07:12.151 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:07:12.148+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:20.508939+0000 front 2019-11-29T03:06:20.341925+0000 (oldest deadline 2019-11-29T03:07:05.603505+0000) 2019-11-29T03:07:12.257 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:07:12.253+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.827176+0000 front 2019-11-29T03:06:24.075515+0000 (oldest deadline 2019-11-29T03:07:04.029714+0000) 2019-11-29T03:07:12.799 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:07:12.793+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.492750+0000 front 2019-11-29T03:06:23.490489+0000 (oldest deadline 2019-11-29T03:07:06.883748+0000) 2019-11-29T03:07:12.974 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:07:12.969+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.396288+0000 front 2019-11-29T03:06:21.468791+0000 (oldest deadline 2019-11-29T03:07:04.816402+0000) 2019-11-29T03:07:12.985 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:07:12.981+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:18.729009+0000 front 2019-11-29T03:06:18.665591+0000 (oldest deadline 2019-11-29T03:07:04.541552+0000) 2019-11-29T03:07:13.091 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:13.082+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:22.077943+0000 front 2019-11-29T03:06:22.254576+0000 (oldest deadline 2019-11-29T03:07:07.937050+0000) 2019-11-29T03:07:13.131 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:07:13.126+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:20.508939+0000 front 2019-11-29T03:06:20.341925+0000 (oldest deadline 2019-11-29T03:07:05.603505+0000) 2019-11-29T03:07:13.134 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:07:13.128+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.215370+0000 front 2019-11-29T03:06:23.217276+0000 (oldest deadline 2019-11-29T03:07:06.687836+0000) 2019-11-29T03:07:13.289 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:07:13.285+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.827176+0000 front 2019-11-29T03:06:24.075515+0000 (oldest deadline 2019-11-29T03:07:04.029714+0000) 2019-11-29T03:07:13.813 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:07:13.807+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.492750+0000 front 2019-11-29T03:06:23.490489+0000 (oldest deadline 2019-11-29T03:07:06.883748+0000) 2019-11-29T03:07:13.950 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:07:13.946+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:18.729009+0000 front 2019-11-29T03:06:18.665591+0000 (oldest deadline 2019-11-29T03:07:04.541552+0000) 2019-11-29T03:07:14.026 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:07:14.022+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.396288+0000 front 2019-11-29T03:06:21.468791+0000 (oldest deadline 2019-11-29T03:07:04.816402+0000) 2019-11-29T03:07:14.107 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:14.102+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:22.077943+0000 front 2019-11-29T03:06:22.254576+0000 (oldest deadline 2019-11-29T03:07:07.937050+0000) 2019-11-29T03:07:14.130 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:07:14.126+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:20.508939+0000 front 2019-11-29T03:06:20.341925+0000 (oldest deadline 2019-11-29T03:07:05.603505+0000) 2019-11-29T03:07:14.189 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:07:14.184+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.215370+0000 front 2019-11-29T03:06:23.217276+0000 (oldest deadline 2019-11-29T03:07:06.687836+0000) 2019-11-29T03:07:14.274 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:07:14.267+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.827176+0000 front 2019-11-29T03:06:24.075515+0000 (oldest deadline 2019-11-29T03:07:04.029714+0000) 2019-11-29T03:07:14.801 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:07:14.796+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.492750+0000 front 2019-11-29T03:06:23.490489+0000 (oldest deadline 2019-11-29T03:07:06.883748+0000) 2019-11-29T03:07:14.905 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:07:14.901+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:18.729009+0000 front 2019-11-29T03:06:18.665591+0000 (oldest deadline 2019-11-29T03:07:04.541552+0000) 2019-11-29T03:07:15.022 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:07:15.016+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.396288+0000 front 2019-11-29T03:06:21.468791+0000 (oldest deadline 2019-11-29T03:07:04.816402+0000) 2019-11-29T03:07:15.104 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:15.098+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:22.077943+0000 front 2019-11-29T03:06:22.254576+0000 (oldest deadline 2019-11-29T03:07:07.937050+0000) 2019-11-29T03:07:15.152 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:07:15.147+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:20.508939+0000 front 2019-11-29T03:06:20.341925+0000 (oldest deadline 2019-11-29T03:07:05.603505+0000) 2019-11-29T03:07:15.180 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:07:15.175+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.215370+0000 front 2019-11-29T03:06:23.217276+0000 (oldest deadline 2019-11-29T03:07:06.687836+0000) 2019-11-29T03:07:15.249 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:07:15.244+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.827176+0000 front 2019-11-29T03:06:24.075515+0000 (oldest deadline 2019-11-29T03:07:04.029714+0000) 2019-11-29T03:07:15.841 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:07:15.835+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.492750+0000 front 2019-11-29T03:06:23.490489+0000 (oldest deadline 2019-11-29T03:07:06.883748+0000) 2019-11-29T03:07:15.881 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:07:15.872+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:18.729009+0000 front 2019-11-29T03:06:18.665591+0000 (oldest deadline 2019-11-29T03:07:04.541552+0000) 2019-11-29T03:07:16.001 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:07:15.996+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.396288+0000 front 2019-11-29T03:06:21.468791+0000 (oldest deadline 2019-11-29T03:07:04.816402+0000) 2019-11-29T03:07:16.127 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:16.120+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:22.077943+0000 front 2019-11-29T03:06:22.254576+0000 (oldest deadline 2019-11-29T03:07:07.937050+0000) 2019-11-29T03:07:16.135 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:07:16.130+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.215370+0000 front 2019-11-29T03:06:23.217276+0000 (oldest deadline 2019-11-29T03:07:06.687836+0000) 2019-11-29T03:07:16.161 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:07:16.156+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:20.508939+0000 front 2019-11-29T03:06:20.341925+0000 (oldest deadline 2019-11-29T03:07:05.603505+0000) 2019-11-29T03:07:16.277 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:07:16.272+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.827176+0000 front 2019-11-29T03:06:24.075515+0000 (oldest deadline 2019-11-29T03:07:04.029714+0000) 2019-11-29T03:07:16.845 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:07:16.841+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:18.729009+0000 front 2019-11-29T03:06:18.665591+0000 (oldest deadline 2019-11-29T03:07:04.541552+0000) 2019-11-29T03:07:16.880 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:07:16.874+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.492750+0000 front 2019-11-29T03:06:23.490489+0000 (oldest deadline 2019-11-29T03:07:06.883748+0000) 2019-11-29T03:07:17.041 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:07:17.035+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.396288+0000 front 2019-11-29T03:06:21.468791+0000 (oldest deadline 2019-11-29T03:07:04.816402+0000) 2019-11-29T03:07:17.151 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:07:17.145+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.215370+0000 front 2019-11-29T03:06:23.217276+0000 (oldest deadline 2019-11-29T03:07:06.687836+0000) 2019-11-29T03:07:17.166 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:17.161+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:22.077943+0000 front 2019-11-29T03:06:22.254576+0000 (oldest deadline 2019-11-29T03:07:07.937050+0000) 2019-11-29T03:07:17.209 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:07:17.205+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:20.508939+0000 front 2019-11-29T03:06:20.341925+0000 (oldest deadline 2019-11-29T03:07:05.603505+0000) 2019-11-29T03:07:17.300 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:07:17.296+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.827176+0000 front 2019-11-29T03:06:24.075515+0000 (oldest deadline 2019-11-29T03:07:04.029714+0000) 2019-11-29T03:07:17.836 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:07:17.830+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.492750+0000 front 2019-11-29T03:06:23.490489+0000 (oldest deadline 2019-11-29T03:07:06.883748+0000) 2019-11-29T03:07:17.894 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:07:17.890+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:18.729009+0000 front 2019-11-29T03:06:18.665591+0000 (oldest deadline 2019-11-29T03:07:04.541552+0000) 2019-11-29T03:07:18.073 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:07:18.067+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.396288+0000 front 2019-11-29T03:06:21.468791+0000 (oldest deadline 2019-11-29T03:07:04.816402+0000) 2019-11-29T03:07:18.178 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:07:18.174+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:20.508939+0000 front 2019-11-29T03:06:20.341925+0000 (oldest deadline 2019-11-29T03:07:05.603505+0000) 2019-11-29T03:07:18.187 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:18.182+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:22.077943+0000 front 2019-11-29T03:06:22.254576+0000 (oldest deadline 2019-11-29T03:07:07.937050+0000) 2019-11-29T03:07:18.193 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:07:18.188+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.215370+0000 front 2019-11-29T03:06:23.217276+0000 (oldest deadline 2019-11-29T03:07:06.687836+0000) 2019-11-29T03:07:18.298 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:07:18.295+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.827176+0000 front 2019-11-29T03:06:24.075515+0000 (oldest deadline 2019-11-29T03:07:04.029714+0000) 2019-11-29T03:07:18.865 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:07:18.853+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.492750+0000 front 2019-11-29T03:06:23.490489+0000 (oldest deadline 2019-11-29T03:07:06.883748+0000) 2019-11-29T03:07:18.866 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:07:18.863+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:18.729009+0000 front 2019-11-29T03:06:18.665591+0000 (oldest deadline 2019-11-29T03:07:04.541552+0000) 2019-11-29T03:07:19.093 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:07:19.080+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.396288+0000 front 2019-11-29T03:06:21.468791+0000 (oldest deadline 2019-11-29T03:07:04.816402+0000) 2019-11-29T03:07:19.138 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:07:19.134+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:20.508939+0000 front 2019-11-29T03:06:20.341925+0000 (oldest deadline 2019-11-29T03:07:05.603505+0000) 2019-11-29T03:07:19.188 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:07:19.183+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.215370+0000 front 2019-11-29T03:06:23.217276+0000 (oldest deadline 2019-11-29T03:07:06.687836+0000) 2019-11-29T03:07:19.230 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:19.225+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:22.077943+0000 front 2019-11-29T03:06:22.254576+0000 (oldest deadline 2019-11-29T03:07:07.937050+0000) 2019-11-29T03:07:19.265 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:07:19.263+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.827176+0000 front 2019-11-29T03:06:24.075515+0000 (oldest deadline 2019-11-29T03:07:04.029714+0000) 2019-11-29T03:07:19.826 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:07:19.820+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.492750+0000 front 2019-11-29T03:06:23.490489+0000 (oldest deadline 2019-11-29T03:07:06.883748+0000) 2019-11-29T03:07:19.880 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:07:19.875+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:18.729009+0000 front 2019-11-29T03:06:18.665591+0000 (oldest deadline 2019-11-29T03:07:04.541552+0000) 2019-11-29T03:07:20.122 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:07:20.116+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.396288+0000 front 2019-11-29T03:06:21.468791+0000 (oldest deadline 2019-11-29T03:07:04.816402+0000) 2019-11-29T03:07:20.146 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:07:20.142+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:20.508939+0000 front 2019-11-29T03:06:20.341925+0000 (oldest deadline 2019-11-29T03:07:05.603505+0000) 2019-11-29T03:07:20.158 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:07:20.152+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.215370+0000 front 2019-11-29T03:06:23.217276+0000 (oldest deadline 2019-11-29T03:07:06.687836+0000) 2019-11-29T03:07:20.273 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:20.268+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:22.077943+0000 front 2019-11-29T03:06:22.254576+0000 (oldest deadline 2019-11-29T03:07:07.937050+0000) 2019-11-29T03:07:20.309 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:07:20.307+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.827176+0000 front 2019-11-29T03:06:24.075515+0000 (oldest deadline 2019-11-29T03:07:04.029714+0000) 2019-11-29T03:07:20.796 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:07:20.787+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.492750+0000 front 2019-11-29T03:06:23.490489+0000 (oldest deadline 2019-11-29T03:07:06.883748+0000) 2019-11-29T03:07:20.926 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:07:20.922+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:18.729009+0000 front 2019-11-29T03:06:18.665591+0000 (oldest deadline 2019-11-29T03:07:04.541552+0000) 2019-11-29T03:07:21.091 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:07:21.085+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.396288+0000 front 2019-11-29T03:06:21.468791+0000 (oldest deadline 2019-11-29T03:07:04.816402+0000) 2019-11-29T03:07:21.150 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:07:21.147+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:20.508939+0000 front 2019-11-29T03:06:20.341925+0000 (oldest deadline 2019-11-29T03:07:05.603505+0000) 2019-11-29T03:07:21.166 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:07:21.161+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.215370+0000 front 2019-11-29T03:06:23.217276+0000 (oldest deadline 2019-11-29T03:07:06.687836+0000) 2019-11-29T03:07:21.284 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:07:21.280+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.827176+0000 front 2019-11-29T03:06:24.075515+0000 (oldest deadline 2019-11-29T03:07:04.029714+0000) 2019-11-29T03:07:21.328 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:21.323+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:22.077943+0000 front 2019-11-29T03:06:22.254576+0000 (oldest deadline 2019-11-29T03:07:07.937050+0000) 2019-11-29T03:07:21.762 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:07:21.756+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.492750+0000 front 2019-11-29T03:06:23.490489+0000 (oldest deadline 2019-11-29T03:07:06.883748+0000) 2019-11-29T03:07:21.906 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:07:21.903+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:18.729009+0000 front 2019-11-29T03:06:18.665591+0000 (oldest deadline 2019-11-29T03:07:04.541552+0000) 2019-11-29T03:07:22.113 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:07:22.108+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:20.508939+0000 front 2019-11-29T03:06:20.341925+0000 (oldest deadline 2019-11-29T03:07:05.603505+0000) 2019-11-29T03:07:22.121 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:07:22.114+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.396288+0000 front 2019-11-29T03:06:21.468791+0000 (oldest deadline 2019-11-29T03:07:04.816402+0000) 2019-11-29T03:07:22.155 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:07:22.149+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.215370+0000 front 2019-11-29T03:06:23.217276+0000 (oldest deadline 2019-11-29T03:07:06.687836+0000) 2019-11-29T03:07:22.281 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:07:22.279+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.827176+0000 front 2019-11-29T03:06:24.075515+0000 (oldest deadline 2019-11-29T03:07:04.029714+0000) 2019-11-29T03:07:22.330 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:22.324+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:22.077943+0000 front 2019-11-29T03:06:22.254576+0000 (oldest deadline 2019-11-29T03:07:07.937050+0000) 2019-11-29T03:07:22.754 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:07:22.748+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.492750+0000 front 2019-11-29T03:06:23.490489+0000 (oldest deadline 2019-11-29T03:07:06.883748+0000) 2019-11-29T03:07:22.954 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:07:22.951+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:18.729009+0000 front 2019-11-29T03:06:18.665591+0000 (oldest deadline 2019-11-29T03:07:04.541552+0000) 2019-11-29T03:07:23.072 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:07:23.070+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:20.508939+0000 front 2019-11-29T03:06:20.341925+0000 (oldest deadline 2019-11-29T03:07:05.603505+0000) 2019-11-29T03:07:23.098 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:07:23.092+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.396288+0000 front 2019-11-29T03:06:21.468791+0000 (oldest deadline 2019-11-29T03:07:04.816402+0000) 2019-11-29T03:07:23.199 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:07:23.194+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.215370+0000 front 2019-11-29T03:06:23.217276+0000 (oldest deadline 2019-11-29T03:07:06.687836+0000) 2019-11-29T03:07:23.330 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:23.324+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:22.077943+0000 front 2019-11-29T03:06:22.254576+0000 (oldest deadline 2019-11-29T03:07:07.937050+0000) 2019-11-29T03:07:23.331 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:07:23.328+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.827176+0000 front 2019-11-29T03:06:24.075515+0000 (oldest deadline 2019-11-29T03:07:04.029714+0000) 2019-11-29T03:07:23.755 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:07:23.749+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.492750+0000 front 2019-11-29T03:06:23.490489+0000 (oldest deadline 2019-11-29T03:07:06.883748+0000) 2019-11-29T03:07:23.948 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:07:23.945+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:18.729009+0000 front 2019-11-29T03:06:18.665591+0000 (oldest deadline 2019-11-29T03:07:04.541552+0000) 2019-11-29T03:07:24.103 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:07:24.100+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:20.508939+0000 front 2019-11-29T03:06:20.341925+0000 (oldest deadline 2019-11-29T03:07:05.603505+0000) 2019-11-29T03:07:24.131 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:07:24.125+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.396288+0000 front 2019-11-29T03:06:21.468791+0000 (oldest deadline 2019-11-29T03:07:04.816402+0000) 2019-11-29T03:07:24.189 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:07:24.181+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.215370+0000 front 2019-11-29T03:06:23.217276+0000 (oldest deadline 2019-11-29T03:07:06.687836+0000) 2019-11-29T03:07:24.300 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:07:24.297+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.827176+0000 front 2019-11-29T03:06:24.075515+0000 (oldest deadline 2019-11-29T03:07:04.029714+0000) 2019-11-29T03:07:24.381 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:24.375+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:22.077943+0000 front 2019-11-29T03:06:22.254576+0000 (oldest deadline 2019-11-29T03:07:07.937050+0000) 2019-11-29T03:07:24.759 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:07:24.754+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.492750+0000 front 2019-11-29T03:06:23.490489+0000 (oldest deadline 2019-11-29T03:07:06.883748+0000) 2019-11-29T03:07:24.926 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:07:24.923+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:18.729009+0000 front 2019-11-29T03:06:18.665591+0000 (oldest deadline 2019-11-29T03:07:04.541552+0000) 2019-11-29T03:07:25.075 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:07:25.073+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:20.508939+0000 front 2019-11-29T03:06:20.341925+0000 (oldest deadline 2019-11-29T03:07:05.603505+0000) 2019-11-29T03:07:25.139 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:07:25.134+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.396288+0000 front 2019-11-29T03:06:21.468791+0000 (oldest deadline 2019-11-29T03:07:04.816402+0000) 2019-11-29T03:07:25.157 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:07:25.151+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.215370+0000 front 2019-11-29T03:06:23.217276+0000 (oldest deadline 2019-11-29T03:07:06.687836+0000) 2019-11-29T03:07:25.310 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:07:25.307+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.827176+0000 front 2019-11-29T03:06:24.075515+0000 (oldest deadline 2019-11-29T03:07:04.029714+0000) 2019-11-29T03:07:25.366 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:25.360+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:22.077943+0000 front 2019-11-29T03:06:22.254576+0000 (oldest deadline 2019-11-29T03:07:07.937050+0000) 2019-11-29T03:07:25.367 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:25.362+0000 1694c700 -1 osd.7 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:104910 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e196) 2019-11-29T03:07:25.800 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:07:25.794+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.492750+0000 front 2019-11-29T03:06:23.490489+0000 (oldest deadline 2019-11-29T03:07:06.883748+0000) 2019-11-29T03:07:25.908 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:07:25.902+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:18.729009+0000 front 2019-11-29T03:06:18.665591+0000 (oldest deadline 2019-11-29T03:07:04.541552+0000) 2019-11-29T03:07:26.041 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:07:26.037+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:20.508939+0000 front 2019-11-29T03:06:20.341925+0000 (oldest deadline 2019-11-29T03:07:05.603505+0000) 2019-11-29T03:07:26.115 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:07:26.108+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.215370+0000 front 2019-11-29T03:06:23.217276+0000 (oldest deadline 2019-11-29T03:07:06.687836+0000) 2019-11-29T03:07:26.163 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:07:26.158+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.396288+0000 front 2019-11-29T03:06:21.468791+0000 (oldest deadline 2019-11-29T03:07:04.816402+0000) 2019-11-29T03:07:26.358 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:07:26.355+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.827176+0000 front 2019-11-29T03:06:24.075515+0000 (oldest deadline 2019-11-29T03:07:04.029714+0000) 2019-11-29T03:07:26.374 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:26.366+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:22.077943+0000 front 2019-11-29T03:06:22.254576+0000 (oldest deadline 2019-11-29T03:07:07.937050+0000) 2019-11-29T03:07:26.377 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:26.371+0000 1694c700 -1 osd.7 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:104910 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e196) 2019-11-29T03:07:26.796 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:07:26.792+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.492750+0000 front 2019-11-29T03:06:23.490489+0000 (oldest deadline 2019-11-29T03:07:06.883748+0000) 2019-11-29T03:07:26.915 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:07:26.913+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:18.729009+0000 front 2019-11-29T03:06:18.665591+0000 (oldest deadline 2019-11-29T03:07:04.541552+0000) 2019-11-29T03:07:27.032 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:07:27.028+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:20.508939+0000 front 2019-11-29T03:06:20.341925+0000 (oldest deadline 2019-11-29T03:07:05.603505+0000) 2019-11-29T03:07:27.125 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:07:27.119+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.396288+0000 front 2019-11-29T03:06:21.468791+0000 (oldest deadline 2019-11-29T03:07:04.816402+0000) 2019-11-29T03:07:27.125 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:07:27.119+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.215370+0000 front 2019-11-29T03:06:23.217276+0000 (oldest deadline 2019-11-29T03:07:06.687836+0000) 2019-11-29T03:07:27.379 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:27.373+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:22.077943+0000 front 2019-11-29T03:06:22.254576+0000 (oldest deadline 2019-11-29T03:07:07.937050+0000) 2019-11-29T03:07:27.380 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:27.375+0000 1694c700 -1 osd.7 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:104910 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e196) 2019-11-29T03:07:27.383 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:07:27.379+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.827176+0000 front 2019-11-29T03:06:24.075515+0000 (oldest deadline 2019-11-29T03:07:04.029714+0000) 2019-11-29T03:07:27.816 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:07:27.810+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.492750+0000 front 2019-11-29T03:06:23.490489+0000 (oldest deadline 2019-11-29T03:07:06.883748+0000) 2019-11-29T03:07:27.911 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:07:27.907+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:18.729009+0000 front 2019-11-29T03:06:18.665591+0000 (oldest deadline 2019-11-29T03:07:04.541552+0000) 2019-11-29T03:07:28.070 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:07:28.067+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:20.508939+0000 front 2019-11-29T03:06:20.341925+0000 (oldest deadline 2019-11-29T03:07:05.603505+0000) 2019-11-29T03:07:28.092 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:07:28.086+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.215370+0000 front 2019-11-29T03:06:23.217276+0000 (oldest deadline 2019-11-29T03:07:06.687836+0000) 2019-11-29T03:07:28.158 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:07:28.152+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.396288+0000 front 2019-11-29T03:06:21.468791+0000 (oldest deadline 2019-11-29T03:07:04.816402+0000) 2019-11-29T03:07:28.367 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:28.361+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:22.077943+0000 front 2019-11-29T03:06:22.254576+0000 (oldest deadline 2019-11-29T03:07:07.937050+0000) 2019-11-29T03:07:28.367 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:28.363+0000 1694c700 -1 osd.7 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:104910 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e196) 2019-11-29T03:07:28.413 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:07:28.411+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.827176+0000 front 2019-11-29T03:06:24.075515+0000 (oldest deadline 2019-11-29T03:07:04.029714+0000) 2019-11-29T03:07:28.847 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:07:28.842+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.492750+0000 front 2019-11-29T03:06:23.490489+0000 (oldest deadline 2019-11-29T03:07:06.883748+0000) 2019-11-29T03:07:28.961 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:07:28.958+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:18.729009+0000 front 2019-11-29T03:06:18.665591+0000 (oldest deadline 2019-11-29T03:07:04.541552+0000) 2019-11-29T03:07:29.121 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:07:29.118+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:20.508939+0000 front 2019-11-29T03:06:20.341925+0000 (oldest deadline 2019-11-29T03:07:05.603505+0000) 2019-11-29T03:07:29.144 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:07:29.139+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.215370+0000 front 2019-11-29T03:06:23.217276+0000 (oldest deadline 2019-11-29T03:07:06.687836+0000) 2019-11-29T03:07:29.152 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:07:29.147+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.396288+0000 front 2019-11-29T03:06:21.468791+0000 (oldest deadline 2019-11-29T03:07:04.816402+0000) 2019-11-29T03:07:29.386 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:07:29.383+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.827176+0000 front 2019-11-29T03:06:24.075515+0000 (oldest deadline 2019-11-29T03:07:04.029714+0000) 2019-11-29T03:07:29.396 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:29.390+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:22.077943+0000 front 2019-11-29T03:06:22.254576+0000 (oldest deadline 2019-11-29T03:07:07.937050+0000) 2019-11-29T03:07:29.397 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:29.392+0000 1694c700 -1 osd.7 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:104910 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e196) 2019-11-29T03:07:29.806 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:07:29.801+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.492750+0000 front 2019-11-29T03:06:23.490489+0000 (oldest deadline 2019-11-29T03:07:06.883748+0000) 2019-11-29T03:07:29.917 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:07:29.913+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:18.729009+0000 front 2019-11-29T03:06:18.665591+0000 (oldest deadline 2019-11-29T03:07:04.541552+0000) 2019-11-29T03:07:30.124 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:07:30.118+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.215370+0000 front 2019-11-29T03:06:23.217276+0000 (oldest deadline 2019-11-29T03:07:06.687836+0000) 2019-11-29T03:07:30.127 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:07:30.124+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:20.508939+0000 front 2019-11-29T03:06:20.341925+0000 (oldest deadline 2019-11-29T03:07:05.603505+0000) 2019-11-29T03:07:30.193 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:07:30.187+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.396288+0000 front 2019-11-29T03:06:21.468791+0000 (oldest deadline 2019-11-29T03:07:04.816402+0000) 2019-11-29T03:07:30.381 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:07:30.379+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.827176+0000 front 2019-11-29T03:06:24.075515+0000 (oldest deadline 2019-11-29T03:07:04.029714+0000) 2019-11-29T03:07:30.383 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:30.377+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:22.077943+0000 front 2019-11-29T03:06:22.254576+0000 (oldest deadline 2019-11-29T03:07:07.937050+0000) 2019-11-29T03:07:30.384 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:30.379+0000 1694c700 -1 osd.7 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:104910 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e196) 2019-11-29T03:07:30.815 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:07:30.807+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.492750+0000 front 2019-11-29T03:06:23.490489+0000 (oldest deadline 2019-11-29T03:07:06.883748+0000) 2019-11-29T03:07:30.880 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:07:30.877+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:18.729009+0000 front 2019-11-29T03:06:18.665591+0000 (oldest deadline 2019-11-29T03:07:04.541552+0000) 2019-11-29T03:07:31.140 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:07:31.138+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:20.508939+0000 front 2019-11-29T03:06:20.341925+0000 (oldest deadline 2019-11-29T03:07:05.603505+0000) 2019-11-29T03:07:31.142 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:07:31.137+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.215370+0000 front 2019-11-29T03:06:23.217276+0000 (oldest deadline 2019-11-29T03:07:06.687836+0000) 2019-11-29T03:07:31.237 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:07:31.232+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.396288+0000 front 2019-11-29T03:06:21.468791+0000 (oldest deadline 2019-11-29T03:07:04.816402+0000) 2019-11-29T03:07:31.353 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:31.348+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:22.077943+0000 front 2019-11-29T03:06:22.254576+0000 (oldest deadline 2019-11-29T03:07:07.937050+0000) 2019-11-29T03:07:31.356 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:31.352+0000 1694c700 -1 osd.7 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:104910 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e196) 2019-11-29T03:07:31.428 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:07:31.425+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.827176+0000 front 2019-11-29T03:06:24.075515+0000 (oldest deadline 2019-11-29T03:07:04.029714+0000) 2019-11-29T03:07:31.835 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:07:31.829+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.492750+0000 front 2019-11-29T03:06:23.490489+0000 (oldest deadline 2019-11-29T03:07:06.883748+0000) 2019-11-29T03:07:31.878 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:07:31.874+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:18.729009+0000 front 2019-11-29T03:06:18.665591+0000 (oldest deadline 2019-11-29T03:07:04.541552+0000) 2019-11-29T03:07:32.122 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:07:32.116+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.215370+0000 front 2019-11-29T03:06:23.217276+0000 (oldest deadline 2019-11-29T03:07:06.687836+0000) 2019-11-29T03:07:32.125 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:07:32.122+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:20.508939+0000 front 2019-11-29T03:06:20.341925+0000 (oldest deadline 2019-11-29T03:07:05.603505+0000) 2019-11-29T03:07:32.242 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:07:32.236+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.396288+0000 front 2019-11-29T03:06:21.468791+0000 (oldest deadline 2019-11-29T03:07:04.816402+0000) 2019-11-29T03:07:32.361 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:32.355+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:22.077943+0000 front 2019-11-29T03:06:22.254576+0000 (oldest deadline 2019-11-29T03:07:07.937050+0000) 2019-11-29T03:07:32.362 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:32.357+0000 1694c700 -1 osd.7 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:104910 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e196) 2019-11-29T03:07:32.443 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:07:32.439+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.827176+0000 front 2019-11-29T03:06:24.075515+0000 (oldest deadline 2019-11-29T03:07:04.029714+0000) 2019-11-29T03:07:32.858 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:07:32.853+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:18.729009+0000 front 2019-11-29T03:06:18.665591+0000 (oldest deadline 2019-11-29T03:07:04.541552+0000) 2019-11-29T03:07:32.888 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:07:32.883+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.492750+0000 front 2019-11-29T03:06:23.490489+0000 (oldest deadline 2019-11-29T03:07:06.883748+0000) 2019-11-29T03:07:33.127 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:07:33.121+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.215370+0000 front 2019-11-29T03:06:23.217276+0000 (oldest deadline 2019-11-29T03:07:06.687836+0000) 2019-11-29T03:07:33.129 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:07:33.125+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:20.508939+0000 front 2019-11-29T03:06:20.341925+0000 (oldest deadline 2019-11-29T03:07:05.603505+0000) 2019-11-29T03:07:33.257 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:07:33.251+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.396288+0000 front 2019-11-29T03:06:21.468791+0000 (oldest deadline 2019-11-29T03:07:04.816402+0000) 2019-11-29T03:07:33.376 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:33.370+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:22.077943+0000 front 2019-11-29T03:06:22.254576+0000 (oldest deadline 2019-11-29T03:07:07.937050+0000) 2019-11-29T03:07:33.377 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:33.372+0000 1694c700 -1 osd.7 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:104910 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e196) 2019-11-29T03:07:33.473 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:07:33.469+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.827176+0000 front 2019-11-29T03:06:24.075515+0000 (oldest deadline 2019-11-29T03:07:04.029714+0000) 2019-11-29T03:07:33.855 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:07:33.852+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:18.729009+0000 front 2019-11-29T03:06:18.665591+0000 (oldest deadline 2019-11-29T03:07:04.541552+0000) 2019-11-29T03:07:33.892 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:07:33.887+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.492750+0000 front 2019-11-29T03:06:23.490489+0000 (oldest deadline 2019-11-29T03:07:06.883748+0000) 2019-11-29T03:07:34.128 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:07:34.123+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:20.508939+0000 front 2019-11-29T03:06:20.341925+0000 (oldest deadline 2019-11-29T03:07:05.603505+0000) 2019-11-29T03:07:34.165 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:07:34.159+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.215370+0000 front 2019-11-29T03:06:23.217276+0000 (oldest deadline 2019-11-29T03:07:06.687836+0000) 2019-11-29T03:07:34.240 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:07:34.235+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.396288+0000 front 2019-11-29T03:06:21.468791+0000 (oldest deadline 2019-11-29T03:07:04.816402+0000) 2019-11-29T03:07:34.382 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:34.376+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:22.077943+0000 front 2019-11-29T03:06:22.254576+0000 (oldest deadline 2019-11-29T03:07:07.937050+0000) 2019-11-29T03:07:34.383 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:34.378+0000 1694c700 -1 osd.7 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:104910 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e196) 2019-11-29T03:07:34.433 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:07:34.429+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.827176+0000 front 2019-11-29T03:06:24.075515+0000 (oldest deadline 2019-11-29T03:07:04.029714+0000) 2019-11-29T03:07:34.822 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:07:34.817+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:18.729009+0000 front 2019-11-29T03:06:18.665591+0000 (oldest deadline 2019-11-29T03:07:04.541552+0000) 2019-11-29T03:07:34.885 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:07:34.879+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.492750+0000 front 2019-11-29T03:06:23.490489+0000 (oldest deadline 2019-11-29T03:07:06.883748+0000) 2019-11-29T03:07:35.112 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:07:35.109+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:20.508939+0000 front 2019-11-29T03:06:20.341925+0000 (oldest deadline 2019-11-29T03:07:05.603505+0000) 2019-11-29T03:07:35.181 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:07:35.176+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.215370+0000 front 2019-11-29T03:06:23.217276+0000 (oldest deadline 2019-11-29T03:07:06.687836+0000) 2019-11-29T03:07:35.242 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:07:35.237+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.396288+0000 front 2019-11-29T03:06:21.468791+0000 (oldest deadline 2019-11-29T03:07:04.816402+0000) 2019-11-29T03:07:35.387 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:35.382+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:22.077943+0000 front 2019-11-29T03:06:22.254576+0000 (oldest deadline 2019-11-29T03:07:07.937050+0000) 2019-11-29T03:07:35.390 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:35.386+0000 1694c700 -1 osd.7 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:104910 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e196) 2019-11-29T03:07:35.489 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:07:35.484+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.827176+0000 front 2019-11-29T03:06:24.075515+0000 (oldest deadline 2019-11-29T03:07:04.029714+0000) 2019-11-29T03:07:35.791 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:07:35.787+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:18.729009+0000 front 2019-11-29T03:06:18.665591+0000 (oldest deadline 2019-11-29T03:07:04.541552+0000) 2019-11-29T03:07:35.886 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:07:35.880+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.492750+0000 front 2019-11-29T03:06:23.490489+0000 (oldest deadline 2019-11-29T03:07:06.883748+0000) 2019-11-29T03:07:36.090 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:07:36.086+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:20.508939+0000 front 2019-11-29T03:06:20.341925+0000 (oldest deadline 2019-11-29T03:07:05.603505+0000) 2019-11-29T03:07:36.219 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:07:36.212+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.215370+0000 front 2019-11-29T03:06:23.217276+0000 (oldest deadline 2019-11-29T03:07:06.687836+0000) 2019-11-29T03:07:36.221 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:07:36.216+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.396288+0000 front 2019-11-29T03:06:21.468791+0000 (oldest deadline 2019-11-29T03:07:04.816402+0000) 2019-11-29T03:07:36.436 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:36.430+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:22.077943+0000 front 2019-11-29T03:06:22.254576+0000 (oldest deadline 2019-11-29T03:07:07.937050+0000) 2019-11-29T03:07:36.439 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:36.435+0000 1694c700 -1 osd.7 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:104910 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e196) 2019-11-29T03:07:36.521 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:07:36.513+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.827176+0000 front 2019-11-29T03:06:24.075515+0000 (oldest deadline 2019-11-29T03:07:04.029714+0000) 2019-11-29T03:07:36.756 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:07:36.752+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:18.729009+0000 front 2019-11-29T03:06:18.665591+0000 (oldest deadline 2019-11-29T03:07:04.541552+0000) 2019-11-29T03:07:36.851 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:07:36.847+0000 1694c700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.492750+0000 front 2019-11-29T03:06:23.490489+0000 (oldest deadline 2019-11-29T03:07:06.883748+0000) 2019-11-29T03:07:37.145 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:07:37.136+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:20.508939+0000 front 2019-11-29T03:06:20.341925+0000 (oldest deadline 2019-11-29T03:07:05.603505+0000) 2019-11-29T03:07:37.206 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:07:37.202+0000 1694c700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:23.215370+0000 front 2019-11-29T03:06:23.217276+0000 (oldest deadline 2019-11-29T03:07:06.687836+0000) 2019-11-29T03:07:37.225 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:07:37.220+0000 1694c700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.396288+0000 front 2019-11-29T03:06:21.468791+0000 (oldest deadline 2019-11-29T03:07:04.816402+0000) 2019-11-29T03:07:37.489 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:07:37.485+0000 1694c700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:21.827176+0000 front 2019-11-29T03:06:24.075515+0000 (oldest deadline 2019-11-29T03:07:04.029714+0000) 2019-11-29T03:07:37.489 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:37.483+0000 1694c700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:22.077943+0000 front 2019-11-29T03:06:22.254576+0000 (oldest deadline 2019-11-29T03:07:07.937050+0000) 2019-11-29T03:07:37.493 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:37.489+0000 1694c700 -1 osd.7 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:104910 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e196) 2019-11-29T03:07:37.672 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:07:37.667+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.74:6802/10096,v1:172.21.15.74:6803/10096] for 46sec e196 v196) 2019-11-29T03:07:37.710 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:07:37.706+0000 1694c700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:18.729009+0000 front 2019-11-29T03:06:18.665591+0000 (oldest deadline 2019-11-29T03:07:04.541552+0000) 2019-11-29T03:07:38.144 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:07:38.140+0000 1694c700 -1 osd.1 196 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:06:20.508939+0000 front 2019-11-29T03:06:20.341925+0000 (oldest deadline 2019-11-29T03:07:05.603505+0000) 2019-11-29T03:07:38.560 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:38.477+0000 1694c700 -1 osd.7 197 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:104910 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e196) 2019-11-29T03:07:39.554 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:39.523+0000 1694c700 -1 osd.7 198 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:104910 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e196) 2019-11-29T03:07:40.514 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:40.510+0000 1694c700 -1 osd.7 198 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:104910 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e196) 2019-11-29T03:07:41.511 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:41.506+0000 1694c700 -1 osd.7 198 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:104910 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e196) 2019-11-29T03:07:42.504 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:42.498+0000 1694c700 -1 osd.7 198 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:104910 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e196) 2019-11-29T03:07:43.473 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:43.467+0000 1694c700 -1 osd.7 198 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:104910 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e196) 2019-11-29T03:07:44.503 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:44.499+0000 1694c700 -1 osd.7 198 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:104910 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e196) 2019-11-29T03:07:45.524 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:45.517+0000 1694c700 -1 osd.7 198 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:104910 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e196) 2019-11-29T03:07:46.568 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:46.564+0000 1694c700 -1 osd.7 198 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:104910 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e196) 2019-11-29T03:07:47.540 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:47.535+0000 1694c700 -1 osd.7 198 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:104910 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e196) 2019-11-29T03:07:48.591 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:48.587+0000 1694c700 -1 osd.7 198 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:104910 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e196) 2019-11-29T03:07:49.571 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:49.566+0000 1694c700 -1 osd.7 198 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:104910 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e196) 2019-11-29T03:07:50.533 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:50.528+0000 1694c700 -1 osd.7 198 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:104910 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e196) 2019-11-29T03:07:51.558 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:51.553+0000 1694c700 -1 osd.7 198 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:104910 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e196) 2019-11-29T03:07:52.591 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:52.587+0000 1694c700 -1 osd.7 198 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:104910 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e196) 2019-11-29T03:07:53.636 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:53.631+0000 1694c700 -1 osd.7 198 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:104910 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e196) 2019-11-29T03:07:54.602 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:07:54.593+0000 1694c700 -1 osd.7 198 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:104910 2.15s0 2:aae615a5:::bd5ae442-b074-4d35-94cc-b1d71bd6ac02.4322.650_eed4580502fd4ea09689826cdada55b4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e196) 2019-11-29T03:08:00.495 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:21:42.712 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:08:00.499 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:21:42.717 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:08:00.517 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:21:42.736 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:08:00.522 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:21:42.741 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:08:00.525 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:21:42.753 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:08:00.535 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:21:42.764 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:08:00.696 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:21:42.913 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:08:00.709 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:21:42.928 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:08:00.765 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:21:42.993 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:08:14.961 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:08:14.862+0000 31783700 -1 osd.3 202 build_incremental_map_msg missing incremental map 202 2019-11-29T03:08:15.072 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:08:14.899+0000 31783700 -1 osd.3 202 build_incremental_map_msg missing incremental map 202 2019-11-29T03:08:15.127 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:08:15.062+0000 31783700 -1 osd.3 202 build_incremental_map_msg missing incremental map 202 2019-11-29T03:08:30.445 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:08:30.440+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:08:31.447 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:08:31.444+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:08:31.981 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:08:31.976+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:08:32.450 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:08:32.446+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:08:32.934 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:08:32.930+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:08:33.023 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:08:33.018+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:08:33.427 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:08:33.423+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:08:33.904 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:08:33.899+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:08:33.981 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:08:33.976+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:08:34.435 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:08:34.430+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:08:34.854 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:08:34.850+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:08:34.914 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:08:34.908+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:08:34.998 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:08:34.994+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:08:35.183 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:08:35.179+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:08:35.389 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:08:35.384+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:08:35.480 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:08:35.476+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:08:35.893 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:08:35.890+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:08:35.902 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:08:35.897+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:08:35.982 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:08:35.978+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:08:36.221 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:08:36.217+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:08:36.366 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:08:36.362+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:08:36.506 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:08:36.502+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:08:36.880 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:08:36.875+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:08:36.954 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:08:36.949+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:08:37.007 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:08:37.001+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:08:37.186 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:08:37.181+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:08:37.352 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:08:37.346+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:08:37.532 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:08:37.526+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:08:37.925 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:08:37.920+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:08:37.932 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:08:37.929+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:08:38.046 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:08:38.042+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:08:38.154 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:08:38.150+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:08:38.304 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:08:38.300+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:08:38.495 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:08:38.489+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:08:38.956 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:08:38.950+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:08:38.972 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:08:38.969+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:08:39.019 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:08:39.015+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:08:39.116 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:08:39.111+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:08:39.305 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:08:39.301+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:08:39.457 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:08:39.451+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:08:39.932 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:08:39.928+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:08:39.975 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:08:39.971+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:08:40.070 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:08:40.064+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:08:40.152 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:08:40.148+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:08:40.303 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:08:40.298+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:08:40.504 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:08:40.498+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:08:40.989 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:08:40.981+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:08:41.012 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:08:41.007+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:08:41.107 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:08:41.101+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:08:41.155 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:08:41.151+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:08:41.356 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:08:41.352+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:08:41.535 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:08:41.526+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:08:41.946 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:08:41.940+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:08:41.972 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:08:41.968+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:08:42.069 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:08:42.063+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:08:42.145 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:08:42.141+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:08:42.309 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:08:42.305+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:08:42.580 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:08:42.575+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:08:42.942 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:08:42.938+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:08:42.949 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:08:42.944+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:08:43.083 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:08:43.078+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:08:43.129 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:08:43.126+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:08:43.346 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:08:43.341+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:08:43.634 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:08:43.629+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:08:43.849 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:08:43.832+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:08:43.928 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:08:43.924+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:08:44.000 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:08:43.988+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:08:44.098 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:08:44.093+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:08:44.099 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:08:44.096+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:08:44.323 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:08:44.319+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:08:44.606 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:08:44.601+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:08:44.865 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:08:44.861+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:08:44.948 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:08:44.943+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:08:45.006 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:08:45.001+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:08:45.062 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:08:45.058+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:08:45.149 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:08:45.144+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:08:45.367 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:08:45.362+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:08:45.566 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:08:45.561+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:08:45.900 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:08:45.896+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:08:45.942 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:08:45.936+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:08:45.979 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:08:45.973+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:08:46.015 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:08:46.011+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:08:46.180 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:08:46.176+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:08:46.357 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:08:46.353+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:08:46.564 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:08:46.560+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:08:46.897 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:08:46.893+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:08:46.933 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:08:46.928+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:08:46.956 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:08:46.953+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:08:46.971 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:08:46.967+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:08:47.204 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:08:47.198+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:08:47.324 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:08:47.320+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:08:47.555 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:08:47.550+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:08:47.858 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:08:47.854+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:08:47.930 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:08:47.924+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:08:47.995 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:08:47.992+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:08:48.005 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:08:48.002+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:08:48.220 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:08:48.214+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:08:48.323 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:08:48.318+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:08:48.538 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:08:48.533+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:08:48.858 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:08:48.856+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:08:48.958 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:08:48.940+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:08:49.004 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:08:49.002+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:08:49.049 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:08:49.046+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:08:49.274 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:08:49.269+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:08:49.314 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:08:49.310+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:08:49.497 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:08:49.492+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:08:49.845 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:08:49.839+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:08:09.564477+0000 (oldest deadline 2019-11-29T03:08:49.564477+0000) 2019-11-29T03:08:49.846 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:08:49.841+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:08:49.995 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:08:49.990+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:08:50.013 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:08:50.010+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:08:50.055 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:08:50.052+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:08:50.246 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:08:50.242+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:08:50.330 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:08:50.328+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:08:50.503 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:08:50.498+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:08:50.894 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:08:50.891+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:08:09.564477+0000 (oldest deadline 2019-11-29T03:08:49.564477+0000) 2019-11-29T03:08:50.895 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:08:50.893+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:08:51.005 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:08:51.001+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:08:51.032 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:08:51.029+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:08:51.051 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:08:51.048+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:08:51.218 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:08:51.213+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:08:51.291 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:08:51.288+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:08:51.547 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:08:51.541+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:08:51.930 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:08:51.926+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:08:09.564477+0000 (oldest deadline 2019-11-29T03:08:49.564477+0000) 2019-11-29T03:08:51.931 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:08:51.928+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:08:52.030 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:08:52.021+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:08:52.048 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:08:52.045+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:08:52.064 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:08:52.060+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:08:52.258 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:08:52.253+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:08:52.270 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:08:52.266+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:08:52.596 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:08:52.592+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:08:52.924 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:08:52.920+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:08:09.564477+0000 (oldest deadline 2019-11-29T03:08:49.564477+0000) 2019-11-29T03:08:52.924 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:08:52.921+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:08:53.025 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:08:53.015+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:08:53.043 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:08:53.039+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:08:53.077 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:08:53.073+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:08:53.256 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:08:53.242+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:08:53.293 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:08:53.291+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:08:53.616 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:08:53.610+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:08:53.933 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:08:53.931+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:08:09.564477+0000 (oldest deadline 2019-11-29T03:08:49.564477+0000) 2019-11-29T03:08:53.935 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:08:53.933+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:08:54.029 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:08:54.027+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:08:54.045 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:08:54.040+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:08:54.074 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:08:54.071+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:08:54.241 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:08:54.235+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:08:54.270 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:08:54.268+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:08:54.630 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:08:54.624+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:08:54.913 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:08:54.910+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:08:09.564477+0000 (oldest deadline 2019-11-29T03:08:49.564477+0000) 2019-11-29T03:08:54.916 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:08:54.914+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:08:55.022 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:08:55.017+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:08:55.041 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:08:55.039+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:08:55.075 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:08:55.070+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:08:55.254 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:08:55.251+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:08:55.279 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:08:55.274+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:08:55.639 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:08:55.634+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:08:55.912 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:08:55.906+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:08:09.564477+0000 (oldest deadline 2019-11-29T03:08:49.564477+0000) 2019-11-29T03:08:55.913 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:08:55.909+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:08:56.024 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:08:56.019+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:08:56.085 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:08:56.081+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:08:56.089 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:08:56.085+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:08:56.290 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:08:56.287+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:08:56.310 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:08:56.303+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:08:56.675 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:08:56.669+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:08:56.940 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:08:56.936+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:08:09.564477+0000 (oldest deadline 2019-11-29T03:08:49.564477+0000) 2019-11-29T03:08:56.940 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:08:56.937+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:08:57.035 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:08:57.030+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:08:57.093 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:08:57.089+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:08:57.129 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:08:57.126+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:08:57.291 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:08:57.288+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:08:57.344 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:08:57.340+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:08:57.699 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:08:57.694+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:08:57.960 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:08:57.957+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:08:09.564477+0000 (oldest deadline 2019-11-29T03:08:49.564477+0000) 2019-11-29T03:08:57.960 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:08:57.958+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:08:58.056 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:08:58.052+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:08:58.099 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:08:58.096+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:08:58.103 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:08:58.100+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:08:58.308 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:08:58.305+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:08:58.345 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:08:58.340+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:08:58.748 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:08:58.743+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:08:58.985 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:08:58.979+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:08:09.564477+0000 (oldest deadline 2019-11-29T03:08:49.564477+0000) 2019-11-29T03:08:58.985 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:08:58.981+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:08:59.089 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:08:59.083+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:08:59.105 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:08:59.101+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:08:59.114 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:08:59.110+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:08:59.319 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:08:59.316+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:08:59.397 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:08:59.392+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:08:59.785 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:08:59.779+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:09:00.022 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:00.018+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:08:09.564477+0000 (oldest deadline 2019-11-29T03:08:49.564477+0000) 2019-11-29T03:09:00.023 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:00.020+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:09:00.113 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:09:00.107+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:09:00.117 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:09:00.113+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:09:00.140 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:09:00.136+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:09:00.331 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:09:00.327+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:09:00.436 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:09:00.431+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:09:00.760 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:09:00.755+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:09:00.988 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:00.985+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:08:09.564477+0000 (oldest deadline 2019-11-29T03:08:49.564477+0000) 2019-11-29T03:09:00.991 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:00.989+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:09:01.103 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:09:01.097+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:09:01.134 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:09:01.131+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:09:01.160 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:09:01.157+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:09:01.320 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:09:01.317+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:09:01.400 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:09:01.395+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:09:01.737 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:09:01.732+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:09:01.996 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:01.991+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:08:09.564477+0000 (oldest deadline 2019-11-29T03:08:49.564477+0000) 2019-11-29T03:09:01.997 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:01.993+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:09:02.111 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:09:02.105+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:09:02.117 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:09:02.114+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:09:02.179 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:09:02.176+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:09:02.355 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:09:02.351+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:09:02.423 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:09:02.418+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:09:02.706 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:09:02.700+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:09:02.902 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:09:02.896+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 44sec e202 v202) 2019-11-29T03:09:02.991 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:02.987+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:08:09.564477+0000 (oldest deadline 2019-11-29T03:08:49.564477+0000) 2019-11-29T03:09:02.992 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:02.990+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:09:03.120 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:09:03.115+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:09:03.124 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:09:03.120+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:09:03.188 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:09:03.184+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:09:03.359 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:09:03.356+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:09:03.437 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:09:03.427+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:09:03.738 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:09:03.733+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:09:04.038 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:04.034+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:08:09.564477+0000 (oldest deadline 2019-11-29T03:08:49.564477+0000) 2019-11-29T03:09:04.039 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:04.036+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:09:04.101 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:09:04.093+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:09:04.147 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:09:04.143+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:09:04.161 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:09:04.156+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:09:04.379 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:09:04.376+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:09:04.399 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:09:04.394+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:09:04.732 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:09:04.726+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:09:05.061 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:09:05.055+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:09:05.090 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:05.085+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:08:09.564477+0000 (oldest deadline 2019-11-29T03:08:49.564477+0000) 2019-11-29T03:09:05.091 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:05.087+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:09:05.156 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:09:05.151+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:09:05.164 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:09:05.160+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:09:05.351 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:09:05.346+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:09:05.452 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:09:05.446+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:09:05.704 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:09:05.696+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:09:06.079 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:09:06.073+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:09:06.084 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:06.080+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:08:09.564477+0000 (oldest deadline 2019-11-29T03:08:49.564477+0000) 2019-11-29T03:09:06.084 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:06.081+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:09:06.157 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:09:06.154+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:09:06.217 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:09:06.213+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:09:06.335 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:09:06.332+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:09:06.409 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:09:06.405+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:09:06.704 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:09:06.699+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:09:07.049 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:07.043+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:08:09.564477+0000 (oldest deadline 2019-11-29T03:08:49.564477+0000) 2019-11-29T03:09:07.049 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:07.045+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:09:07.128 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:09:07.123+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:09:07.177 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:09:07.172+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:09:07.219 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:09:07.216+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:09:07.382 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:09:07.377+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:09:07.385 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:09:07.381+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:09:07.748 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:09:07.743+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:09:07.923 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:09:07.912+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 44sec e202 v202) 2019-11-29T03:09:08.032 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:08.027+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:08:09.564477+0000 (oldest deadline 2019-11-29T03:08:49.564477+0000) 2019-11-29T03:09:08.032 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:08.028+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:09:08.110 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:09:08.104+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:09:08.152 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:09:08.148+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:09:08.196 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:09:08.192+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:09:08.362 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:09:08.358+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:09:08.432 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:09:08.427+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:09:08.727 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:09:08.721+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:09:09.031 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:09.026+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:08:09.564477+0000 (oldest deadline 2019-11-29T03:08:49.564477+0000) 2019-11-29T03:09:09.031 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:09.027+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:09:09.119 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:09:09.114+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:09:09.197 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:09:09.189+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:09:09.251 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:09:09.242+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:09:09.346 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:09:09.343+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:09:09.404 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:09:09.399+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:09:09.687 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:09:09.681+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:09:09.990 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:09.983+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:08:09.564477+0000 (oldest deadline 2019-11-29T03:08:49.564477+0000) 2019-11-29T03:09:09.993 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:09.985+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:09:10.076 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:09:10.071+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:09:10.181 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:09:10.177+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:09:10.209 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:09:10.205+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:09:10.379 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:09:10.374+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:09:10.391 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:09:10.388+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:09:10.739 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:09:10.734+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:09:10.969 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:10.964+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:08:09.564477+0000 (oldest deadline 2019-11-29T03:08:49.564477+0000) 2019-11-29T03:09:10.970 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:10.966+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:09:11.124 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:09:11.102+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:09:11.211 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:09:11.207+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:09:11.252 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:09:11.248+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:09:11.348 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:09:11.343+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:09:11.349 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:09:11.344+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:09:11.712 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:09:11.706+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:09:11.941 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:11.936+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:08:09.564477+0000 (oldest deadline 2019-11-29T03:08:49.564477+0000) 2019-11-29T03:09:11.944 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:11.940+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:09:12.074 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:09:12.068+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:09:12.219 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:09:12.215+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:09:12.228 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:09:12.224+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:09:12.347 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:09:12.342+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:09:12.382 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:09:12.378+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:09:12.707 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:09:12.701+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:09:12.917 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:12.913+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:08:09.564477+0000 (oldest deadline 2019-11-29T03:08:49.564477+0000) 2019-11-29T03:09:12.920 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:12.917+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:09:12.940 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:09:12.931+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 44sec e202 v202) 2019-11-29T03:09:13.071 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:09:13.066+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:09:13.199 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:09:13.195+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:09:13.255 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:09:13.250+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:09:13.305 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:09:13.300+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:09:13.400 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:09:13.395+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:09:13.669 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:09:13.663+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:09:13.886 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:13.882+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:08:09.564477+0000 (oldest deadline 2019-11-29T03:08:49.564477+0000) 2019-11-29T03:09:13.889 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:13.886+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:09:14.053 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:09:14.048+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:09:14.209 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:09:14.204+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:09:14.247 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:09:14.243+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:09:14.271 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:09:14.266+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:09:14.432 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:09:14.427+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:09:14.636 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:09:14.631+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:09:14.907 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:14.902+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:08:09.564477+0000 (oldest deadline 2019-11-29T03:08:49.564477+0000) 2019-11-29T03:09:14.908 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:14.903+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:09:15.076 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:09:15.069+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:09:15.194 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:09:15.190+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:09:15.216 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:09:15.211+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:09:15.267 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:09:15.263+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:09:15.402 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:09:15.396+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:09:15.618 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:09:15.613+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:09:15.915 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:15.905+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:08:09.564477+0000 (oldest deadline 2019-11-29T03:08:49.564477+0000) 2019-11-29T03:09:15.920 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:15.907+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:09:16.115 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:09:16.106+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:09:16.156 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:09:16.151+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:09:16.249 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:09:16.244+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:09:16.253 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:09:16.249+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:09:16.377 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:09:16.371+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:09:16.660 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:09:16.654+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:09:16.962 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:16.956+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:08:09.564477+0000 (oldest deadline 2019-11-29T03:08:49.564477+0000) 2019-11-29T03:09:16.963 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:16.959+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:09:17.086 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:09:17.080+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:09:17.167 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:09:17.163+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:09:17.264 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:09:17.257+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:09:17.266 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:09:17.260+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:09:17.387 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:09:17.382+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:09:17.655 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:09:17.649+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:09:17.957 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:09:17.951+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 44sec e202 v202) 2019-11-29T03:09:18.004 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:18.000+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:08:09.564477+0000 (oldest deadline 2019-11-29T03:08:49.564477+0000) 2019-11-29T03:09:18.006 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:18.003+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:09:18.099 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:09:18.092+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:09:18.175 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:09:18.172+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:09:18.244 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:09:18.240+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:09:18.311 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:09:18.308+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:09:18.346 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:09:18.340+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:09:18.637 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:09:18.631+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:09:18.988 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:18.981+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:08:09.564477+0000 (oldest deadline 2019-11-29T03:08:49.564477+0000) 2019-11-29T03:09:18.988 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:18.982+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:09:19.106 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:09:19.101+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:09:19.132 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:09:19.128+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:09:19.239 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:09:19.235+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:09:19.276 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:09:19.272+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:09:19.322 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:09:19.318+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:09:19.665 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:09:19.660+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:09:20.000 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:19.996+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:08:09.564477+0000 (oldest deadline 2019-11-29T03:08:49.564477+0000) 2019-11-29T03:09:20.002 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:19.999+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:09:20.133 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:09:20.127+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:09:20.163 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:09:20.159+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:09:20.210 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:09:20.205+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:09:20.271 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:09:20.267+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:09:20.298 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:09:20.293+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:09:20.626 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:09:20.621+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:09:20.958 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:20.954+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:08:09.564477+0000 (oldest deadline 2019-11-29T03:08:49.564477+0000) 2019-11-29T03:09:20.960 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:20.957+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:09:21.175 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:09:21.171+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:09:21.176 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:09:21.164+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:09:21.193 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:09:21.189+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:09:21.320 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:09:21.315+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:09:21.343 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:09:21.337+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:09:21.640 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:09:21.635+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:09:21.927 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:21.923+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:08:09.564477+0000 (oldest deadline 2019-11-29T03:08:49.564477+0000) 2019-11-29T03:09:21.928 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:21.924+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:09:22.141 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:09:22.136+0000 1694c700 -1 osd.1 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:57.146733+0000 front 2019-11-29T03:07:57.148970+0000 (oldest deadline 2019-11-29T03:08:34.639609+0000) 2019-11-29T03:09:22.160 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:09:22.154+0000 1694c700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.149047+0000 front 2019-11-29T03:07:52.065254+0000 (oldest deadline 2019-11-29T03:08:31.117242+0000) 2019-11-29T03:09:22.194 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:09:22.190+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:09:22.342 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:09:22.338+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:09:22.391 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:09:22.387+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:09:22.599 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:09:22.594+0000 1694c700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:49.617448+0000 front 2019-11-29T03:07:49.373635+0000 (oldest deadline 2019-11-29T03:08:35.241294+0000) 2019-11-29T03:09:22.903 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:22.898+0000 1694c700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:08:09.564477+0000 (oldest deadline 2019-11-29T03:08:49.564477+0000) 2019-11-29T03:09:22.905 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:22.900+0000 1694c700 -1 osd.3 202 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:09:23.006 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:09:22.999+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 44sec e202 v202) 2019-11-29T03:09:23.153 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:09:23.148+0000 1694c700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:55.159148+0000 front 2019-11-29T03:07:49.202859+0000 (oldest deadline 2019-11-29T03:08:34.953936+0000) 2019-11-29T03:09:23.389 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:09:23.383+0000 1694c700 -1 osd.2 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:45.777519+0000 front 2019-11-29T03:07:57.148361+0000 (oldest deadline 2019-11-29T03:08:29.991933+0000) 2019-11-29T03:09:23.395 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:09:23.391+0000 1694c700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:07:51.868440+0000 front 2019-11-29T03:07:52.897730+0000 (oldest deadline 2019-11-29T03:08:32.437642+0000) 2019-11-29T03:09:23.986 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:23.878+0000 1694c700 -1 osd.3 203 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e200) 2019-11-29T03:09:24.044 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:09:24.005+0000 37f90700 -1 osd.3 203 build_incremental_map_msg missing incremental map 202 2019-11-29T03:09:53.646 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:09:53.634+0000 34f8a700 -1 osd.5 207 build_incremental_map_msg missing incremental map 207 2019-11-29T03:09:53.647 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:09:53.640+0000 30f82700 -1 osd.5 207 build_incremental_map_msg missing incremental map 207 2019-11-29T03:09:53.991 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:09:53.870+0000 31783700 -1 osd.5 207 build_incremental_map_msg missing incremental map 207 2019-11-29T03:09:54.289 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:09:54.273+0000 31783700 -1 osd.5 207 build_incremental_map_msg missing incremental map 207 2019-11-29T03:09:54.338 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:09:54.291+0000 3578b700 -1 osd.5 207 build_incremental_map_msg missing incremental map 207 2019-11-29T03:09:54.399 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:09:54.362+0000 31f84700 -1 osd.5 207 build_incremental_map_msg missing incremental map 207 2019-11-29T03:09:54.945 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:09:54.899+0000 3578b700 -1 osd.5 208 build_incremental_map_msg missing incremental map 208 2019-11-29T03:09:55.296 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:09:55.237+0000 3578b700 -1 osd.5 208 build_incremental_map_msg missing incremental map 208 2019-11-29T03:09:55.302 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:09:55.250+0000 3678d700 -1 osd.5 208 build_incremental_map_msg missing incremental map 208 2019-11-29T03:09:55.603 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:09:55.348+0000 31783700 -1 osd.5 208 build_incremental_map_msg missing incremental map 208 2019-11-29T03:09:55.924 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:09:55.433+0000 3578b700 -1 osd.5 208 build_incremental_map_msg missing incremental map 208 2019-11-29T03:10:50.670 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:10:50.645+0000 3578b700 -1 osd.3 208 build_incremental_map_msg missing incremental map 191 2019-11-29T03:10:51.533 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:10:51.466+0000 3578b700 -1 osd.3 208 build_incremental_map_msg missing incremental map 202 2019-11-29T03:10:51.855 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:10:51.848+0000 1694c700 -1 osd.4 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:09.948886+0000 front 2019-11-29T03:10:09.962751+0000 (oldest deadline 2019-11-29T03:10:51.197696+0000) 2019-11-29T03:10:52.116 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:10:52.109+0000 1694c700 -1 osd.7 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.353773+0000 front 2019-11-29T03:10:11.352631+0000 (oldest deadline 2019-11-29T03:10:51.840908+0000) 2019-11-29T03:10:52.818 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:10:52.812+0000 1694c700 -1 osd.4 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:09.948886+0000 front 2019-11-29T03:10:09.962751+0000 (oldest deadline 2019-11-29T03:10:51.197696+0000) 2019-11-29T03:10:52.852 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:10:52.847+0000 1694c700 -1 osd.0 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:08.225197+0000 front 2019-11-29T03:10:08.223618+0000 (oldest deadline 2019-11-29T03:10:52.763729+0000) 2019-11-29T03:10:53.112 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:10:53.106+0000 1694c700 -1 osd.6 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.040753+0000 front 2019-11-29T03:10:11.078901+0000 (oldest deadline 2019-11-29T03:10:52.711528+0000) 2019-11-29T03:10:53.155 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:10:53.150+0000 1694c700 -1 osd.7 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.353773+0000 front 2019-11-29T03:10:11.352631+0000 (oldest deadline 2019-11-29T03:10:51.840908+0000) 2019-11-29T03:10:53.256 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:10:53.253+0000 1694c700 -1 osd.1 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:07.262000+0000 front 2019-11-29T03:10:07.307485+0000 (oldest deadline 2019-11-29T03:10:52.506570+0000) 2019-11-29T03:10:53.641 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:10:53.636+0000 1694c700 -1 osd.5 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.896415+0000 front 2019-11-29T03:10:10.894476+0000 (oldest deadline 2019-11-29T03:10:52.923570+0000) 2019-11-29T03:10:53.773 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:10:53.769+0000 1694c700 -1 osd.2 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.152151+0000 front 2019-11-29T03:10:09.868236+0000 (oldest deadline 2019-11-29T03:10:53.353683+0000) 2019-11-29T03:10:53.859 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:10:53.847+0000 1694c700 -1 osd.4 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:09.948886+0000 front 2019-11-29T03:10:09.962751+0000 (oldest deadline 2019-11-29T03:10:51.197696+0000) 2019-11-29T03:10:53.892 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:10:53.888+0000 1694c700 -1 osd.0 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:08.225197+0000 front 2019-11-29T03:10:08.223618+0000 (oldest deadline 2019-11-29T03:10:52.763729+0000) 2019-11-29T03:10:54.164 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:10:54.158+0000 1694c700 -1 osd.6 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.040753+0000 front 2019-11-29T03:10:11.078901+0000 (oldest deadline 2019-11-29T03:10:52.711528+0000) 2019-11-29T03:10:54.167 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:10:54.163+0000 1694c700 -1 osd.7 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.353773+0000 front 2019-11-29T03:10:11.352631+0000 (oldest deadline 2019-11-29T03:10:51.840908+0000) 2019-11-29T03:10:54.228 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:10:54.225+0000 1694c700 -1 osd.1 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:07.262000+0000 front 2019-11-29T03:10:07.307485+0000 (oldest deadline 2019-11-29T03:10:52.506570+0000) 2019-11-29T03:10:54.603 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:10:54.597+0000 1694c700 -1 osd.5 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.896415+0000 front 2019-11-29T03:10:10.894476+0000 (oldest deadline 2019-11-29T03:10:52.923570+0000) 2019-11-29T03:10:54.821 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:10:54.817+0000 1694c700 -1 osd.2 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.152151+0000 front 2019-11-29T03:10:09.868236+0000 (oldest deadline 2019-11-29T03:10:53.353683+0000) 2019-11-29T03:10:54.860 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:10:54.855+0000 1694c700 -1 osd.4 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:09.948886+0000 front 2019-11-29T03:10:09.962751+0000 (oldest deadline 2019-11-29T03:10:51.197696+0000) 2019-11-29T03:10:54.944 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:10:54.939+0000 1694c700 -1 osd.0 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:08.225197+0000 front 2019-11-29T03:10:08.223618+0000 (oldest deadline 2019-11-29T03:10:52.763729+0000) 2019-11-29T03:10:55.155 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:10:55.148+0000 1694c700 -1 osd.7 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.353773+0000 front 2019-11-29T03:10:11.352631+0000 (oldest deadline 2019-11-29T03:10:51.840908+0000) 2019-11-29T03:10:55.191 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:10:55.187+0000 1694c700 -1 osd.1 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:07.262000+0000 front 2019-11-29T03:10:07.307485+0000 (oldest deadline 2019-11-29T03:10:52.506570+0000) 2019-11-29T03:10:55.218 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:10:55.213+0000 1694c700 -1 osd.6 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.040753+0000 front 2019-11-29T03:10:11.078901+0000 (oldest deadline 2019-11-29T03:10:52.711528+0000) 2019-11-29T03:10:55.634 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:10:55.627+0000 1694c700 -1 osd.5 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.896415+0000 front 2019-11-29T03:10:10.894476+0000 (oldest deadline 2019-11-29T03:10:52.923570+0000) 2019-11-29T03:10:55.832 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:10:55.820+0000 1694c700 -1 osd.4 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:09.948886+0000 front 2019-11-29T03:10:09.962751+0000 (oldest deadline 2019-11-29T03:10:51.197696+0000) 2019-11-29T03:10:55.841 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:10:55.837+0000 1694c700 -1 osd.2 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.152151+0000 front 2019-11-29T03:10:09.868236+0000 (oldest deadline 2019-11-29T03:10:53.353683+0000) 2019-11-29T03:10:55.953 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:10:55.950+0000 1694c700 -1 osd.0 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:08.225197+0000 front 2019-11-29T03:10:08.223618+0000 (oldest deadline 2019-11-29T03:10:52.763729+0000) 2019-11-29T03:10:56.179 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:10:56.175+0000 1694c700 -1 osd.1 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:07.262000+0000 front 2019-11-29T03:10:07.307485+0000 (oldest deadline 2019-11-29T03:10:52.506570+0000) 2019-11-29T03:10:56.182 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:10:56.176+0000 1694c700 -1 osd.6 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.040753+0000 front 2019-11-29T03:10:11.078901+0000 (oldest deadline 2019-11-29T03:10:52.711528+0000) 2019-11-29T03:10:56.198 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:10:56.193+0000 1694c700 -1 osd.7 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.353773+0000 front 2019-11-29T03:10:11.352631+0000 (oldest deadline 2019-11-29T03:10:51.840908+0000) 2019-11-29T03:10:56.608 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:10:56.602+0000 1694c700 -1 osd.5 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.896415+0000 front 2019-11-29T03:10:10.894476+0000 (oldest deadline 2019-11-29T03:10:52.923570+0000) 2019-11-29T03:10:56.857 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:10:56.853+0000 1694c700 -1 osd.2 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.152151+0000 front 2019-11-29T03:10:09.868236+0000 (oldest deadline 2019-11-29T03:10:53.353683+0000) 2019-11-29T03:10:56.877 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:10:56.872+0000 1694c700 -1 osd.4 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:09.948886+0000 front 2019-11-29T03:10:09.962751+0000 (oldest deadline 2019-11-29T03:10:51.197696+0000) 2019-11-29T03:10:56.910 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:10:56.906+0000 1694c700 -1 osd.0 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:08.225197+0000 front 2019-11-29T03:10:08.223618+0000 (oldest deadline 2019-11-29T03:10:52.763729+0000) 2019-11-29T03:10:57.167 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:10:57.160+0000 1694c700 -1 osd.7 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.353773+0000 front 2019-11-29T03:10:11.352631+0000 (oldest deadline 2019-11-29T03:10:51.840908+0000) 2019-11-29T03:10:57.186 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:10:57.179+0000 1694c700 -1 osd.6 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.040753+0000 front 2019-11-29T03:10:11.078901+0000 (oldest deadline 2019-11-29T03:10:52.711528+0000) 2019-11-29T03:10:57.189 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:10:57.186+0000 1694c700 -1 osd.1 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:07.262000+0000 front 2019-11-29T03:10:07.307485+0000 (oldest deadline 2019-11-29T03:10:52.506570+0000) 2019-11-29T03:10:57.590 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:10:57.582+0000 1694c700 -1 osd.5 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.896415+0000 front 2019-11-29T03:10:10.894476+0000 (oldest deadline 2019-11-29T03:10:52.923570+0000) 2019-11-29T03:10:57.742 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:10:57.716+0000 37f90700 -1 osd.5 208 build_incremental_map_msg missing incremental map 207 2019-11-29T03:10:57.742 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:10:57.732+0000 37f90700 -1 osd.5 208 build_incremental_map_msg missing incremental map 208 2019-11-29T03:10:57.879 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:10:57.875+0000 1694c700 -1 osd.2 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.152151+0000 front 2019-11-29T03:10:09.868236+0000 (oldest deadline 2019-11-29T03:10:53.353683+0000) 2019-11-29T03:10:57.907 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:10:57.903+0000 1694c700 -1 osd.0 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:08.225197+0000 front 2019-11-29T03:10:08.223618+0000 (oldest deadline 2019-11-29T03:10:52.763729+0000) 2019-11-29T03:10:57.920 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:10:57.914+0000 1694c700 -1 osd.4 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:09.948886+0000 front 2019-11-29T03:10:09.962751+0000 (oldest deadline 2019-11-29T03:10:51.197696+0000) 2019-11-29T03:10:58.136 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:10:58.131+0000 1694c700 -1 osd.7 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.353773+0000 front 2019-11-29T03:10:11.352631+0000 (oldest deadline 2019-11-29T03:10:51.840908+0000) 2019-11-29T03:10:58.190 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:10:58.186+0000 1694c700 -1 osd.1 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:07.262000+0000 front 2019-11-29T03:10:07.307485+0000 (oldest deadline 2019-11-29T03:10:52.506570+0000) 2019-11-29T03:10:58.215 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:10:58.209+0000 1694c700 -1 osd.6 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.040753+0000 front 2019-11-29T03:10:11.078901+0000 (oldest deadline 2019-11-29T03:10:52.711528+0000) 2019-11-29T03:10:58.641 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:10:58.635+0000 1694c700 -1 osd.5 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.896415+0000 front 2019-11-29T03:10:10.894476+0000 (oldest deadline 2019-11-29T03:10:52.923570+0000) 2019-11-29T03:10:58.835 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:10:58.831+0000 1694c700 -1 osd.2 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.152151+0000 front 2019-11-29T03:10:09.868236+0000 (oldest deadline 2019-11-29T03:10:53.353683+0000) 2019-11-29T03:10:58.901 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:10:58.897+0000 1694c700 -1 osd.0 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:08.225197+0000 front 2019-11-29T03:10:08.223618+0000 (oldest deadline 2019-11-29T03:10:52.763729+0000) 2019-11-29T03:10:58.975 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:10:58.970+0000 1694c700 -1 osd.4 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:09.948886+0000 front 2019-11-29T03:10:09.962751+0000 (oldest deadline 2019-11-29T03:10:51.197696+0000) 2019-11-29T03:10:59.129 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:10:59.124+0000 1694c700 -1 osd.7 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.353773+0000 front 2019-11-29T03:10:11.352631+0000 (oldest deadline 2019-11-29T03:10:51.840908+0000) 2019-11-29T03:10:59.225 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:10:59.221+0000 1694c700 -1 osd.1 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:07.262000+0000 front 2019-11-29T03:10:07.307485+0000 (oldest deadline 2019-11-29T03:10:52.506570+0000) 2019-11-29T03:10:59.226 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:10:59.221+0000 1694c700 -1 osd.6 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.040753+0000 front 2019-11-29T03:10:11.078901+0000 (oldest deadline 2019-11-29T03:10:52.711528+0000) 2019-11-29T03:10:59.663 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:10:59.659+0000 1694c700 -1 osd.5 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.896415+0000 front 2019-11-29T03:10:10.894476+0000 (oldest deadline 2019-11-29T03:10:52.923570+0000) 2019-11-29T03:10:59.838 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:10:59.833+0000 1694c700 -1 osd.2 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.152151+0000 front 2019-11-29T03:10:09.868236+0000 (oldest deadline 2019-11-29T03:10:53.353683+0000) 2019-11-29T03:10:59.926 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:10:59.922+0000 1694c700 -1 osd.0 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:08.225197+0000 front 2019-11-29T03:10:08.223618+0000 (oldest deadline 2019-11-29T03:10:52.763729+0000) 2019-11-29T03:10:59.976 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:10:59.970+0000 1694c700 -1 osd.4 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:09.948886+0000 front 2019-11-29T03:10:09.962751+0000 (oldest deadline 2019-11-29T03:10:51.197696+0000) 2019-11-29T03:11:00.169 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:11:00.164+0000 1694c700 -1 osd.7 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.353773+0000 front 2019-11-29T03:10:11.352631+0000 (oldest deadline 2019-11-29T03:10:51.840908+0000) 2019-11-29T03:11:00.232 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:11:00.226+0000 1694c700 -1 osd.6 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.040753+0000 front 2019-11-29T03:10:11.078901+0000 (oldest deadline 2019-11-29T03:10:52.711528+0000) 2019-11-29T03:11:00.245 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:11:00.240+0000 1694c700 -1 osd.1 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:07.262000+0000 front 2019-11-29T03:10:07.307485+0000 (oldest deadline 2019-11-29T03:10:52.506570+0000) 2019-11-29T03:11:00.688 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:11:00.682+0000 1694c700 -1 osd.5 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.896415+0000 front 2019-11-29T03:10:10.894476+0000 (oldest deadline 2019-11-29T03:10:52.923570+0000) 2019-11-29T03:11:00.813 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:11:00.809+0000 1694c700 -1 osd.2 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.152151+0000 front 2019-11-29T03:10:09.868236+0000 (oldest deadline 2019-11-29T03:10:53.353683+0000) 2019-11-29T03:11:00.927 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:11:00.923+0000 1694c700 -1 osd.0 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:08.225197+0000 front 2019-11-29T03:10:08.223618+0000 (oldest deadline 2019-11-29T03:10:52.763729+0000) 2019-11-29T03:11:00.937 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:11:00.931+0000 1694c700 -1 osd.4 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:09.948886+0000 front 2019-11-29T03:10:09.962751+0000 (oldest deadline 2019-11-29T03:10:51.197696+0000) 2019-11-29T03:11:01.197 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:11:01.191+0000 1694c700 -1 osd.7 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.353773+0000 front 2019-11-29T03:10:11.352631+0000 (oldest deadline 2019-11-29T03:10:51.840908+0000) 2019-11-29T03:11:01.245 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:11:01.240+0000 1694c700 -1 osd.6 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.040753+0000 front 2019-11-29T03:10:11.078901+0000 (oldest deadline 2019-11-29T03:10:52.711528+0000) 2019-11-29T03:11:01.246 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:11:01.241+0000 1694c700 -1 osd.1 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:07.262000+0000 front 2019-11-29T03:10:07.307485+0000 (oldest deadline 2019-11-29T03:10:52.506570+0000) 2019-11-29T03:11:01.733 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:11:01.726+0000 1694c700 -1 osd.5 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.896415+0000 front 2019-11-29T03:10:10.894476+0000 (oldest deadline 2019-11-29T03:10:52.923570+0000) 2019-11-29T03:11:01.810 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:11:01.804+0000 1694c700 -1 osd.2 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.152151+0000 front 2019-11-29T03:10:09.868236+0000 (oldest deadline 2019-11-29T03:10:53.353683+0000) 2019-11-29T03:11:01.921 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:11:01.916+0000 1694c700 -1 osd.4 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:09.948886+0000 front 2019-11-29T03:10:09.962751+0000 (oldest deadline 2019-11-29T03:10:51.197696+0000) 2019-11-29T03:11:01.939 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:11:01.935+0000 1694c700 -1 osd.0 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:08.225197+0000 front 2019-11-29T03:10:08.223618+0000 (oldest deadline 2019-11-29T03:10:52.763729+0000) 2019-11-29T03:11:02.221 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:11:02.216+0000 1694c700 -1 osd.6 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.040753+0000 front 2019-11-29T03:10:11.078901+0000 (oldest deadline 2019-11-29T03:10:52.711528+0000) 2019-11-29T03:11:02.225 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:11:02.221+0000 1694c700 -1 osd.1 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:07.262000+0000 front 2019-11-29T03:10:07.307485+0000 (oldest deadline 2019-11-29T03:10:52.506570+0000) 2019-11-29T03:11:02.235 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:11:02.230+0000 1694c700 -1 osd.7 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.353773+0000 front 2019-11-29T03:10:11.352631+0000 (oldest deadline 2019-11-29T03:10:51.840908+0000) 2019-11-29T03:11:02.720 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:11:02.714+0000 1694c700 -1 osd.5 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.896415+0000 front 2019-11-29T03:10:10.894476+0000 (oldest deadline 2019-11-29T03:10:52.923570+0000) 2019-11-29T03:11:02.768 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:11:02.764+0000 1694c700 -1 osd.2 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.152151+0000 front 2019-11-29T03:10:09.868236+0000 (oldest deadline 2019-11-29T03:10:53.353683+0000) 2019-11-29T03:11:02.880 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:11:02.874+0000 1694c700 -1 osd.4 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:09.948886+0000 front 2019-11-29T03:10:09.962751+0000 (oldest deadline 2019-11-29T03:10:51.197696+0000) 2019-11-29T03:11:02.994 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:11:02.988+0000 1694c700 -1 osd.0 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:08.225197+0000 front 2019-11-29T03:10:08.223618+0000 (oldest deadline 2019-11-29T03:10:52.763729+0000) 2019-11-29T03:11:03.215 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:11:03.208+0000 1694c700 -1 osd.7 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.353773+0000 front 2019-11-29T03:10:11.352631+0000 (oldest deadline 2019-11-29T03:10:51.840908+0000) 2019-11-29T03:11:03.254 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:11:03.250+0000 1694c700 -1 osd.1 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:07.262000+0000 front 2019-11-29T03:10:07.307485+0000 (oldest deadline 2019-11-29T03:10:52.506570+0000) 2019-11-29T03:11:03.262 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:11:03.257+0000 1694c700 -1 osd.6 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.040753+0000 front 2019-11-29T03:10:11.078901+0000 (oldest deadline 2019-11-29T03:10:52.711528+0000) 2019-11-29T03:11:03.759 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:11:03.754+0000 1694c700 -1 osd.5 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.896415+0000 front 2019-11-29T03:10:10.894476+0000 (oldest deadline 2019-11-29T03:10:52.923570+0000) 2019-11-29T03:11:03.777 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:11:03.773+0000 1694c700 -1 osd.2 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.152151+0000 front 2019-11-29T03:10:09.868236+0000 (oldest deadline 2019-11-29T03:10:53.353683+0000) 2019-11-29T03:11:03.902 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:11:03.897+0000 1694c700 -1 osd.4 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:09.948886+0000 front 2019-11-29T03:10:09.962751+0000 (oldest deadline 2019-11-29T03:10:51.197696+0000) 2019-11-29T03:11:04.025 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:11:04.020+0000 1694c700 -1 osd.0 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:08.225197+0000 front 2019-11-29T03:10:08.223618+0000 (oldest deadline 2019-11-29T03:10:52.763729+0000) 2019-11-29T03:11:04.199 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:11:04.194+0000 1694c700 -1 osd.7 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.353773+0000 front 2019-11-29T03:10:11.352631+0000 (oldest deadline 2019-11-29T03:10:51.840908+0000) 2019-11-29T03:11:04.236 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:11:04.231+0000 1694c700 -1 osd.1 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:07.262000+0000 front 2019-11-29T03:10:07.307485+0000 (oldest deadline 2019-11-29T03:10:52.506570+0000) 2019-11-29T03:11:04.295 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:11:04.288+0000 1694c700 -1 osd.6 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.040753+0000 front 2019-11-29T03:10:11.078901+0000 (oldest deadline 2019-11-29T03:10:52.711528+0000) 2019-11-29T03:11:04.793 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:11:04.787+0000 1694c700 -1 osd.5 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.896415+0000 front 2019-11-29T03:10:10.894476+0000 (oldest deadline 2019-11-29T03:10:52.923570+0000) 2019-11-29T03:11:04.807 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:11:04.803+0000 1694c700 -1 osd.2 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.152151+0000 front 2019-11-29T03:10:09.868236+0000 (oldest deadline 2019-11-29T03:10:53.353683+0000) 2019-11-29T03:11:04.912 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:11:04.901+0000 1694c700 -1 osd.4 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:09.948886+0000 front 2019-11-29T03:10:09.962751+0000 (oldest deadline 2019-11-29T03:10:51.197696+0000) 2019-11-29T03:11:05.072 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:11:05.069+0000 1694c700 -1 osd.0 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:08.225197+0000 front 2019-11-29T03:10:08.223618+0000 (oldest deadline 2019-11-29T03:10:52.763729+0000) 2019-11-29T03:11:05.166 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:11:05.161+0000 1694c700 -1 osd.7 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.353773+0000 front 2019-11-29T03:10:11.352631+0000 (oldest deadline 2019-11-29T03:10:51.840908+0000) 2019-11-29T03:11:05.228 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:11:05.226+0000 1694c700 -1 osd.1 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:07.262000+0000 front 2019-11-29T03:10:07.307485+0000 (oldest deadline 2019-11-29T03:10:52.506570+0000) 2019-11-29T03:11:05.278 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:11:05.272+0000 1694c700 -1 osd.6 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.040753+0000 front 2019-11-29T03:10:11.078901+0000 (oldest deadline 2019-11-29T03:10:52.711528+0000) 2019-11-29T03:11:05.768 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:11:05.762+0000 1694c700 -1 osd.5 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.896415+0000 front 2019-11-29T03:10:10.894476+0000 (oldest deadline 2019-11-29T03:10:52.923570+0000) 2019-11-29T03:11:05.773 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:11:05.770+0000 1694c700 -1 osd.2 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.152151+0000 front 2019-11-29T03:10:09.868236+0000 (oldest deadline 2019-11-29T03:10:53.353683+0000) 2019-11-29T03:11:05.877 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:11:05.870+0000 1694c700 -1 osd.4 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:09.948886+0000 front 2019-11-29T03:10:09.962751+0000 (oldest deadline 2019-11-29T03:10:51.197696+0000) 2019-11-29T03:11:06.126 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:11:06.122+0000 1694c700 -1 osd.0 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:08.225197+0000 front 2019-11-29T03:10:08.223618+0000 (oldest deadline 2019-11-29T03:10:52.763729+0000) 2019-11-29T03:11:06.201 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:11:06.196+0000 1694c700 -1 osd.7 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.353773+0000 front 2019-11-29T03:10:11.352631+0000 (oldest deadline 2019-11-29T03:10:51.840908+0000) 2019-11-29T03:11:06.237 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:11:06.235+0000 1694c700 -1 osd.1 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:07.262000+0000 front 2019-11-29T03:10:07.307485+0000 (oldest deadline 2019-11-29T03:10:52.506570+0000) 2019-11-29T03:11:06.319 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:11:06.313+0000 1694c700 -1 osd.6 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.040753+0000 front 2019-11-29T03:10:11.078901+0000 (oldest deadline 2019-11-29T03:10:52.711528+0000) 2019-11-29T03:11:06.725 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:11:06.720+0000 1694c700 -1 osd.5 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.896415+0000 front 2019-11-29T03:10:10.894476+0000 (oldest deadline 2019-11-29T03:10:52.923570+0000) 2019-11-29T03:11:06.780 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:11:06.777+0000 1694c700 -1 osd.2 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.152151+0000 front 2019-11-29T03:10:09.868236+0000 (oldest deadline 2019-11-29T03:10:53.353683+0000) 2019-11-29T03:11:06.884 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:11:06.878+0000 1694c700 -1 osd.4 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:09.948886+0000 front 2019-11-29T03:10:09.962751+0000 (oldest deadline 2019-11-29T03:10:51.197696+0000) 2019-11-29T03:11:07.093 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:11:07.090+0000 1694c700 -1 osd.0 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:08.225197+0000 front 2019-11-29T03:10:08.223618+0000 (oldest deadline 2019-11-29T03:10:52.763729+0000) 2019-11-29T03:11:07.209 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:11:07.203+0000 1694c700 -1 osd.7 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.353773+0000 front 2019-11-29T03:10:11.352631+0000 (oldest deadline 2019-11-29T03:10:51.840908+0000) 2019-11-29T03:11:07.265 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:11:07.263+0000 1694c700 -1 osd.1 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:07.262000+0000 front 2019-11-29T03:10:07.307485+0000 (oldest deadline 2019-11-29T03:10:52.506570+0000) 2019-11-29T03:11:07.292 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:11:07.287+0000 1694c700 -1 osd.6 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.040753+0000 front 2019-11-29T03:10:11.078901+0000 (oldest deadline 2019-11-29T03:10:52.711528+0000) 2019-11-29T03:11:07.738 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:11:07.735+0000 1694c700 -1 osd.2 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.152151+0000 front 2019-11-29T03:10:09.868236+0000 (oldest deadline 2019-11-29T03:10:53.353683+0000) 2019-11-29T03:11:07.772 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:11:07.767+0000 1694c700 -1 osd.5 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.896415+0000 front 2019-11-29T03:10:10.894476+0000 (oldest deadline 2019-11-29T03:10:52.923570+0000) 2019-11-29T03:11:07.861 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:11:07.855+0000 1694c700 -1 osd.4 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:09.948886+0000 front 2019-11-29T03:10:09.962751+0000 (oldest deadline 2019-11-29T03:10:51.197696+0000) 2019-11-29T03:11:08.116 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:11:08.113+0000 1694c700 -1 osd.0 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:08.225197+0000 front 2019-11-29T03:10:08.223618+0000 (oldest deadline 2019-11-29T03:10:52.763729+0000) 2019-11-29T03:11:08.208 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:11:08.202+0000 1694c700 -1 osd.7 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.353773+0000 front 2019-11-29T03:10:11.352631+0000 (oldest deadline 2019-11-29T03:10:51.840908+0000) 2019-11-29T03:11:08.300 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:11:08.294+0000 1694c700 -1 osd.6 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.040753+0000 front 2019-11-29T03:10:11.078901+0000 (oldest deadline 2019-11-29T03:10:52.711528+0000) 2019-11-29T03:11:08.305 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:11:08.302+0000 1694c700 -1 osd.1 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:07.262000+0000 front 2019-11-29T03:10:07.307485+0000 (oldest deadline 2019-11-29T03:10:52.506570+0000) 2019-11-29T03:11:08.713 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:11:08.710+0000 1694c700 -1 osd.2 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.152151+0000 front 2019-11-29T03:10:09.868236+0000 (oldest deadline 2019-11-29T03:10:53.353683+0000) 2019-11-29T03:11:08.767 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:11:08.761+0000 1694c700 -1 osd.5 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.896415+0000 front 2019-11-29T03:10:10.894476+0000 (oldest deadline 2019-11-29T03:10:52.923570+0000) 2019-11-29T03:11:08.856 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:11:08.851+0000 1694c700 -1 osd.4 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:09.948886+0000 front 2019-11-29T03:10:09.962751+0000 (oldest deadline 2019-11-29T03:10:51.197696+0000) 2019-11-29T03:11:09.157 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:11:09.153+0000 1694c700 -1 osd.0 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:08.225197+0000 front 2019-11-29T03:10:08.223618+0000 (oldest deadline 2019-11-29T03:10:52.763729+0000) 2019-11-29T03:11:09.254 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:11:09.248+0000 1694c700 -1 osd.7 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.353773+0000 front 2019-11-29T03:10:11.352631+0000 (oldest deadline 2019-11-29T03:10:51.840908+0000) 2019-11-29T03:11:09.263 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:11:09.259+0000 1694c700 -1 osd.1 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:07.262000+0000 front 2019-11-29T03:10:07.307485+0000 (oldest deadline 2019-11-29T03:10:52.506570+0000) 2019-11-29T03:11:09.329 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:11:09.323+0000 1694c700 -1 osd.6 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.040753+0000 front 2019-11-29T03:10:11.078901+0000 (oldest deadline 2019-11-29T03:10:52.711528+0000) 2019-11-29T03:11:09.721 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:11:09.718+0000 1694c700 -1 osd.2 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.152151+0000 front 2019-11-29T03:10:09.868236+0000 (oldest deadline 2019-11-29T03:10:53.353683+0000) 2019-11-29T03:11:09.732 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:11:09.727+0000 1694c700 -1 osd.5 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.896415+0000 front 2019-11-29T03:10:10.894476+0000 (oldest deadline 2019-11-29T03:10:52.923570+0000) 2019-11-29T03:11:09.843 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:11:09.837+0000 1694c700 -1 osd.4 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:09.948886+0000 front 2019-11-29T03:10:09.962751+0000 (oldest deadline 2019-11-29T03:10:51.197696+0000) 2019-11-29T03:11:10.188 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:11:10.186+0000 1694c700 -1 osd.0 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:08.225197+0000 front 2019-11-29T03:10:08.223618+0000 (oldest deadline 2019-11-29T03:10:52.763729+0000) 2019-11-29T03:11:10.273 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:11:10.270+0000 1694c700 -1 osd.1 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:07.262000+0000 front 2019-11-29T03:10:07.307485+0000 (oldest deadline 2019-11-29T03:10:52.506570+0000) 2019-11-29T03:11:10.285 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:11:10.279+0000 1694c700 -1 osd.6 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.040753+0000 front 2019-11-29T03:10:11.078901+0000 (oldest deadline 2019-11-29T03:10:52.711528+0000) 2019-11-29T03:11:10.287 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:11:10.282+0000 1694c700 -1 osd.7 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.353773+0000 front 2019-11-29T03:10:11.352631+0000 (oldest deadline 2019-11-29T03:10:51.840908+0000) 2019-11-29T03:11:10.706 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:11:10.704+0000 1694c700 -1 osd.2 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.152151+0000 front 2019-11-29T03:10:09.868236+0000 (oldest deadline 2019-11-29T03:10:53.353683+0000) 2019-11-29T03:11:10.783 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:11:10.777+0000 1694c700 -1 osd.5 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.896415+0000 front 2019-11-29T03:10:10.894476+0000 (oldest deadline 2019-11-29T03:10:52.923570+0000) 2019-11-29T03:11:10.874 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:11:10.868+0000 1694c700 -1 osd.4 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:09.948886+0000 front 2019-11-29T03:10:09.962751+0000 (oldest deadline 2019-11-29T03:10:51.197696+0000) 2019-11-29T03:11:11.158 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:11:11.155+0000 1694c700 -1 osd.0 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:08.225197+0000 front 2019-11-29T03:10:08.223618+0000 (oldest deadline 2019-11-29T03:10:52.763729+0000) 2019-11-29T03:11:11.259 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:11:11.253+0000 1694c700 -1 osd.6 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.040753+0000 front 2019-11-29T03:10:11.078901+0000 (oldest deadline 2019-11-29T03:10:52.711528+0000) 2019-11-29T03:11:11.280 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:11:11.274+0000 1694c700 -1 osd.7 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.353773+0000 front 2019-11-29T03:10:11.352631+0000 (oldest deadline 2019-11-29T03:10:51.840908+0000) 2019-11-29T03:11:11.304 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:11:11.300+0000 1694c700 -1 osd.1 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:07.262000+0000 front 2019-11-29T03:10:07.307485+0000 (oldest deadline 2019-11-29T03:10:52.506570+0000) 2019-11-29T03:11:11.689 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:11:11.685+0000 1694c700 -1 osd.2 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.152151+0000 front 2019-11-29T03:10:09.868236+0000 (oldest deadline 2019-11-29T03:10:53.353683+0000) 2019-11-29T03:11:11.739 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:11:11.733+0000 1694c700 -1 osd.5 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.896415+0000 front 2019-11-29T03:10:10.894476+0000 (oldest deadline 2019-11-29T03:10:52.923570+0000) 2019-11-29T03:11:11.895 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:11:11.887+0000 1694c700 -1 osd.4 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:09.948886+0000 front 2019-11-29T03:10:09.962751+0000 (oldest deadline 2019-11-29T03:10:51.197696+0000) 2019-11-29T03:11:12.141 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:11:12.138+0000 1694c700 -1 osd.0 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:08.225197+0000 front 2019-11-29T03:10:08.223618+0000 (oldest deadline 2019-11-29T03:10:52.763729+0000) 2019-11-29T03:11:12.219 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:11:12.214+0000 1694c700 -1 osd.6 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.040753+0000 front 2019-11-29T03:10:11.078901+0000 (oldest deadline 2019-11-29T03:10:52.711528+0000) 2019-11-29T03:11:12.247 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:11:12.242+0000 1694c700 -1 osd.7 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.353773+0000 front 2019-11-29T03:10:11.352631+0000 (oldest deadline 2019-11-29T03:10:51.840908+0000) 2019-11-29T03:11:12.288 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:11:12.285+0000 1694c700 -1 osd.1 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:07.262000+0000 front 2019-11-29T03:10:07.307485+0000 (oldest deadline 2019-11-29T03:10:52.506570+0000) 2019-11-29T03:11:12.672 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:11:12.669+0000 1694c700 -1 osd.2 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.152151+0000 front 2019-11-29T03:10:09.868236+0000 (oldest deadline 2019-11-29T03:10:53.353683+0000) 2019-11-29T03:11:12.746 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:11:12.742+0000 1694c700 -1 osd.5 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.896415+0000 front 2019-11-29T03:10:10.894476+0000 (oldest deadline 2019-11-29T03:10:52.923570+0000) 2019-11-29T03:11:12.890 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:11:12.884+0000 1694c700 -1 osd.4 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:09.948886+0000 front 2019-11-29T03:10:09.962751+0000 (oldest deadline 2019-11-29T03:10:51.197696+0000) 2019-11-29T03:11:13.156 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:11:13.153+0000 1694c700 -1 osd.0 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:08.225197+0000 front 2019-11-29T03:10:08.223618+0000 (oldest deadline 2019-11-29T03:10:52.763729+0000) 2019-11-29T03:11:13.182 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:11:13.177+0000 1694c700 -1 osd.6 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.040753+0000 front 2019-11-29T03:10:11.078901+0000 (oldest deadline 2019-11-29T03:10:52.711528+0000) 2019-11-29T03:11:13.297 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:11:13.291+0000 1694c700 -1 osd.7 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.353773+0000 front 2019-11-29T03:10:11.352631+0000 (oldest deadline 2019-11-29T03:10:51.840908+0000) 2019-11-29T03:11:13.303 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:11:13.301+0000 1694c700 -1 osd.1 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:07.262000+0000 front 2019-11-29T03:10:07.307485+0000 (oldest deadline 2019-11-29T03:10:52.506570+0000) 2019-11-29T03:11:13.721 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:11:13.718+0000 1694c700 -1 osd.2 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.152151+0000 front 2019-11-29T03:10:09.868236+0000 (oldest deadline 2019-11-29T03:10:53.353683+0000) 2019-11-29T03:11:13.762 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:11:13.756+0000 1694c700 -1 osd.5 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.896415+0000 front 2019-11-29T03:10:10.894476+0000 (oldest deadline 2019-11-29T03:10:52.923570+0000) 2019-11-29T03:11:13.887 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:11:13.882+0000 1694c700 -1 osd.4 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:09.948886+0000 front 2019-11-29T03:10:09.962751+0000 (oldest deadline 2019-11-29T03:10:51.197696+0000) 2019-11-29T03:11:13.968 INFO:teuthology.orchestra.run.smithi074.stderr:testIfMatch (test.functional.tests.TestFileComparison) ... ok 2019-11-29T03:11:14.173 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:11:14.171+0000 1694c700 -1 osd.0 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:08.225197+0000 front 2019-11-29T03:10:08.223618+0000 (oldest deadline 2019-11-29T03:10:52.763729+0000) 2019-11-29T03:11:14.221 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:11:14.215+0000 1694c700 -1 osd.6 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.040753+0000 front 2019-11-29T03:10:11.078901+0000 (oldest deadline 2019-11-29T03:10:52.711528+0000) 2019-11-29T03:11:14.291 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:11:14.286+0000 1694c700 -1 osd.7 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.353773+0000 front 2019-11-29T03:10:11.352631+0000 (oldest deadline 2019-11-29T03:10:51.840908+0000) 2019-11-29T03:11:14.308 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:11:14.306+0000 1694c700 -1 osd.1 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:07.262000+0000 front 2019-11-29T03:10:07.307485+0000 (oldest deadline 2019-11-29T03:10:52.506570+0000) 2019-11-29T03:11:14.730 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:11:14.724+0000 1694c700 -1 osd.5 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.896415+0000 front 2019-11-29T03:10:10.894476+0000 (oldest deadline 2019-11-29T03:10:52.923570+0000) 2019-11-29T03:11:14.758 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:11:14.754+0000 1694c700 -1 osd.2 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.152151+0000 front 2019-11-29T03:10:09.868236+0000 (oldest deadline 2019-11-29T03:10:53.353683+0000) 2019-11-29T03:11:14.848 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:11:14.842+0000 1694c700 -1 osd.4 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:09.948886+0000 front 2019-11-29T03:10:09.962751+0000 (oldest deadline 2019-11-29T03:10:51.197696+0000) 2019-11-29T03:11:15.182 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:11:15.179+0000 1694c700 -1 osd.0 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:08.225197+0000 front 2019-11-29T03:10:08.223618+0000 (oldest deadline 2019-11-29T03:10:52.763729+0000) 2019-11-29T03:11:15.261 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:11:15.255+0000 1694c700 -1 osd.6 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.040753+0000 front 2019-11-29T03:10:11.078901+0000 (oldest deadline 2019-11-29T03:10:52.711528+0000) 2019-11-29T03:11:15.309 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:11:15.307+0000 1694c700 -1 osd.1 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:07.262000+0000 front 2019-11-29T03:10:07.307485+0000 (oldest deadline 2019-11-29T03:10:52.506570+0000) 2019-11-29T03:11:15.335 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:11:15.330+0000 1694c700 -1 osd.7 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.353773+0000 front 2019-11-29T03:10:11.352631+0000 (oldest deadline 2019-11-29T03:10:51.840908+0000) 2019-11-29T03:11:15.697 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:11:15.689+0000 1694c700 -1 osd.5 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.896415+0000 front 2019-11-29T03:10:10.894476+0000 (oldest deadline 2019-11-29T03:10:52.923570+0000) 2019-11-29T03:11:15.759 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:11:15.756+0000 1694c700 -1 osd.2 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.152151+0000 front 2019-11-29T03:10:09.868236+0000 (oldest deadline 2019-11-29T03:10:53.353683+0000) 2019-11-29T03:11:15.880 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:11:15.875+0000 1694c700 -1 osd.4 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:09.948886+0000 front 2019-11-29T03:10:09.962751+0000 (oldest deadline 2019-11-29T03:10:51.197696+0000) 2019-11-29T03:11:16.201 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:11:16.197+0000 1694c700 -1 osd.0 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:08.225197+0000 front 2019-11-29T03:10:08.223618+0000 (oldest deadline 2019-11-29T03:10:52.763729+0000) 2019-11-29T03:11:16.218 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:11:16.212+0000 1694c700 -1 osd.6 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.040753+0000 front 2019-11-29T03:10:11.078901+0000 (oldest deadline 2019-11-29T03:10:52.711528+0000) 2019-11-29T03:11:16.278 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:11:16.275+0000 1694c700 -1 osd.1 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:07.262000+0000 front 2019-11-29T03:10:07.307485+0000 (oldest deadline 2019-11-29T03:10:52.506570+0000) 2019-11-29T03:11:16.305 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:11:16.299+0000 1694c700 -1 osd.7 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.353773+0000 front 2019-11-29T03:10:11.352631+0000 (oldest deadline 2019-11-29T03:10:51.840908+0000) 2019-11-29T03:11:16.721 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:11:16.705+0000 1694c700 -1 osd.5 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.896415+0000 front 2019-11-29T03:10:10.894476+0000 (oldest deadline 2019-11-29T03:10:52.923570+0000) 2019-11-29T03:11:16.760 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:11:16.757+0000 1694c700 -1 osd.2 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.152151+0000 front 2019-11-29T03:10:09.868236+0000 (oldest deadline 2019-11-29T03:10:53.353683+0000) 2019-11-29T03:11:16.860 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:11:16.854+0000 1694c700 -1 osd.4 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:09.948886+0000 front 2019-11-29T03:10:09.962751+0000 (oldest deadline 2019-11-29T03:10:51.197696+0000) 2019-11-29T03:11:17.209 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:11:17.203+0000 1694c700 -1 osd.6 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.040753+0000 front 2019-11-29T03:10:11.078901+0000 (oldest deadline 2019-11-29T03:10:52.711528+0000) 2019-11-29T03:11:17.211 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:11:17.208+0000 1694c700 -1 osd.0 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:08.225197+0000 front 2019-11-29T03:10:08.223618+0000 (oldest deadline 2019-11-29T03:10:52.763729+0000) 2019-11-29T03:11:17.280 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:11:17.275+0000 1694c700 -1 osd.7 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.353773+0000 front 2019-11-29T03:10:11.352631+0000 (oldest deadline 2019-11-29T03:10:51.840908+0000) 2019-11-29T03:11:17.322 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:11:17.319+0000 1694c700 -1 osd.1 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:07.262000+0000 front 2019-11-29T03:10:07.307485+0000 (oldest deadline 2019-11-29T03:10:52.506570+0000) 2019-11-29T03:11:17.764 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:11:17.759+0000 1694c700 -1 osd.5 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.896415+0000 front 2019-11-29T03:10:10.894476+0000 (oldest deadline 2019-11-29T03:10:52.923570+0000) 2019-11-29T03:11:17.783 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:11:17.779+0000 1694c700 -1 osd.2 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.152151+0000 front 2019-11-29T03:10:09.868236+0000 (oldest deadline 2019-11-29T03:10:53.353683+0000) 2019-11-29T03:11:17.859 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:11:17.853+0000 1694c700 -1 osd.4 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:09.948886+0000 front 2019-11-29T03:10:09.962751+0000 (oldest deadline 2019-11-29T03:10:51.197696+0000) 2019-11-29T03:11:18.180 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:11:18.175+0000 1694c700 -1 osd.6 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.040753+0000 front 2019-11-29T03:10:11.078901+0000 (oldest deadline 2019-11-29T03:10:52.711528+0000) 2019-11-29T03:11:18.234 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:11:18.230+0000 1694c700 -1 osd.0 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:08.225197+0000 front 2019-11-29T03:10:08.223618+0000 (oldest deadline 2019-11-29T03:10:52.763729+0000) 2019-11-29T03:11:18.284 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:11:18.279+0000 1694c700 -1 osd.7 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.353773+0000 front 2019-11-29T03:10:11.352631+0000 (oldest deadline 2019-11-29T03:10:51.840908+0000) 2019-11-29T03:11:18.299 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:11:18.293+0000 1694c700 -1 osd.1 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:07.262000+0000 front 2019-11-29T03:10:07.307485+0000 (oldest deadline 2019-11-29T03:10:52.506570+0000) 2019-11-29T03:11:18.752 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:11:18.747+0000 1694c700 -1 osd.5 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.896415+0000 front 2019-11-29T03:10:10.894476+0000 (oldest deadline 2019-11-29T03:10:52.923570+0000) 2019-11-29T03:11:18.764 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:11:18.760+0000 1694c700 -1 osd.2 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.152151+0000 front 2019-11-29T03:10:09.868236+0000 (oldest deadline 2019-11-29T03:10:53.353683+0000) 2019-11-29T03:11:18.894 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:11:18.887+0000 1694c700 -1 osd.4 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:09.948886+0000 front 2019-11-29T03:10:09.962751+0000 (oldest deadline 2019-11-29T03:10:51.197696+0000) 2019-11-29T03:11:19.185 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:11:19.179+0000 1694c700 -1 osd.6 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.040753+0000 front 2019-11-29T03:10:11.078901+0000 (oldest deadline 2019-11-29T03:10:52.711528+0000) 2019-11-29T03:11:19.249 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:11:19.245+0000 1694c700 -1 osd.0 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:08.225197+0000 front 2019-11-29T03:10:08.223618+0000 (oldest deadline 2019-11-29T03:10:52.763729+0000) 2019-11-29T03:11:19.256 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:11:19.252+0000 1694c700 -1 osd.1 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:07.262000+0000 front 2019-11-29T03:10:07.307485+0000 (oldest deadline 2019-11-29T03:10:52.506570+0000) 2019-11-29T03:11:19.298 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:11:19.292+0000 1694c700 -1 osd.7 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.353773+0000 front 2019-11-29T03:10:11.352631+0000 (oldest deadline 2019-11-29T03:10:51.840908+0000) 2019-11-29T03:11:19.724 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:11:19.720+0000 1694c700 -1 osd.2 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.152151+0000 front 2019-11-29T03:10:09.868236+0000 (oldest deadline 2019-11-29T03:10:53.353683+0000) 2019-11-29T03:11:19.803 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:11:19.797+0000 1694c700 -1 osd.5 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.896415+0000 front 2019-11-29T03:10:10.894476+0000 (oldest deadline 2019-11-29T03:10:52.923570+0000) 2019-11-29T03:11:19.857 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:11:19.851+0000 1694c700 -1 osd.4 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:09.948886+0000 front 2019-11-29T03:10:09.962751+0000 (oldest deadline 2019-11-29T03:10:51.197696+0000) 2019-11-29T03:11:20.185 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:11:20.179+0000 1694c700 -1 osd.6 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.040753+0000 front 2019-11-29T03:10:11.078901+0000 (oldest deadline 2019-11-29T03:10:52.711528+0000) 2019-11-29T03:11:20.226 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:11:20.221+0000 1694c700 -1 osd.0 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:08.225197+0000 front 2019-11-29T03:10:08.223618+0000 (oldest deadline 2019-11-29T03:10:52.763729+0000) 2019-11-29T03:11:20.264 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:11:20.261+0000 1694c700 -1 osd.1 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:07.262000+0000 front 2019-11-29T03:10:07.307485+0000 (oldest deadline 2019-11-29T03:10:52.506570+0000) 2019-11-29T03:11:20.288 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:11:20.283+0000 1694c700 -1 osd.7 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.353773+0000 front 2019-11-29T03:10:11.352631+0000 (oldest deadline 2019-11-29T03:10:51.840908+0000) 2019-11-29T03:11:20.699 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:11:20.694+0000 1694c700 -1 osd.2 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.152151+0000 front 2019-11-29T03:10:09.868236+0000 (oldest deadline 2019-11-29T03:10:53.353683+0000) 2019-11-29T03:11:20.789 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:11:20.783+0000 1694c700 -1 osd.5 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.896415+0000 front 2019-11-29T03:10:10.894476+0000 (oldest deadline 2019-11-29T03:10:52.923570+0000) 2019-11-29T03:11:20.869 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:11:20.863+0000 1694c700 -1 osd.4 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:09.948886+0000 front 2019-11-29T03:10:09.962751+0000 (oldest deadline 2019-11-29T03:10:51.197696+0000) 2019-11-29T03:11:21.161 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:11:21.155+0000 1694c700 -1 osd.6 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.040753+0000 front 2019-11-29T03:10:11.078901+0000 (oldest deadline 2019-11-29T03:10:52.711528+0000) 2019-11-29T03:11:21.221 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:11:21.217+0000 1694c700 -1 osd.0 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:08.225197+0000 front 2019-11-29T03:10:08.223618+0000 (oldest deadline 2019-11-29T03:10:52.763729+0000) 2019-11-29T03:11:21.307 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:11:21.303+0000 1694c700 -1 osd.1 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:07.262000+0000 front 2019-11-29T03:10:07.307485+0000 (oldest deadline 2019-11-29T03:10:52.506570+0000) 2019-11-29T03:11:21.331 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:11:21.326+0000 1694c700 -1 osd.7 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.353773+0000 front 2019-11-29T03:10:11.352631+0000 (oldest deadline 2019-11-29T03:10:51.840908+0000) 2019-11-29T03:11:21.744 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:11:21.739+0000 1694c700 -1 osd.2 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.152151+0000 front 2019-11-29T03:10:09.868236+0000 (oldest deadline 2019-11-29T03:10:53.353683+0000) 2019-11-29T03:11:21.797 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:11:21.792+0000 1694c700 -1 osd.5 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.896415+0000 front 2019-11-29T03:10:10.894476+0000 (oldest deadline 2019-11-29T03:10:52.923570+0000) 2019-11-29T03:11:21.906 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:11:21.897+0000 1694c700 -1 osd.4 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:09.948886+0000 front 2019-11-29T03:10:09.962751+0000 (oldest deadline 2019-11-29T03:10:51.197696+0000) 2019-11-29T03:11:22.194 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:11:22.189+0000 1694c700 -1 osd.6 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.040753+0000 front 2019-11-29T03:10:11.078901+0000 (oldest deadline 2019-11-29T03:10:52.711528+0000) 2019-11-29T03:11:22.204 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:11:22.200+0000 1694c700 -1 osd.0 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:08.225197+0000 front 2019-11-29T03:10:08.223618+0000 (oldest deadline 2019-11-29T03:10:52.763729+0000) 2019-11-29T03:11:22.300 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:11:22.297+0000 1694c700 -1 osd.1 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:07.262000+0000 front 2019-11-29T03:10:07.307485+0000 (oldest deadline 2019-11-29T03:10:52.506570+0000) 2019-11-29T03:11:22.305 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:11:22.296+0000 1694c700 -1 osd.7 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.353773+0000 front 2019-11-29T03:10:11.352631+0000 (oldest deadline 2019-11-29T03:10:51.840908+0000) 2019-11-29T03:11:22.736 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:11:22.732+0000 1694c700 -1 osd.2 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.152151+0000 front 2019-11-29T03:10:09.868236+0000 (oldest deadline 2019-11-29T03:10:53.353683+0000) 2019-11-29T03:11:22.803 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:11:22.799+0000 1694c700 -1 osd.5 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.896415+0000 front 2019-11-29T03:10:10.894476+0000 (oldest deadline 2019-11-29T03:10:52.923570+0000) 2019-11-29T03:11:22.931 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:11:22.927+0000 1694c700 -1 osd.4 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:09.948886+0000 front 2019-11-29T03:10:09.962751+0000 (oldest deadline 2019-11-29T03:10:51.197696+0000) 2019-11-29T03:11:23.204 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:11:23.201+0000 1694c700 -1 osd.0 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:08.225197+0000 front 2019-11-29T03:10:08.223618+0000 (oldest deadline 2019-11-29T03:10:52.763729+0000) 2019-11-29T03:11:23.213 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:11:23.208+0000 1694c700 -1 osd.6 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.040753+0000 front 2019-11-29T03:10:11.078901+0000 (oldest deadline 2019-11-29T03:10:52.711528+0000) 2019-11-29T03:11:23.304 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:11:23.297+0000 1694c700 -1 osd.7 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.353773+0000 front 2019-11-29T03:10:11.352631+0000 (oldest deadline 2019-11-29T03:10:51.840908+0000) 2019-11-29T03:11:23.330 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:11:23.327+0000 1694c700 -1 osd.1 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:07.262000+0000 front 2019-11-29T03:10:07.307485+0000 (oldest deadline 2019-11-29T03:10:52.506570+0000) 2019-11-29T03:11:23.375 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:11:23.372+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.74:6802/10096,v1:172.21.15.74:6803/10096] for 45sec e208 v208) 2019-11-29T03:11:23.706 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:11:23.702+0000 1694c700 -1 osd.2 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.152151+0000 front 2019-11-29T03:10:09.868236+0000 (oldest deadline 2019-11-29T03:10:53.353683+0000) 2019-11-29T03:11:23.764 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:11:23.758+0000 1694c700 -1 osd.5 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.896415+0000 front 2019-11-29T03:10:10.894476+0000 (oldest deadline 2019-11-29T03:10:52.923570+0000) 2019-11-29T03:11:23.948 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:11:23.942+0000 1694c700 -1 osd.4 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:09.948886+0000 front 2019-11-29T03:10:09.962751+0000 (oldest deadline 2019-11-29T03:10:51.197696+0000) 2019-11-29T03:11:24.185 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:11:24.179+0000 1694c700 -1 osd.6 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.040753+0000 front 2019-11-29T03:10:11.078901+0000 (oldest deadline 2019-11-29T03:10:52.711528+0000) 2019-11-29T03:11:24.225 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:11:24.222+0000 1694c700 -1 osd.0 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:08.225197+0000 front 2019-11-29T03:10:08.223618+0000 (oldest deadline 2019-11-29T03:10:52.763729+0000) 2019-11-29T03:11:24.316 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:11:24.311+0000 1694c700 -1 osd.7 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.353773+0000 front 2019-11-29T03:10:11.352631+0000 (oldest deadline 2019-11-29T03:10:51.840908+0000) 2019-11-29T03:11:24.369 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:11:24.365+0000 1694c700 -1 osd.1 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:07.262000+0000 front 2019-11-29T03:10:07.307485+0000 (oldest deadline 2019-11-29T03:10:52.506570+0000) 2019-11-29T03:11:24.722 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:11:24.719+0000 1694c700 -1 osd.2 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.152151+0000 front 2019-11-29T03:10:09.868236+0000 (oldest deadline 2019-11-29T03:10:53.353683+0000) 2019-11-29T03:11:24.791 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:11:24.785+0000 1694c700 -1 osd.5 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.896415+0000 front 2019-11-29T03:10:10.894476+0000 (oldest deadline 2019-11-29T03:10:52.923570+0000) 2019-11-29T03:11:24.970 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:11:24.965+0000 1694c700 -1 osd.4 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:09.948886+0000 front 2019-11-29T03:10:09.962751+0000 (oldest deadline 2019-11-29T03:10:51.197696+0000) 2019-11-29T03:11:25.172 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:11:25.166+0000 1694c700 -1 osd.6 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.040753+0000 front 2019-11-29T03:10:11.078901+0000 (oldest deadline 2019-11-29T03:10:52.711528+0000) 2019-11-29T03:11:25.197 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:11:25.193+0000 1694c700 -1 osd.0 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:08.225197+0000 front 2019-11-29T03:10:08.223618+0000 (oldest deadline 2019-11-29T03:10:52.763729+0000) 2019-11-29T03:11:25.363 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:11:25.357+0000 1694c700 -1 osd.7 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.353773+0000 front 2019-11-29T03:10:11.352631+0000 (oldest deadline 2019-11-29T03:10:51.840908+0000) 2019-11-29T03:11:25.386 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:11:25.380+0000 1694c700 -1 osd.1 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:07.262000+0000 front 2019-11-29T03:10:07.307485+0000 (oldest deadline 2019-11-29T03:10:52.506570+0000) 2019-11-29T03:11:25.677 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:11:25.673+0000 1694c700 -1 osd.2 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.152151+0000 front 2019-11-29T03:10:09.868236+0000 (oldest deadline 2019-11-29T03:10:53.353683+0000) 2019-11-29T03:11:25.815 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:11:25.809+0000 1694c700 -1 osd.5 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.896415+0000 front 2019-11-29T03:10:10.894476+0000 (oldest deadline 2019-11-29T03:10:52.923570+0000) 2019-11-29T03:11:25.972 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:11:25.966+0000 1694c700 -1 osd.4 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:09.948886+0000 front 2019-11-29T03:10:09.962751+0000 (oldest deadline 2019-11-29T03:10:51.197696+0000) 2019-11-29T03:11:26.168 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:11:26.162+0000 1694c700 -1 osd.6 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.040753+0000 front 2019-11-29T03:10:11.078901+0000 (oldest deadline 2019-11-29T03:10:52.711528+0000) 2019-11-29T03:11:26.215 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:11:26.211+0000 1694c700 -1 osd.0 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:08.225197+0000 front 2019-11-29T03:10:08.223618+0000 (oldest deadline 2019-11-29T03:10:52.763729+0000) 2019-11-29T03:11:26.333 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:11:26.328+0000 1694c700 -1 osd.7 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.353773+0000 front 2019-11-29T03:10:11.352631+0000 (oldest deadline 2019-11-29T03:10:51.840908+0000) 2019-11-29T03:11:26.354 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:11:26.351+0000 1694c700 -1 osd.1 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:07.262000+0000 front 2019-11-29T03:10:07.307485+0000 (oldest deadline 2019-11-29T03:10:52.506570+0000) 2019-11-29T03:11:26.653 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:11:26.650+0000 1694c700 -1 osd.2 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.152151+0000 front 2019-11-29T03:10:09.868236+0000 (oldest deadline 2019-11-29T03:10:53.353683+0000) 2019-11-29T03:11:26.837 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:11:26.832+0000 1694c700 -1 osd.5 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.896415+0000 front 2019-11-29T03:10:10.894476+0000 (oldest deadline 2019-11-29T03:10:52.923570+0000) 2019-11-29T03:11:26.980 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:11:26.975+0000 1694c700 -1 osd.4 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:09.948886+0000 front 2019-11-29T03:10:09.962751+0000 (oldest deadline 2019-11-29T03:10:51.197696+0000) 2019-11-29T03:11:27.170 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:11:27.165+0000 1694c700 -1 osd.6 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.040753+0000 front 2019-11-29T03:10:11.078901+0000 (oldest deadline 2019-11-29T03:10:52.711528+0000) 2019-11-29T03:11:27.266 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:11:27.262+0000 1694c700 -1 osd.0 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:08.225197+0000 front 2019-11-29T03:10:08.223618+0000 (oldest deadline 2019-11-29T03:10:52.763729+0000) 2019-11-29T03:11:27.314 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:11:27.310+0000 1694c700 -1 osd.1 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:07.262000+0000 front 2019-11-29T03:10:07.307485+0000 (oldest deadline 2019-11-29T03:10:52.506570+0000) 2019-11-29T03:11:27.318 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:11:27.312+0000 1694c700 -1 osd.7 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.353773+0000 front 2019-11-29T03:10:11.352631+0000 (oldest deadline 2019-11-29T03:10:51.840908+0000) 2019-11-29T03:11:27.683 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:11:27.678+0000 1694c700 -1 osd.2 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.152151+0000 front 2019-11-29T03:10:09.868236+0000 (oldest deadline 2019-11-29T03:10:53.353683+0000) 2019-11-29T03:11:27.861 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:11:27.856+0000 1694c700 -1 osd.5 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:10.896415+0000 front 2019-11-29T03:10:10.894476+0000 (oldest deadline 2019-11-29T03:10:52.923570+0000) 2019-11-29T03:11:27.989 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:11:27.983+0000 1694c700 -1 osd.4 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:09.948886+0000 front 2019-11-29T03:10:09.962751+0000 (oldest deadline 2019-11-29T03:10:51.197696+0000) 2019-11-29T03:11:28.204 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:11:28.199+0000 1694c700 -1 osd.6 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.040753+0000 front 2019-11-29T03:10:11.078901+0000 (oldest deadline 2019-11-29T03:10:52.711528+0000) 2019-11-29T03:11:28.261 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:11:28.257+0000 1694c700 -1 osd.0 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:08.225197+0000 front 2019-11-29T03:10:08.223618+0000 (oldest deadline 2019-11-29T03:10:52.763729+0000) 2019-11-29T03:11:28.270 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:11:28.267+0000 1694c700 -1 osd.1 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:07.262000+0000 front 2019-11-29T03:10:07.307485+0000 (oldest deadline 2019-11-29T03:10:52.506570+0000) 2019-11-29T03:11:28.318 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:11:28.313+0000 1694c700 -1 osd.7 208 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:10:11.353773+0000 front 2019-11-29T03:10:11.352631+0000 (oldest deadline 2019-11-29T03:10:51.840908+0000) 2019-11-29T03:11:28.422 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:11:28.420+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.74:6802/10096,v1:172.21.15.74:6803/10096] for 45sec e208 v208) 2019-11-29T03:11:57.378 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:25:39.596 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:11:57.387 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:25:39.605 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:11:57.392 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:25:39.611 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:11:57.394 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:25:39.622 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:11:57.396 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:25:39.615 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:11:57.409 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:25:39.638 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:11:57.667 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:25:39.896 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:11:57.700 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:25:39.918 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:11:57.718 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:25:39.937 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:12:27.606 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:12:27.600+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:12:27.616 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:12:27.613+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:12:27.804 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:12:27.799+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:12:28.641 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:12:28.634+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:12:28.665 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:12:28.661+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:12:28.813 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:12:28.808+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:12:29.610 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:12:29.605+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:12:29.663 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:12:29.659+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:12:29.782 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:12:29.778+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:12:29.856 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:12:29.850+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:12:30.575 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:12:30.570+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:12:30.630 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:12:30.626+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:12:30.678 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:12:30.675+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:12:30.757 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:12:30.753+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:12:30.823 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:12:30.817+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:12:31.548 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:12:31.543+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:12:31.647 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:12:31.642+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:12:31.702 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:12:31.699+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:12:31.764 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:12:31.759+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:12:31.838 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:12:31.832+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:12:32.565 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:12:32.561+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:12:32.676 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:12:32.671+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:12:32.688 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:12:32.684+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:12:32.780 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:12:32.775+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:12:32.896 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:12:32.886+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:12:33.371 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:33.369+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:12:33.591 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:12:33.586+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:12:33.662 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:12:33.657+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:12:33.663 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:12:33.657+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:12:33.769 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:12:33.766+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:12:33.913 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:12:33.908+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:12:34.401 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:34.397+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:12:34.632 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:12:34.626+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:12:34.643 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:12:34.638+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:12:34.661 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:12:34.657+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:12:34.775 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:12:34.772+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:12:34.887 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:12:34.883+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:12:35.358 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:35.354+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:12:35.591 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:12:35.587+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:12:35.632 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:12:35.629+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:12:35.668 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:12:35.663+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:12:35.783 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:12:35.780+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:12:35.865 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:12:35.861+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:12:36.351 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:36.349+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:12:36.619 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:12:36.617+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:12:36.619 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:12:36.610+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:12:36.723 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:12:36.718+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:12:36.790 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:12:36.787+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:12:36.913 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:12:36.908+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:12:37.379 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:37.376+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:12:37.574 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:12:37.568+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:12:37.624 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:12:37.621+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:12:37.704 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:12:37.699+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:12:37.766 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:12:37.763+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:12:37.886 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:12:37.880+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:12:38.415 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:38.411+0000 1694c700 -1 osd.3 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:11:57.745199+0000 (oldest deadline 2019-11-29T03:12:37.745199+0000) 2019-11-29T03:12:38.417 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:38.413+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:12:38.608 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:12:38.603+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:12:38.665 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:12:38.661+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:12:38.712 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:12:38.707+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:12:38.813 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:12:38.810+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:12:38.884 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:12:38.880+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:12:38.940 INFO:teuthology.orchestra.run.smithi074.stderr:testIfMatchAndUnmodified (test.functional.tests.TestFileComparison) ... ok 2019-11-29T03:12:39.460 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:39.458+0000 1694c700 -1 osd.3 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:11:57.745199+0000 (oldest deadline 2019-11-29T03:12:37.745199+0000) 2019-11-29T03:12:39.463 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:39.461+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:12:39.659 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:12:39.655+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:12:39.681 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:12:39.676+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:12:39.698 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:12:39.696+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:12:39.846 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:12:39.842+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:12:39.922 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:12:39.917+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:12:40.464 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:40.458+0000 1694c700 -1 osd.3 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:11:57.745199+0000 (oldest deadline 2019-11-29T03:12:37.745199+0000) 2019-11-29T03:12:40.465 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:40.461+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:12:40.656 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:12:40.652+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:12:40.656 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:12:40.648+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:12:40.736 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:12:40.733+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:12:40.854 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:12:40.851+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:12:40.904 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:12:40.899+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:12:41.482 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:41.473+0000 1694c700 -1 osd.3 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:11:57.745199+0000 (oldest deadline 2019-11-29T03:12:37.745199+0000) 2019-11-29T03:12:41.492 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:41.481+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:12:41.617 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:12:41.611+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:12:41.643 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:12:41.638+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:12:41.720 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:12:41.717+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:12:41.813 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:12:41.810+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:12:41.909 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:12:41.904+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:12:42.514 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:42.510+0000 1694c700 -1 osd.3 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:11:57.745199+0000 (oldest deadline 2019-11-29T03:12:37.745199+0000) 2019-11-29T03:12:42.515 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:42.512+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:12:42.572 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:12:42.567+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:12:42.655 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:12:42.650+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:12:42.769 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:12:42.767+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:12:42.840 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:12:42.837+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:12:42.937 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:12:42.933+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:12:43.512 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:43.509+0000 1694c700 -1 osd.3 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:11:57.745199+0000 (oldest deadline 2019-11-29T03:12:37.745199+0000) 2019-11-29T03:12:43.512 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:43.510+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:12:43.584 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:12:43.578+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:12:43.674 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:12:43.668+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:12:43.752 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:12:43.750+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:12:43.853 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:12:43.851+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:12:43.930 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:12:43.925+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:12:44.555 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:44.551+0000 1694c700 -1 osd.3 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:11:57.745199+0000 (oldest deadline 2019-11-29T03:12:37.745199+0000) 2019-11-29T03:12:44.555 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:44.553+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:12:44.624 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:12:44.619+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:12:44.694 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:12:44.689+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:12:44.718 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:12:44.715+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:12:44.847 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:12:44.844+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:12:44.891 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:12:44.885+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:12:45.606 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:45.601+0000 1694c700 -1 osd.3 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:11:57.745199+0000 (oldest deadline 2019-11-29T03:12:37.745199+0000) 2019-11-29T03:12:45.606 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:45.603+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:12:45.613 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:12:45.608+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:12:45.716 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:12:45.711+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:12:45.719 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:12:45.717+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:12:45.865 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:12:45.860+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:12:45.886 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:12:45.882+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:12:46.610 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:12:46.605+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:12:46.638 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:46.635+0000 1694c700 -1 osd.3 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:11:57.745199+0000 (oldest deadline 2019-11-29T03:12:37.745199+0000) 2019-11-29T03:12:46.639 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:46.636+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:12:46.762 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:12:46.756+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:12:46.762 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:12:46.758+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:12:46.821 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:12:46.816+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:12:46.910 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:12:46.907+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:12:47.594 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:47.591+0000 1694c700 -1 osd.3 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:11:57.745199+0000 (oldest deadline 2019-11-29T03:12:37.745199+0000) 2019-11-29T03:12:47.595 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:47.592+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:12:47.635 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:12:47.630+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:12:47.717 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:12:47.714+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:12:47.798 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:12:47.792+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:12:47.800 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:12:47.795+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:12:47.948 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:12:47.945+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:12:48.609 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:48.606+0000 1694c700 -1 osd.3 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:11:57.745199+0000 (oldest deadline 2019-11-29T03:12:37.745199+0000) 2019-11-29T03:12:48.610 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:48.607+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:12:48.634 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:12:48.629+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:12:48.758 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:12:48.754+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:12:48.770 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:12:48.765+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:12:48.847 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:12:48.842+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:12:48.921 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:12:48.918+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:12:49.602 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:49.599+0000 1694c700 -1 osd.3 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:11:57.745199+0000 (oldest deadline 2019-11-29T03:12:37.745199+0000) 2019-11-29T03:12:49.604 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:49.601+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:12:49.657 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:12:49.651+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:12:49.741 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:12:49.735+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:12:49.799 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:12:49.796+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:12:49.823 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:12:49.818+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:12:49.933 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:12:49.928+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:12:50.628 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:12:50.623+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:12:50.640 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:50.637+0000 1694c700 -1 osd.3 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:11:57.745199+0000 (oldest deadline 2019-11-29T03:12:37.745199+0000) 2019-11-29T03:12:50.641 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:50.638+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:12:50.745 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:12:50.740+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:12:50.797 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:12:50.790+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:12:50.814 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:12:50.810+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:12:50.963 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:12:50.959+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:12:51.621 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:12:51.616+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:12:51.654 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:51.649+0000 1694c700 -1 osd.3 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:11:57.745199+0000 (oldest deadline 2019-11-29T03:12:37.745199+0000) 2019-11-29T03:12:51.655 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:51.651+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:12:51.749 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:12:51.744+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:12:51.790 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:12:51.785+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:12:51.851 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:12:51.846+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:12:51.996 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:12:51.992+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:12:52.674 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:12:52.669+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:12:52.704 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:52.701+0000 1694c700 -1 osd.3 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:11:57.745199+0000 (oldest deadline 2019-11-29T03:12:37.745199+0000) 2019-11-29T03:12:52.712 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:52.708+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:12:52.750 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:12:52.745+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:12:52.787 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:12:52.783+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:12:52.899 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:12:52.895+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:12:52.959 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:12:52.956+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:12:53.630 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:12:53.624+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:12:53.744 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:53.741+0000 1694c700 -1 osd.3 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:11:57.745199+0000 (oldest deadline 2019-11-29T03:12:37.745199+0000) 2019-11-29T03:12:53.745 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:53.743+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:12:53.782 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:12:53.777+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:12:53.791 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:12:53.786+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:12:53.900 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:12:53.897+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:12:53.985 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:12:53.981+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:12:54.588 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:12:54.581+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:12:54.767 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:54.762+0000 1694c700 -1 osd.3 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:11:57.745199+0000 (oldest deadline 2019-11-29T03:12:37.745199+0000) 2019-11-29T03:12:54.777 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:54.764+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:12:54.792 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:12:54.787+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:12:54.794 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:12:54.790+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:12:54.867 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:12:54.863+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:12:54.943 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:12:54.939+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:12:55.565 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:12:55.559+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:12:55.763 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:12:55.758+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:12:55.770 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:12:55.764+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:12:55.789 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:55.786+0000 1694c700 -1 osd.3 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:11:57.745199+0000 (oldest deadline 2019-11-29T03:12:37.745199+0000) 2019-11-29T03:12:55.792 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:55.789+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:12:55.903 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:12:55.900+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:12:55.989 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:12:55.985+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:12:56.597 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:12:56.563+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:12:56.734 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:12:56.729+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:12:56.750 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:12:56.746+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:12:56.753 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:56.750+0000 1694c700 -1 osd.3 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:11:57.745199+0000 (oldest deadline 2019-11-29T03:12:37.745199+0000) 2019-11-29T03:12:56.754 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:56.751+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:12:56.955 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:12:56.951+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:12:57.032 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:12:57.027+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:12:57.599 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:12:57.594+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:12:57.775 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:57.771+0000 1694c700 -1 osd.3 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:11:57.745199+0000 (oldest deadline 2019-11-29T03:12:37.745199+0000) 2019-11-29T03:12:57.776 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:57.773+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:12:57.778 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:12:57.773+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:12:57.786 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:12:57.781+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:12:57.928 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:12:57.925+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:12:58.041 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:12:58.036+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:12:58.627 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:12:58.621+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:12:58.749 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:12:58.741+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 43sec e214 v214) 2019-11-29T03:12:58.792 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:12:58.779+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:12:58.798 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:58.794+0000 1694c700 -1 osd.3 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:11:57.745199+0000 (oldest deadline 2019-11-29T03:12:37.745199+0000) 2019-11-29T03:12:58.799 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:58.796+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:12:58.804 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:12:58.799+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:12:58.893 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:12:58.889+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:12:59.069 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:12:59.065+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:12:59.633 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:12:59.627+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:12:59.825 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:12:59.821+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:12:59.832 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:59.828+0000 1694c700 -1 osd.3 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:11:57.745199+0000 (oldest deadline 2019-11-29T03:12:37.745199+0000) 2019-11-29T03:12:59.833 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:12:59.830+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:12:59.841 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:12:59.834+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:12:59.856 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:12:59.852+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:13:00.068 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:13:00.064+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:13:00.654 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:13:00.647+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:13:00.792 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:13:00.788+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:13:00.802 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:13:00.798+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:13:00.809 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:13:00.804+0000 1694c700 -1 osd.3 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:11:57.745199+0000 (oldest deadline 2019-11-29T03:12:37.745199+0000) 2019-11-29T03:13:00.810 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:13:00.806+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:13:00.863 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:13:00.859+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:13:01.084 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:13:01.080+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:13:01.674 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:13:01.668+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:13:01.801 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:13:01.796+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:13:01.826 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:13:01.822+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:13:01.840 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:13:01.834+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:13:01.840 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:13:01.837+0000 1694c700 -1 osd.3 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:11:57.745199+0000 (oldest deadline 2019-11-29T03:12:37.745199+0000) 2019-11-29T03:13:01.843 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:13:01.840+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:13:02.127 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:13:02.122+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:13:02.630 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:13:02.625+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:13:02.793 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:13:02.788+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:13:02.798 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:13:02.793+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:13:02.803 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:13:02.798+0000 1694c700 -1 osd.3 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:11:57.745199+0000 (oldest deadline 2019-11-29T03:12:37.745199+0000) 2019-11-29T03:13:02.804 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:13:02.799+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:13:02.878 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:13:02.874+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:13:03.164 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:13:03.160+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:13:03.665 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:13:03.659+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:13:03.759 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:13:03.755+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 43sec e214 v214) 2019-11-29T03:13:03.760 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:13:03.756+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:13:03.837 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:13:03.832+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:13:03.848 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:13:03.844+0000 1694c700 -1 osd.3 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:11:57.745199+0000 (oldest deadline 2019-11-29T03:12:37.745199+0000) 2019-11-29T03:13:03.849 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:13:03.845+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:13:03.864 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:13:03.859+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:13:04.121 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:13:04.117+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:13:04.637 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:13:04.631+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:13:04.757 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:13:04.752+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:13:04.822 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:13:04.817+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:13:04.824 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:13:04.819+0000 1694c700 -1 osd.3 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:11:57.745199+0000 (oldest deadline 2019-11-29T03:12:37.745199+0000) 2019-11-29T03:13:04.844 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:13:04.837+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:13:04.886 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:13:04.882+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:13:05.141 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:13:05.138+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:13:05.629 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:13:05.623+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:13:05.762 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:13:05.757+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:13:05.826 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:13:05.820+0000 1694c700 -1 osd.3 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:11:57.745199+0000 (oldest deadline 2019-11-29T03:12:37.745199+0000) 2019-11-29T03:13:05.827 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:13:05.822+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:13:05.837 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:13:05.832+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:13:05.919 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:13:05.913+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:13:06.134 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:13:06.130+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:13:06.633 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:13:06.627+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:13:06.731 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:13:06.727+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:13:06.831 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:13:06.826+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:13:06.878 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:13:06.873+0000 1694c700 -1 osd.3 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:11:57.745199+0000 (oldest deadline 2019-11-29T03:12:37.745199+0000) 2019-11-29T03:13:06.878 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:13:06.875+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:13:06.896 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:13:06.892+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:13:07.095 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:13:07.091+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:13:07.685 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:13:07.679+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:13:07.703 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:13:07.699+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:13:07.847 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:13:07.843+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:13:07.862 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:13:07.858+0000 1694c700 -1 osd.3 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:11:57.745199+0000 (oldest deadline 2019-11-29T03:12:37.745199+0000) 2019-11-29T03:13:07.865 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:13:07.862+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:13:07.924 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:13:07.919+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:13:08.108 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:13:08.104+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:13:08.653 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:13:08.649+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:13:08.742 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:13:08.737+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:13:08.779 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:13:08.773+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 43sec e214 v214) 2019-11-29T03:13:08.834 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:13:08.830+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:13:08.840 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:13:08.835+0000 1694c700 -1 osd.3 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:11:57.745199+0000 (oldest deadline 2019-11-29T03:12:37.745199+0000) 2019-11-29T03:13:08.841 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:13:08.836+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:13:08.933 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:13:08.928+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:13:09.103 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:13:09.099+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:13:09.705 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:13:09.700+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:13:09.750 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:13:09.745+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:13:09.861 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:13:09.856+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:13:09.866 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:13:09.861+0000 1694c700 -1 osd.3 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:11:57.745199+0000 (oldest deadline 2019-11-29T03:12:37.745199+0000) 2019-11-29T03:13:09.867 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:13:09.863+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:13:09.920 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:13:09.915+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:13:10.106 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:13:10.102+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:13:10.746 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:13:10.741+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:13:10.779 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:13:10.773+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:13:10.884 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:13:10.880+0000 1694c700 -1 osd.3 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:11:57.745199+0000 (oldest deadline 2019-11-29T03:12:37.745199+0000) 2019-11-29T03:13:10.886 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:13:10.883+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:13:10.906 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:13:10.901+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:13:10.909 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:13:10.904+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:13:11.102 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:13:11.097+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:13:11.439 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:13:11.435+0000 1694c700 -1 osd.2 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:42.471369+0000 front 2019-11-29T03:11:42.330133+0000 (oldest deadline 2019-11-29T03:13:10.584291+0000) 2019-11-29T03:13:11.703 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:13:11.697+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:13:11.771 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:13:11.767+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:13:11.891 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:13:11.886+0000 1694c700 -1 osd.3 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:11:57.745199+0000 (oldest deadline 2019-11-29T03:12:37.745199+0000) 2019-11-29T03:13:11.892 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:13:11.888+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:13:11.950 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:13:11.944+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:13:11.962 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:13:11.956+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:13:12.138 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:13:12.134+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:13:12.468 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:13:12.464+0000 1694c700 -1 osd.2 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:42.471369+0000 front 2019-11-29T03:11:42.330133+0000 (oldest deadline 2019-11-29T03:13:10.584291+0000) 2019-11-29T03:13:12.683 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:13:12.677+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:13:12.739 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:13:12.735+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:13:12.862 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:13:12.858+0000 1694c700 -1 osd.3 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:11:57.745199+0000 (oldest deadline 2019-11-29T03:12:37.745199+0000) 2019-11-29T03:13:12.865 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:13:12.862+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:13:12.990 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:13:12.984+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:13:13.003 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:13:12.997+0000 1694c700 -1 osd.6 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.291890+0000 front 2019-11-29T03:11:45.301823+0000 (oldest deadline 2019-11-29T03:12:30.559502+0000) 2019-11-29T03:13:13.119 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:13:13.116+0000 1694c700 -1 osd.1 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.328117+0000 front 2019-11-29T03:11:45.327054+0000 (oldest deadline 2019-11-29T03:12:28.811861+0000) 2019-11-29T03:13:13.437 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:13:13.433+0000 1694c700 -1 osd.2 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:42.471369+0000 front 2019-11-29T03:11:42.330133+0000 (oldest deadline 2019-11-29T03:13:10.584291+0000) 2019-11-29T03:13:13.736 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:13:13.730+0000 1694c700 -1 osd.4 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:44.020521+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:27.309629+0000) 2019-11-29T03:13:13.755 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:13:13.752+0000 1694c700 -1 osd.0 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.310862+0000 front 2019-11-29T03:11:45.468190+0000 (oldest deadline 2019-11-29T03:12:26.995764+0000) 2019-11-29T03:13:13.837 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:13:13.830+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 43sec e214 v214) 2019-11-29T03:13:13.900 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:13:13.896+0000 1694c700 -1 osd.3 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:11:57.745199+0000 (oldest deadline 2019-11-29T03:12:37.745199+0000) 2019-11-29T03:13:13.901 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:13:13.897+0000 1694c700 -1 osd.3 214 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e212) 2019-11-29T03:13:13.951 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:13:13.945+0000 1694c700 -1 osd.7 214 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:11:45.089895+0000 front 2019-11-29T03:11:45.087384+0000 (oldest deadline 2019-11-29T03:12:26.887810+0000) 2019-11-29T03:13:18.957 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:27:01.174 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:13:19.000 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:27:01.217 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:13:19.028 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:27:01.257 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:13:19.029 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:27:01.248 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:13:19.037 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:27:01.256 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:13:19.039 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:27:01.268 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:13:19.150 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:27:01.368 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:13:19.168 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:27:01.387 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:13:19.242 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:27:01.470 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:13:41.585 INFO:teuthology.orchestra.run.smithi074.stderr:testIfModifiedSince (test.functional.tests.TestFileComparison) ... ok 2019-11-29T03:13:45.665 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:13:45.585+0000 32785700 -1 osd.5 220 build_incremental_map_msg missing incremental map 220 2019-11-29T03:13:45.741 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:13:45.600+0000 32785700 -1 osd.5 220 build_incremental_map_msg missing incremental map 220 2019-11-29T03:13:45.886 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:13:45.725+0000 31783700 -1 osd.5 220 build_incremental_map_msg missing incremental map 220 2019-11-29T03:13:45.951 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:13:45.839+0000 30f82700 -1 osd.5 220 build_incremental_map_msg missing incremental map 220 2019-11-29T03:13:46.048 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:13:45.948+0000 32f86700 -1 osd.5 220 build_incremental_map_msg missing incremental map 220 2019-11-29T03:13:46.053 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:13:45.992+0000 32f86700 -1 osd.5 220 build_incremental_map_msg missing incremental map 220 2019-11-29T03:13:46.070 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:13:46.003+0000 32785700 -1 osd.5 220 build_incremental_map_msg missing incremental map 220 2019-11-29T03:14:04.005 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:14:03.993+0000 37f90700 -1 osd.5 220 build_incremental_map_msg missing incremental map 220 2019-11-29T03:14:16.838 INFO:teuthology.orchestra.run.smithi074.stderr:testIfNoneMatch (test.functional.tests.TestFileComparison) ... ok 2019-11-29T03:14:34.893 INFO:teuthology.orchestra.run.smithi074.stderr:testIfUnmodifiedSince (test.functional.tests.TestFileComparison) ... ok 2019-11-29T03:14:43.295 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:14:43.289+0000 1694c700 -1 osd.7 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:03.319187+0000 front 2019-11-29T03:14:01.051962+0000 (oldest deadline 2019-11-29T03:14:43.020024+0000) 2019-11-29T03:14:43.477 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:14:43.471+0000 1694c700 -1 osd.4 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.814852+0000 front 2019-11-29T03:13:58.822962+0000 (oldest deadline 2019-11-29T03:14:43.433628+0000) 2019-11-29T03:14:43.743 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:14:43.736+0000 1694c700 -1 osd.5 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.663857+0000 front 2019-11-29T03:13:59.267128+0000 (oldest deadline 2019-11-29T03:14:43.316789+0000) 2019-11-29T03:14:44.140 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:14:44.136+0000 1694c700 -1 osd.2 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.210122+0000 front 2019-11-29T03:13:58.207924+0000 (oldest deadline 2019-11-29T03:14:43.482546+0000) 2019-11-29T03:14:44.301 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:14:44.296+0000 1694c700 -1 osd.7 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:03.319187+0000 front 2019-11-29T03:14:01.051962+0000 (oldest deadline 2019-11-29T03:14:43.020024+0000) 2019-11-29T03:14:44.503 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:14:44.497+0000 1694c700 -1 osd.4 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.814852+0000 front 2019-11-29T03:13:58.822962+0000 (oldest deadline 2019-11-29T03:14:43.433628+0000) 2019-11-29T03:14:44.778 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:14:44.773+0000 1694c700 -1 osd.5 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.663857+0000 front 2019-11-29T03:13:59.267128+0000 (oldest deadline 2019-11-29T03:14:43.316789+0000) 2019-11-29T03:14:45.063 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:14:45.059+0000 1694c700 -1 osd.1 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:59.408529+0000 front 2019-11-29T03:13:59.403068+0000 (oldest deadline 2019-11-29T03:14:44.060736+0000) 2019-11-29T03:14:45.121 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:14:45.117+0000 1694c700 -1 osd.2 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.210122+0000 front 2019-11-29T03:13:58.207924+0000 (oldest deadline 2019-11-29T03:14:43.482546+0000) 2019-11-29T03:14:45.140 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:14:45.133+0000 1694c700 -1 osd.6 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:02.515387+0000 front 2019-11-29T03:14:02.575337+0000 (oldest deadline 2019-11-29T03:14:44.683360+0000) 2019-11-29T03:14:45.342 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:14:45.336+0000 1694c700 -1 osd.7 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:03.319187+0000 front 2019-11-29T03:14:01.051962+0000 (oldest deadline 2019-11-29T03:14:43.020024+0000) 2019-11-29T03:14:45.485 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:14:45.478+0000 1694c700 -1 osd.4 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.814852+0000 front 2019-11-29T03:13:58.822962+0000 (oldest deadline 2019-11-29T03:14:43.433628+0000) 2019-11-29T03:14:45.503 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:14:45.498+0000 1694c700 -1 osd.0 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.744452+0000 front 2019-11-29T03:13:59.326943+0000 (oldest deadline 2019-11-29T03:14:44.628567+0000) 2019-11-29T03:14:45.771 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:14:45.764+0000 1694c700 -1 osd.5 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.663857+0000 front 2019-11-29T03:13:59.267128+0000 (oldest deadline 2019-11-29T03:14:43.316789+0000) 2019-11-29T03:14:46.033 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:14:46.027+0000 1694c700 -1 osd.1 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:59.408529+0000 front 2019-11-29T03:13:59.403068+0000 (oldest deadline 2019-11-29T03:14:44.060736+0000) 2019-11-29T03:14:46.117 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:14:46.111+0000 1694c700 -1 osd.6 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:02.515387+0000 front 2019-11-29T03:14:02.575337+0000 (oldest deadline 2019-11-29T03:14:44.683360+0000) 2019-11-29T03:14:46.146 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:14:46.142+0000 1694c700 -1 osd.2 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.210122+0000 front 2019-11-29T03:13:58.207924+0000 (oldest deadline 2019-11-29T03:14:43.482546+0000) 2019-11-29T03:14:46.314 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:14:46.307+0000 1694c700 -1 osd.7 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:03.319187+0000 front 2019-11-29T03:14:01.051962+0000 (oldest deadline 2019-11-29T03:14:43.020024+0000) 2019-11-29T03:14:46.496 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:14:46.488+0000 1694c700 -1 osd.4 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.814852+0000 front 2019-11-29T03:13:58.822962+0000 (oldest deadline 2019-11-29T03:14:43.433628+0000) 2019-11-29T03:14:46.501 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:14:46.497+0000 1694c700 -1 osd.0 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.744452+0000 front 2019-11-29T03:13:59.326943+0000 (oldest deadline 2019-11-29T03:14:44.628567+0000) 2019-11-29T03:14:46.788 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:14:46.781+0000 1694c700 -1 osd.5 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.663857+0000 front 2019-11-29T03:13:59.267128+0000 (oldest deadline 2019-11-29T03:14:43.316789+0000) 2019-11-29T03:14:46.996 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:14:46.992+0000 1694c700 -1 osd.1 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:59.408529+0000 front 2019-11-29T03:13:59.403068+0000 (oldest deadline 2019-11-29T03:14:44.060736+0000) 2019-11-29T03:14:47.131 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:14:47.128+0000 1694c700 -1 osd.2 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.210122+0000 front 2019-11-29T03:13:58.207924+0000 (oldest deadline 2019-11-29T03:14:43.482546+0000) 2019-11-29T03:14:47.144 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:14:47.137+0000 1694c700 -1 osd.6 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:02.515387+0000 front 2019-11-29T03:14:02.575337+0000 (oldest deadline 2019-11-29T03:14:44.683360+0000) 2019-11-29T03:14:47.282 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:14:47.276+0000 1694c700 -1 osd.7 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:03.319187+0000 front 2019-11-29T03:14:01.051962+0000 (oldest deadline 2019-11-29T03:14:43.020024+0000) 2019-11-29T03:14:47.507 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:14:47.503+0000 1694c700 -1 osd.0 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.744452+0000 front 2019-11-29T03:13:59.326943+0000 (oldest deadline 2019-11-29T03:14:44.628567+0000) 2019-11-29T03:14:47.538 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:14:47.532+0000 1694c700 -1 osd.4 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.814852+0000 front 2019-11-29T03:13:58.822962+0000 (oldest deadline 2019-11-29T03:14:43.433628+0000) 2019-11-29T03:14:47.815 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:14:47.808+0000 1694c700 -1 osd.5 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.663857+0000 front 2019-11-29T03:13:59.267128+0000 (oldest deadline 2019-11-29T03:14:43.316789+0000) 2019-11-29T03:14:48.050 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:14:48.045+0000 1694c700 -1 osd.1 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:59.408529+0000 front 2019-11-29T03:13:59.403068+0000 (oldest deadline 2019-11-29T03:14:44.060736+0000) 2019-11-29T03:14:48.103 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:14:48.097+0000 1694c700 -1 osd.6 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:02.515387+0000 front 2019-11-29T03:14:02.575337+0000 (oldest deadline 2019-11-29T03:14:44.683360+0000) 2019-11-29T03:14:48.145 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:14:48.142+0000 1694c700 -1 osd.2 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.210122+0000 front 2019-11-29T03:13:58.207924+0000 (oldest deadline 2019-11-29T03:14:43.482546+0000) 2019-11-29T03:14:48.301 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:14:48.295+0000 1694c700 -1 osd.7 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:03.319187+0000 front 2019-11-29T03:14:01.051962+0000 (oldest deadline 2019-11-29T03:14:43.020024+0000) 2019-11-29T03:14:48.541 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:14:48.535+0000 1694c700 -1 osd.4 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.814852+0000 front 2019-11-29T03:13:58.822962+0000 (oldest deadline 2019-11-29T03:14:43.433628+0000) 2019-11-29T03:14:48.542 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:14:48.539+0000 1694c700 -1 osd.0 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.744452+0000 front 2019-11-29T03:13:59.326943+0000 (oldest deadline 2019-11-29T03:14:44.628567+0000) 2019-11-29T03:14:48.860 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:14:48.853+0000 1694c700 -1 osd.5 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.663857+0000 front 2019-11-29T03:13:59.267128+0000 (oldest deadline 2019-11-29T03:14:43.316789+0000) 2019-11-29T03:14:49.077 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:14:49.072+0000 1694c700 -1 osd.6 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:02.515387+0000 front 2019-11-29T03:14:02.575337+0000 (oldest deadline 2019-11-29T03:14:44.683360+0000) 2019-11-29T03:14:49.089 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:14:49.086+0000 1694c700 -1 osd.1 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:59.408529+0000 front 2019-11-29T03:13:59.403068+0000 (oldest deadline 2019-11-29T03:14:44.060736+0000) 2019-11-29T03:14:49.129 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:14:49.126+0000 1694c700 -1 osd.2 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.210122+0000 front 2019-11-29T03:13:58.207924+0000 (oldest deadline 2019-11-29T03:14:43.482546+0000) 2019-11-29T03:14:49.304 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:14:49.299+0000 1694c700 -1 osd.7 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:03.319187+0000 front 2019-11-29T03:14:01.051962+0000 (oldest deadline 2019-11-29T03:14:43.020024+0000) 2019-11-29T03:14:49.572 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:14:49.566+0000 1694c700 -1 osd.4 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.814852+0000 front 2019-11-29T03:13:58.822962+0000 (oldest deadline 2019-11-29T03:14:43.433628+0000) 2019-11-29T03:14:49.590 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:14:49.585+0000 1694c700 -1 osd.0 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.744452+0000 front 2019-11-29T03:13:59.326943+0000 (oldest deadline 2019-11-29T03:14:44.628567+0000) 2019-11-29T03:14:49.869 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:14:49.863+0000 1694c700 -1 osd.5 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.663857+0000 front 2019-11-29T03:13:59.267128+0000 (oldest deadline 2019-11-29T03:14:43.316789+0000) 2019-11-29T03:14:50.044 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:14:50.038+0000 1694c700 -1 osd.6 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:02.515387+0000 front 2019-11-29T03:14:02.575337+0000 (oldest deadline 2019-11-29T03:14:44.683360+0000) 2019-11-29T03:14:50.107 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:14:50.103+0000 1694c700 -1 osd.2 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.210122+0000 front 2019-11-29T03:13:58.207924+0000 (oldest deadline 2019-11-29T03:14:43.482546+0000) 2019-11-29T03:14:50.124 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:14:50.120+0000 1694c700 -1 osd.1 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:59.408529+0000 front 2019-11-29T03:13:59.403068+0000 (oldest deadline 2019-11-29T03:14:44.060736+0000) 2019-11-29T03:14:50.316 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:14:50.310+0000 1694c700 -1 osd.7 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:03.319187+0000 front 2019-11-29T03:14:01.051962+0000 (oldest deadline 2019-11-29T03:14:43.020024+0000) 2019-11-29T03:14:50.537 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:14:50.532+0000 1694c700 -1 osd.4 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.814852+0000 front 2019-11-29T03:13:58.822962+0000 (oldest deadline 2019-11-29T03:14:43.433628+0000) 2019-11-29T03:14:50.587 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:14:50.582+0000 1694c700 -1 osd.0 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.744452+0000 front 2019-11-29T03:13:59.326943+0000 (oldest deadline 2019-11-29T03:14:44.628567+0000) 2019-11-29T03:14:50.833 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:14:50.828+0000 1694c700 -1 osd.5 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.663857+0000 front 2019-11-29T03:13:59.267128+0000 (oldest deadline 2019-11-29T03:14:43.316789+0000) 2019-11-29T03:14:51.041 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:14:51.036+0000 1694c700 -1 osd.6 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:02.515387+0000 front 2019-11-29T03:14:02.575337+0000 (oldest deadline 2019-11-29T03:14:44.683360+0000) 2019-11-29T03:14:51.077 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:14:51.074+0000 1694c700 -1 osd.2 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.210122+0000 front 2019-11-29T03:13:58.207924+0000 (oldest deadline 2019-11-29T03:14:43.482546+0000) 2019-11-29T03:14:51.140 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:14:51.137+0000 1694c700 -1 osd.1 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:59.408529+0000 front 2019-11-29T03:13:59.403068+0000 (oldest deadline 2019-11-29T03:14:44.060736+0000) 2019-11-29T03:14:51.322 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:14:51.317+0000 1694c700 -1 osd.7 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:03.319187+0000 front 2019-11-29T03:14:01.051962+0000 (oldest deadline 2019-11-29T03:14:43.020024+0000) 2019-11-29T03:14:51.540 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:14:51.535+0000 1694c700 -1 osd.4 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.814852+0000 front 2019-11-29T03:13:58.822962+0000 (oldest deadline 2019-11-29T03:14:43.433628+0000) 2019-11-29T03:14:51.618 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:14:51.615+0000 1694c700 -1 osd.0 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.744452+0000 front 2019-11-29T03:13:59.326943+0000 (oldest deadline 2019-11-29T03:14:44.628567+0000) 2019-11-29T03:14:51.799 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:14:51.793+0000 1694c700 -1 osd.5 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.663857+0000 front 2019-11-29T03:13:59.267128+0000 (oldest deadline 2019-11-29T03:14:43.316789+0000) 2019-11-29T03:14:52.013 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:14:52.007+0000 1694c700 -1 osd.6 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:02.515387+0000 front 2019-11-29T03:14:02.575337+0000 (oldest deadline 2019-11-29T03:14:44.683360+0000) 2019-11-29T03:14:52.065 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:14:52.062+0000 1694c700 -1 osd.2 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.210122+0000 front 2019-11-29T03:13:58.207924+0000 (oldest deadline 2019-11-29T03:14:43.482546+0000) 2019-11-29T03:14:52.180 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:14:52.175+0000 1694c700 -1 osd.1 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:59.408529+0000 front 2019-11-29T03:13:59.403068+0000 (oldest deadline 2019-11-29T03:14:44.060736+0000) 2019-11-29T03:14:52.307 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:14:52.300+0000 1694c700 -1 osd.7 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:03.319187+0000 front 2019-11-29T03:14:01.051962+0000 (oldest deadline 2019-11-29T03:14:43.020024+0000) 2019-11-29T03:14:52.590 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:14:52.585+0000 1694c700 -1 osd.4 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.814852+0000 front 2019-11-29T03:13:58.822962+0000 (oldest deadline 2019-11-29T03:14:43.433628+0000) 2019-11-29T03:14:52.640 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:14:52.637+0000 1694c700 -1 osd.0 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.744452+0000 front 2019-11-29T03:13:59.326943+0000 (oldest deadline 2019-11-29T03:14:44.628567+0000) 2019-11-29T03:14:52.823 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:14:52.817+0000 1694c700 -1 osd.5 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.663857+0000 front 2019-11-29T03:13:59.267128+0000 (oldest deadline 2019-11-29T03:14:43.316789+0000) 2019-11-29T03:14:53.029 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:14:53.027+0000 1694c700 -1 osd.2 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.210122+0000 front 2019-11-29T03:13:58.207924+0000 (oldest deadline 2019-11-29T03:14:43.482546+0000) 2019-11-29T03:14:53.050 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:14:53.045+0000 1694c700 -1 osd.6 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:02.515387+0000 front 2019-11-29T03:14:02.575337+0000 (oldest deadline 2019-11-29T03:14:44.683360+0000) 2019-11-29T03:14:53.231 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:14:53.228+0000 1694c700 -1 osd.1 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:59.408529+0000 front 2019-11-29T03:13:59.403068+0000 (oldest deadline 2019-11-29T03:14:44.060736+0000) 2019-11-29T03:14:53.278 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:14:53.272+0000 1694c700 -1 osd.7 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:03.319187+0000 front 2019-11-29T03:14:01.051962+0000 (oldest deadline 2019-11-29T03:14:43.020024+0000) 2019-11-29T03:14:53.573 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:14:53.565+0000 1694c700 -1 osd.4 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.814852+0000 front 2019-11-29T03:13:58.822962+0000 (oldest deadline 2019-11-29T03:14:43.433628+0000) 2019-11-29T03:14:53.613 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:14:53.611+0000 1694c700 -1 osd.0 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.744452+0000 front 2019-11-29T03:13:59.326943+0000 (oldest deadline 2019-11-29T03:14:44.628567+0000) 2019-11-29T03:14:53.840 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:14:53.834+0000 1694c700 -1 osd.5 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.663857+0000 front 2019-11-29T03:13:59.267128+0000 (oldest deadline 2019-11-29T03:14:43.316789+0000) 2019-11-29T03:14:54.020 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:14:54.016+0000 1694c700 -1 osd.2 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.210122+0000 front 2019-11-29T03:13:58.207924+0000 (oldest deadline 2019-11-29T03:14:43.482546+0000) 2019-11-29T03:14:54.070 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:14:54.064+0000 1694c700 -1 osd.6 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:02.515387+0000 front 2019-11-29T03:14:02.575337+0000 (oldest deadline 2019-11-29T03:14:44.683360+0000) 2019-11-29T03:14:54.217 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:14:54.214+0000 1694c700 -1 osd.1 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:59.408529+0000 front 2019-11-29T03:13:59.403068+0000 (oldest deadline 2019-11-29T03:14:44.060736+0000) 2019-11-29T03:14:54.260 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:14:54.254+0000 1694c700 -1 osd.7 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:03.319187+0000 front 2019-11-29T03:14:01.051962+0000 (oldest deadline 2019-11-29T03:14:43.020024+0000) 2019-11-29T03:14:54.530 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:14:54.524+0000 1694c700 -1 osd.4 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.814852+0000 front 2019-11-29T03:13:58.822962+0000 (oldest deadline 2019-11-29T03:14:43.433628+0000) 2019-11-29T03:14:54.668 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:14:54.665+0000 1694c700 -1 osd.0 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.744452+0000 front 2019-11-29T03:13:59.326943+0000 (oldest deadline 2019-11-29T03:14:44.628567+0000) 2019-11-29T03:14:54.892 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:14:54.887+0000 1694c700 -1 osd.5 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.663857+0000 front 2019-11-29T03:13:59.267128+0000 (oldest deadline 2019-11-29T03:14:43.316789+0000) 2019-11-29T03:14:54.985 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:14:54.982+0000 1694c700 -1 osd.2 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.210122+0000 front 2019-11-29T03:13:58.207924+0000 (oldest deadline 2019-11-29T03:14:43.482546+0000) 2019-11-29T03:14:55.119 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:14:55.113+0000 1694c700 -1 osd.6 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:02.515387+0000 front 2019-11-29T03:14:02.575337+0000 (oldest deadline 2019-11-29T03:14:44.683360+0000) 2019-11-29T03:14:55.207 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:14:55.203+0000 1694c700 -1 osd.1 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:59.408529+0000 front 2019-11-29T03:13:59.403068+0000 (oldest deadline 2019-11-29T03:14:44.060736+0000) 2019-11-29T03:14:55.241 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:14:55.235+0000 1694c700 -1 osd.7 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:03.319187+0000 front 2019-11-29T03:14:01.051962+0000 (oldest deadline 2019-11-29T03:14:43.020024+0000) 2019-11-29T03:14:55.523 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:14:55.518+0000 1694c700 -1 osd.4 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.814852+0000 front 2019-11-29T03:13:58.822962+0000 (oldest deadline 2019-11-29T03:14:43.433628+0000) 2019-11-29T03:14:55.705 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:14:55.702+0000 1694c700 -1 osd.0 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.744452+0000 front 2019-11-29T03:13:59.326943+0000 (oldest deadline 2019-11-29T03:14:44.628567+0000) 2019-11-29T03:14:55.900 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:14:55.895+0000 1694c700 -1 osd.5 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.663857+0000 front 2019-11-29T03:13:59.267128+0000 (oldest deadline 2019-11-29T03:14:43.316789+0000) 2019-11-29T03:14:55.979 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:14:55.976+0000 1694c700 -1 osd.2 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.210122+0000 front 2019-11-29T03:13:58.207924+0000 (oldest deadline 2019-11-29T03:14:43.482546+0000) 2019-11-29T03:14:56.136 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:14:56.131+0000 1694c700 -1 osd.6 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:02.515387+0000 front 2019-11-29T03:14:02.575337+0000 (oldest deadline 2019-11-29T03:14:44.683360+0000) 2019-11-29T03:14:56.251 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:14:56.248+0000 1694c700 -1 osd.1 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:59.408529+0000 front 2019-11-29T03:13:59.403068+0000 (oldest deadline 2019-11-29T03:14:44.060736+0000) 2019-11-29T03:14:56.263 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:14:56.257+0000 1694c700 -1 osd.7 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:03.319187+0000 front 2019-11-29T03:14:01.051962+0000 (oldest deadline 2019-11-29T03:14:43.020024+0000) 2019-11-29T03:14:56.542 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:14:56.537+0000 1694c700 -1 osd.4 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.814852+0000 front 2019-11-29T03:13:58.822962+0000 (oldest deadline 2019-11-29T03:14:43.433628+0000) 2019-11-29T03:14:56.695 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:14:56.693+0000 1694c700 -1 osd.0 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.744452+0000 front 2019-11-29T03:13:59.326943+0000 (oldest deadline 2019-11-29T03:14:44.628567+0000) 2019-11-29T03:14:56.875 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:14:56.870+0000 1694c700 -1 osd.5 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.663857+0000 front 2019-11-29T03:13:59.267128+0000 (oldest deadline 2019-11-29T03:14:43.316789+0000) 2019-11-29T03:14:57.019 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:14:57.016+0000 1694c700 -1 osd.2 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.210122+0000 front 2019-11-29T03:13:58.207924+0000 (oldest deadline 2019-11-29T03:14:43.482546+0000) 2019-11-29T03:14:57.178 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:14:57.172+0000 1694c700 -1 osd.6 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:02.515387+0000 front 2019-11-29T03:14:02.575337+0000 (oldest deadline 2019-11-29T03:14:44.683360+0000) 2019-11-29T03:14:57.256 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:14:57.250+0000 1694c700 -1 osd.7 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:03.319187+0000 front 2019-11-29T03:14:01.051962+0000 (oldest deadline 2019-11-29T03:14:43.020024+0000) 2019-11-29T03:14:57.305 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:14:57.301+0000 1694c700 -1 osd.1 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:59.408529+0000 front 2019-11-29T03:13:59.403068+0000 (oldest deadline 2019-11-29T03:14:44.060736+0000) 2019-11-29T03:14:57.522 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:14:57.516+0000 1694c700 -1 osd.4 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.814852+0000 front 2019-11-29T03:13:58.822962+0000 (oldest deadline 2019-11-29T03:14:43.433628+0000) 2019-11-29T03:14:57.712 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:14:57.710+0000 1694c700 -1 osd.0 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.744452+0000 front 2019-11-29T03:13:59.326943+0000 (oldest deadline 2019-11-29T03:14:44.628567+0000) 2019-11-29T03:14:57.855 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:14:57.849+0000 1694c700 -1 osd.5 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.663857+0000 front 2019-11-29T03:13:59.267128+0000 (oldest deadline 2019-11-29T03:14:43.316789+0000) 2019-11-29T03:14:57.987 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:14:57.984+0000 1694c700 -1 osd.2 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.210122+0000 front 2019-11-29T03:13:58.207924+0000 (oldest deadline 2019-11-29T03:14:43.482546+0000) 2019-11-29T03:14:58.203 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:14:58.197+0000 1694c700 -1 osd.6 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:02.515387+0000 front 2019-11-29T03:14:02.575337+0000 (oldest deadline 2019-11-29T03:14:44.683360+0000) 2019-11-29T03:14:58.221 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:14:58.215+0000 1694c700 -1 osd.7 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:03.319187+0000 front 2019-11-29T03:14:01.051962+0000 (oldest deadline 2019-11-29T03:14:43.020024+0000) 2019-11-29T03:14:58.341 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:14:58.339+0000 1694c700 -1 osd.1 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:59.408529+0000 front 2019-11-29T03:13:59.403068+0000 (oldest deadline 2019-11-29T03:14:44.060736+0000) 2019-11-29T03:14:58.544 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:14:58.534+0000 1694c700 -1 osd.4 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.814852+0000 front 2019-11-29T03:13:58.822962+0000 (oldest deadline 2019-11-29T03:14:43.433628+0000) 2019-11-29T03:14:58.720 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:14:58.717+0000 1694c700 -1 osd.0 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.744452+0000 front 2019-11-29T03:13:59.326943+0000 (oldest deadline 2019-11-29T03:14:44.628567+0000) 2019-11-29T03:14:58.899 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:14:58.893+0000 1694c700 -1 osd.5 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.663857+0000 front 2019-11-29T03:13:59.267128+0000 (oldest deadline 2019-11-29T03:14:43.316789+0000) 2019-11-29T03:14:59.062 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:14:59.045+0000 1694c700 -1 osd.2 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.210122+0000 front 2019-11-29T03:13:58.207924+0000 (oldest deadline 2019-11-29T03:14:43.482546+0000) 2019-11-29T03:14:59.197 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:14:59.191+0000 1694c700 -1 osd.6 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:02.515387+0000 front 2019-11-29T03:14:02.575337+0000 (oldest deadline 2019-11-29T03:14:44.683360+0000) 2019-11-29T03:14:59.224 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:14:59.218+0000 1694c700 -1 osd.7 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:03.319187+0000 front 2019-11-29T03:14:01.051962+0000 (oldest deadline 2019-11-29T03:14:43.020024+0000) 2019-11-29T03:14:59.298 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:14:59.295+0000 1694c700 -1 osd.1 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:59.408529+0000 front 2019-11-29T03:13:59.403068+0000 (oldest deadline 2019-11-29T03:14:44.060736+0000) 2019-11-29T03:14:59.571 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:14:59.565+0000 1694c700 -1 osd.4 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.814852+0000 front 2019-11-29T03:13:58.822962+0000 (oldest deadline 2019-11-29T03:14:43.433628+0000) 2019-11-29T03:14:59.740 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:14:59.738+0000 1694c700 -1 osd.0 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.744452+0000 front 2019-11-29T03:13:59.326943+0000 (oldest deadline 2019-11-29T03:14:44.628567+0000) 2019-11-29T03:14:59.932 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:14:59.927+0000 1694c700 -1 osd.5 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.663857+0000 front 2019-11-29T03:13:59.267128+0000 (oldest deadline 2019-11-29T03:14:43.316789+0000) 2019-11-29T03:15:00.027 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:15:00.025+0000 1694c700 -1 osd.2 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.210122+0000 front 2019-11-29T03:13:58.207924+0000 (oldest deadline 2019-11-29T03:14:43.482546+0000) 2019-11-29T03:15:00.195 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:15:00.189+0000 1694c700 -1 osd.6 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:02.515387+0000 front 2019-11-29T03:14:02.575337+0000 (oldest deadline 2019-11-29T03:14:44.683360+0000) 2019-11-29T03:15:00.241 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:15:00.236+0000 1694c700 -1 osd.7 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:03.319187+0000 front 2019-11-29T03:14:01.051962+0000 (oldest deadline 2019-11-29T03:14:43.020024+0000) 2019-11-29T03:15:00.269 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:15:00.266+0000 1694c700 -1 osd.1 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:59.408529+0000 front 2019-11-29T03:13:59.403068+0000 (oldest deadline 2019-11-29T03:14:44.060736+0000) 2019-11-29T03:15:00.582 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:15:00.568+0000 1694c700 -1 osd.4 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.814852+0000 front 2019-11-29T03:13:58.822962+0000 (oldest deadline 2019-11-29T03:14:43.433628+0000) 2019-11-29T03:15:00.763 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:15:00.760+0000 1694c700 -1 osd.0 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.744452+0000 front 2019-11-29T03:13:59.326943+0000 (oldest deadline 2019-11-29T03:14:44.628567+0000) 2019-11-29T03:15:00.956 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:15:00.951+0000 1694c700 -1 osd.5 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.663857+0000 front 2019-11-29T03:13:59.267128+0000 (oldest deadline 2019-11-29T03:14:43.316789+0000) 2019-11-29T03:15:01.040 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:15:01.026+0000 1694c700 -1 osd.2 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.210122+0000 front 2019-11-29T03:13:58.207924+0000 (oldest deadline 2019-11-29T03:14:43.482546+0000) 2019-11-29T03:15:01.183 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:15:01.177+0000 1694c700 -1 osd.6 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:02.515387+0000 front 2019-11-29T03:14:02.575337+0000 (oldest deadline 2019-11-29T03:14:44.683360+0000) 2019-11-29T03:15:01.229 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:15:01.226+0000 1694c700 -1 osd.1 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:59.408529+0000 front 2019-11-29T03:13:59.403068+0000 (oldest deadline 2019-11-29T03:14:44.060736+0000) 2019-11-29T03:15:01.280 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:15:01.274+0000 1694c700 -1 osd.7 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:03.319187+0000 front 2019-11-29T03:14:01.051962+0000 (oldest deadline 2019-11-29T03:14:43.020024+0000) 2019-11-29T03:15:01.552 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:15:01.547+0000 1694c700 -1 osd.4 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.814852+0000 front 2019-11-29T03:13:58.822962+0000 (oldest deadline 2019-11-29T03:14:43.433628+0000) 2019-11-29T03:15:01.756 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:15:01.753+0000 1694c700 -1 osd.0 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.744452+0000 front 2019-11-29T03:13:59.326943+0000 (oldest deadline 2019-11-29T03:14:44.628567+0000) 2019-11-29T03:15:01.974 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:15:01.968+0000 1694c700 -1 osd.5 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.663857+0000 front 2019-11-29T03:13:59.267128+0000 (oldest deadline 2019-11-29T03:14:43.316789+0000) 2019-11-29T03:15:02.062 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:15:02.060+0000 1694c700 -1 osd.2 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.210122+0000 front 2019-11-29T03:13:58.207924+0000 (oldest deadline 2019-11-29T03:14:43.482546+0000) 2019-11-29T03:15:02.182 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:15:02.171+0000 1694c700 -1 osd.6 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:02.515387+0000 front 2019-11-29T03:14:02.575337+0000 (oldest deadline 2019-11-29T03:14:44.683360+0000) 2019-11-29T03:15:02.236 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:15:02.232+0000 1694c700 -1 osd.1 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:59.408529+0000 front 2019-11-29T03:13:59.403068+0000 (oldest deadline 2019-11-29T03:14:44.060736+0000) 2019-11-29T03:15:02.237 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:15:02.232+0000 1694c700 -1 osd.7 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:03.319187+0000 front 2019-11-29T03:14:01.051962+0000 (oldest deadline 2019-11-29T03:14:43.020024+0000) 2019-11-29T03:15:02.579 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:15:02.573+0000 1694c700 -1 osd.4 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.814852+0000 front 2019-11-29T03:13:58.822962+0000 (oldest deadline 2019-11-29T03:14:43.433628+0000) 2019-11-29T03:15:02.764 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:15:02.761+0000 1694c700 -1 osd.0 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.744452+0000 front 2019-11-29T03:13:59.326943+0000 (oldest deadline 2019-11-29T03:14:44.628567+0000) 2019-11-29T03:15:02.949 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:15:02.942+0000 1694c700 -1 osd.5 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.663857+0000 front 2019-11-29T03:13:59.267128+0000 (oldest deadline 2019-11-29T03:14:43.316789+0000) 2019-11-29T03:15:03.071 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:15:03.067+0000 1694c700 -1 osd.2 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.210122+0000 front 2019-11-29T03:13:58.207924+0000 (oldest deadline 2019-11-29T03:14:43.482546+0000) 2019-11-29T03:15:03.201 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:15:03.186+0000 1694c700 -1 osd.6 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:02.515387+0000 front 2019-11-29T03:14:02.575337+0000 (oldest deadline 2019-11-29T03:14:44.683360+0000) 2019-11-29T03:15:03.253 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:15:03.248+0000 1694c700 -1 osd.7 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:03.319187+0000 front 2019-11-29T03:14:01.051962+0000 (oldest deadline 2019-11-29T03:14:43.020024+0000) 2019-11-29T03:15:03.253 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:15:03.251+0000 1694c700 -1 osd.1 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:59.408529+0000 front 2019-11-29T03:13:59.403068+0000 (oldest deadline 2019-11-29T03:14:44.060736+0000) 2019-11-29T03:15:03.611 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:15:03.605+0000 1694c700 -1 osd.4 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.814852+0000 front 2019-11-29T03:13:58.822962+0000 (oldest deadline 2019-11-29T03:14:43.433628+0000) 2019-11-29T03:15:03.741 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:15:03.738+0000 1694c700 -1 osd.0 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.744452+0000 front 2019-11-29T03:13:59.326943+0000 (oldest deadline 2019-11-29T03:14:44.628567+0000) 2019-11-29T03:15:03.989 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:15:03.984+0000 1694c700 -1 osd.5 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.663857+0000 front 2019-11-29T03:13:59.267128+0000 (oldest deadline 2019-11-29T03:14:43.316789+0000) 2019-11-29T03:15:04.037 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:15:04.035+0000 1694c700 -1 osd.2 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.210122+0000 front 2019-11-29T03:13:58.207924+0000 (oldest deadline 2019-11-29T03:14:43.482546+0000) 2019-11-29T03:15:04.207 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:15:04.201+0000 1694c700 -1 osd.6 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:02.515387+0000 front 2019-11-29T03:14:02.575337+0000 (oldest deadline 2019-11-29T03:14:44.683360+0000) 2019-11-29T03:15:04.253 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:15:04.247+0000 1694c700 -1 osd.7 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:03.319187+0000 front 2019-11-29T03:14:01.051962+0000 (oldest deadline 2019-11-29T03:14:43.020024+0000) 2019-11-29T03:15:04.282 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:15:04.280+0000 1694c700 -1 osd.1 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:59.408529+0000 front 2019-11-29T03:13:59.403068+0000 (oldest deadline 2019-11-29T03:14:44.060736+0000) 2019-11-29T03:15:04.621 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:15:04.616+0000 1694c700 -1 osd.4 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.814852+0000 front 2019-11-29T03:13:58.822962+0000 (oldest deadline 2019-11-29T03:14:43.433628+0000) 2019-11-29T03:15:04.703 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:15:04.700+0000 1694c700 -1 osd.0 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.744452+0000 front 2019-11-29T03:13:59.326943+0000 (oldest deadline 2019-11-29T03:14:44.628567+0000) 2019-11-29T03:15:05.016 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:15:05.010+0000 1694c700 -1 osd.5 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.663857+0000 front 2019-11-29T03:13:59.267128+0000 (oldest deadline 2019-11-29T03:14:43.316789+0000) 2019-11-29T03:15:05.069 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:15:05.067+0000 1694c700 -1 osd.2 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.210122+0000 front 2019-11-29T03:13:58.207924+0000 (oldest deadline 2019-11-29T03:14:43.482546+0000) 2019-11-29T03:15:05.161 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:15:05.156+0000 1694c700 -1 osd.6 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:02.515387+0000 front 2019-11-29T03:14:02.575337+0000 (oldest deadline 2019-11-29T03:14:44.683360+0000) 2019-11-29T03:15:05.253 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:15:05.248+0000 1694c700 -1 osd.7 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:03.319187+0000 front 2019-11-29T03:14:01.051962+0000 (oldest deadline 2019-11-29T03:14:43.020024+0000) 2019-11-29T03:15:05.263 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:15:05.260+0000 1694c700 -1 osd.1 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:59.408529+0000 front 2019-11-29T03:13:59.403068+0000 (oldest deadline 2019-11-29T03:14:44.060736+0000) 2019-11-29T03:15:05.623 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:15:05.617+0000 1694c700 -1 osd.4 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.814852+0000 front 2019-11-29T03:13:58.822962+0000 (oldest deadline 2019-11-29T03:14:43.433628+0000) 2019-11-29T03:15:05.725 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:15:05.713+0000 1694c700 -1 osd.0 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.744452+0000 front 2019-11-29T03:13:59.326943+0000 (oldest deadline 2019-11-29T03:14:44.628567+0000) 2019-11-29T03:15:06.034 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:15:06.030+0000 1694c700 -1 osd.2 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.210122+0000 front 2019-11-29T03:13:58.207924+0000 (oldest deadline 2019-11-29T03:14:43.482546+0000) 2019-11-29T03:15:06.070 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:15:06.061+0000 1694c700 -1 osd.5 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.663857+0000 front 2019-11-29T03:13:59.267128+0000 (oldest deadline 2019-11-29T03:14:43.316789+0000) 2019-11-29T03:15:06.194 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:15:06.188+0000 1694c700 -1 osd.6 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:02.515387+0000 front 2019-11-29T03:14:02.575337+0000 (oldest deadline 2019-11-29T03:14:44.683360+0000) 2019-11-29T03:15:06.254 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:15:06.249+0000 1694c700 -1 osd.7 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:03.319187+0000 front 2019-11-29T03:14:01.051962+0000 (oldest deadline 2019-11-29T03:14:43.020024+0000) 2019-11-29T03:15:06.292 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:15:06.287+0000 1694c700 -1 osd.1 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:59.408529+0000 front 2019-11-29T03:13:59.403068+0000 (oldest deadline 2019-11-29T03:14:44.060736+0000) 2019-11-29T03:15:06.646 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:15:06.640+0000 1694c700 -1 osd.4 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.814852+0000 front 2019-11-29T03:13:58.822962+0000 (oldest deadline 2019-11-29T03:14:43.433628+0000) 2019-11-29T03:15:06.737 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:15:06.734+0000 1694c700 -1 osd.0 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.744452+0000 front 2019-11-29T03:13:59.326943+0000 (oldest deadline 2019-11-29T03:14:44.628567+0000) 2019-11-29T03:15:07.029 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:15:07.025+0000 1694c700 -1 osd.2 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.210122+0000 front 2019-11-29T03:13:58.207924+0000 (oldest deadline 2019-11-29T03:14:43.482546+0000) 2019-11-29T03:15:07.053 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:15:07.047+0000 1694c700 -1 osd.5 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.663857+0000 front 2019-11-29T03:13:59.267128+0000 (oldest deadline 2019-11-29T03:14:43.316789+0000) 2019-11-29T03:15:07.151 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:15:07.146+0000 1694c700 -1 osd.6 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:02.515387+0000 front 2019-11-29T03:14:02.575337+0000 (oldest deadline 2019-11-29T03:14:44.683360+0000) 2019-11-29T03:15:07.248 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:15:07.242+0000 1694c700 -1 osd.7 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:03.319187+0000 front 2019-11-29T03:14:01.051962+0000 (oldest deadline 2019-11-29T03:14:43.020024+0000) 2019-11-29T03:15:07.284 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:15:07.281+0000 1694c700 -1 osd.1 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:59.408529+0000 front 2019-11-29T03:13:59.403068+0000 (oldest deadline 2019-11-29T03:14:44.060736+0000) 2019-11-29T03:15:07.646 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:15:07.640+0000 1694c700 -1 osd.4 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.814852+0000 front 2019-11-29T03:13:58.822962+0000 (oldest deadline 2019-11-29T03:14:43.433628+0000) 2019-11-29T03:15:07.765 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:15:07.760+0000 1694c700 -1 osd.0 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.744452+0000 front 2019-11-29T03:13:59.326943+0000 (oldest deadline 2019-11-29T03:14:44.628567+0000) 2019-11-29T03:15:08.024 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:15:08.018+0000 1694c700 -1 osd.5 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.663857+0000 front 2019-11-29T03:13:59.267128+0000 (oldest deadline 2019-11-29T03:14:43.316789+0000) 2019-11-29T03:15:08.042 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:15:08.038+0000 1694c700 -1 osd.2 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.210122+0000 front 2019-11-29T03:13:58.207924+0000 (oldest deadline 2019-11-29T03:14:43.482546+0000) 2019-11-29T03:15:08.141 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:15:08.135+0000 1694c700 -1 osd.6 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:02.515387+0000 front 2019-11-29T03:14:02.575337+0000 (oldest deadline 2019-11-29T03:14:44.683360+0000) 2019-11-29T03:15:08.282 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:15:08.277+0000 1694c700 -1 osd.7 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:03.319187+0000 front 2019-11-29T03:14:01.051962+0000 (oldest deadline 2019-11-29T03:14:43.020024+0000) 2019-11-29T03:15:08.311 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:15:08.307+0000 1694c700 -1 osd.1 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:59.408529+0000 front 2019-11-29T03:13:59.403068+0000 (oldest deadline 2019-11-29T03:14:44.060736+0000) 2019-11-29T03:15:08.637 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:15:08.632+0000 1694c700 -1 osd.4 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.814852+0000 front 2019-11-29T03:13:58.822962+0000 (oldest deadline 2019-11-29T03:14:43.433628+0000) 2019-11-29T03:15:08.808 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:15:08.804+0000 1694c700 -1 osd.0 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.744452+0000 front 2019-11-29T03:13:59.326943+0000 (oldest deadline 2019-11-29T03:14:44.628567+0000) 2019-11-29T03:15:09.028 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:15:09.022+0000 1694c700 -1 osd.5 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.663857+0000 front 2019-11-29T03:13:59.267128+0000 (oldest deadline 2019-11-29T03:14:43.316789+0000) 2019-11-29T03:15:09.093 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:15:09.088+0000 1694c700 -1 osd.2 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.210122+0000 front 2019-11-29T03:13:58.207924+0000 (oldest deadline 2019-11-29T03:14:43.482546+0000) 2019-11-29T03:15:09.137 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:15:09.132+0000 1694c700 -1 osd.6 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:02.515387+0000 front 2019-11-29T03:14:02.575337+0000 (oldest deadline 2019-11-29T03:14:44.683360+0000) 2019-11-29T03:15:09.336 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:15:09.331+0000 1694c700 -1 osd.7 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:03.319187+0000 front 2019-11-29T03:14:01.051962+0000 (oldest deadline 2019-11-29T03:14:43.020024+0000) 2019-11-29T03:15:09.364 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:15:09.359+0000 1694c700 -1 osd.1 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:59.408529+0000 front 2019-11-29T03:13:59.403068+0000 (oldest deadline 2019-11-29T03:14:44.060736+0000) 2019-11-29T03:15:09.670 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:15:09.665+0000 1694c700 -1 osd.4 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.814852+0000 front 2019-11-29T03:13:58.822962+0000 (oldest deadline 2019-11-29T03:14:43.433628+0000) 2019-11-29T03:15:09.841 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:15:09.837+0000 1694c700 -1 osd.0 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.744452+0000 front 2019-11-29T03:13:59.326943+0000 (oldest deadline 2019-11-29T03:14:44.628567+0000) 2019-11-29T03:15:10.072 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:15:10.066+0000 1694c700 -1 osd.5 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.663857+0000 front 2019-11-29T03:13:59.267128+0000 (oldest deadline 2019-11-29T03:14:43.316789+0000) 2019-11-29T03:15:10.113 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:15:10.107+0000 1694c700 -1 osd.6 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:02.515387+0000 front 2019-11-29T03:14:02.575337+0000 (oldest deadline 2019-11-29T03:14:44.683360+0000) 2019-11-29T03:15:10.140 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:15:10.134+0000 1694c700 -1 osd.2 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.210122+0000 front 2019-11-29T03:13:58.207924+0000 (oldest deadline 2019-11-29T03:14:43.482546+0000) 2019-11-29T03:15:10.325 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:15:10.319+0000 1694c700 -1 osd.7 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:03.319187+0000 front 2019-11-29T03:14:01.051962+0000 (oldest deadline 2019-11-29T03:14:43.020024+0000) 2019-11-29T03:15:10.345 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:15:10.341+0000 1694c700 -1 osd.1 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:59.408529+0000 front 2019-11-29T03:13:59.403068+0000 (oldest deadline 2019-11-29T03:14:44.060736+0000) 2019-11-29T03:15:10.659 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:15:10.654+0000 1694c700 -1 osd.4 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.814852+0000 front 2019-11-29T03:13:58.822962+0000 (oldest deadline 2019-11-29T03:14:43.433628+0000) 2019-11-29T03:15:10.892 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:15:10.887+0000 1694c700 -1 osd.0 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.744452+0000 front 2019-11-29T03:13:59.326943+0000 (oldest deadline 2019-11-29T03:14:44.628567+0000) 2019-11-29T03:15:11.045 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:15:11.040+0000 1694c700 -1 osd.5 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.663857+0000 front 2019-11-29T03:13:59.267128+0000 (oldest deadline 2019-11-29T03:14:43.316789+0000) 2019-11-29T03:15:11.124 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:15:11.118+0000 1694c700 -1 osd.6 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:02.515387+0000 front 2019-11-29T03:14:02.575337+0000 (oldest deadline 2019-11-29T03:14:44.683360+0000) 2019-11-29T03:15:11.176 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:15:11.171+0000 1694c700 -1 osd.2 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.210122+0000 front 2019-11-29T03:13:58.207924+0000 (oldest deadline 2019-11-29T03:14:43.482546+0000) 2019-11-29T03:15:11.308 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:15:11.302+0000 1694c700 -1 osd.7 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:03.319187+0000 front 2019-11-29T03:14:01.051962+0000 (oldest deadline 2019-11-29T03:14:43.020024+0000) 2019-11-29T03:15:11.331 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:15:11.327+0000 1694c700 -1 osd.1 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:59.408529+0000 front 2019-11-29T03:13:59.403068+0000 (oldest deadline 2019-11-29T03:14:44.060736+0000) 2019-11-29T03:15:11.682 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:15:11.677+0000 1694c700 -1 osd.4 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.814852+0000 front 2019-11-29T03:13:58.822962+0000 (oldest deadline 2019-11-29T03:14:43.433628+0000) 2019-11-29T03:15:11.918 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:15:11.913+0000 1694c700 -1 osd.0 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.744452+0000 front 2019-11-29T03:13:59.326943+0000 (oldest deadline 2019-11-29T03:14:44.628567+0000) 2019-11-29T03:15:12.087 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:15:12.081+0000 1694c700 -1 osd.5 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.663857+0000 front 2019-11-29T03:13:59.267128+0000 (oldest deadline 2019-11-29T03:14:43.316789+0000) 2019-11-29T03:15:12.167 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:15:12.162+0000 1694c700 -1 osd.6 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:02.515387+0000 front 2019-11-29T03:14:02.575337+0000 (oldest deadline 2019-11-29T03:14:44.683360+0000) 2019-11-29T03:15:12.212 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:15:12.208+0000 1694c700 -1 osd.2 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.210122+0000 front 2019-11-29T03:13:58.207924+0000 (oldest deadline 2019-11-29T03:14:43.482546+0000) 2019-11-29T03:15:12.309 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:15:12.303+0000 1694c700 -1 osd.7 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:03.319187+0000 front 2019-11-29T03:14:01.051962+0000 (oldest deadline 2019-11-29T03:14:43.020024+0000) 2019-11-29T03:15:12.322 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:15:12.318+0000 1694c700 -1 osd.1 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:59.408529+0000 front 2019-11-29T03:13:59.403068+0000 (oldest deadline 2019-11-29T03:14:44.060736+0000) 2019-11-29T03:15:12.646 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:15:12.641+0000 1694c700 -1 osd.4 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.814852+0000 front 2019-11-29T03:13:58.822962+0000 (oldest deadline 2019-11-29T03:14:43.433628+0000) 2019-11-29T03:15:12.916 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:15:12.912+0000 1694c700 -1 osd.0 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.744452+0000 front 2019-11-29T03:13:59.326943+0000 (oldest deadline 2019-11-29T03:14:44.628567+0000) 2019-11-29T03:15:13.124 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:15:13.119+0000 1694c700 -1 osd.5 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.663857+0000 front 2019-11-29T03:13:59.267128+0000 (oldest deadline 2019-11-29T03:14:43.316789+0000) 2019-11-29T03:15:13.166 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:15:13.162+0000 1694c700 -1 osd.2 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.210122+0000 front 2019-11-29T03:13:58.207924+0000 (oldest deadline 2019-11-29T03:14:43.482546+0000) 2019-11-29T03:15:13.195 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:15:13.189+0000 1694c700 -1 osd.6 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:02.515387+0000 front 2019-11-29T03:14:02.575337+0000 (oldest deadline 2019-11-29T03:14:44.683360+0000) 2019-11-29T03:15:13.283 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:15:13.277+0000 1694c700 -1 osd.7 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:03.319187+0000 front 2019-11-29T03:14:01.051962+0000 (oldest deadline 2019-11-29T03:14:43.020024+0000) 2019-11-29T03:15:13.310 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:15:13.305+0000 1694c700 -1 osd.1 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:59.408529+0000 front 2019-11-29T03:13:59.403068+0000 (oldest deadline 2019-11-29T03:14:44.060736+0000) 2019-11-29T03:15:13.648 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:15:13.638+0000 1694c700 -1 osd.4 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.814852+0000 front 2019-11-29T03:13:58.822962+0000 (oldest deadline 2019-11-29T03:14:43.433628+0000) 2019-11-29T03:15:13.906 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:15:13.903+0000 1694c700 -1 osd.0 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.744452+0000 front 2019-11-29T03:13:59.326943+0000 (oldest deadline 2019-11-29T03:14:44.628567+0000) 2019-11-29T03:15:14.120 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:15:14.115+0000 1694c700 -1 osd.5 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.663857+0000 front 2019-11-29T03:13:59.267128+0000 (oldest deadline 2019-11-29T03:14:43.316789+0000) 2019-11-29T03:15:14.143 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:15:14.140+0000 1694c700 -1 osd.2 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.210122+0000 front 2019-11-29T03:13:58.207924+0000 (oldest deadline 2019-11-29T03:14:43.482546+0000) 2019-11-29T03:15:14.188 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:15:14.182+0000 1694c700 -1 osd.6 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:02.515387+0000 front 2019-11-29T03:14:02.575337+0000 (oldest deadline 2019-11-29T03:14:44.683360+0000) 2019-11-29T03:15:14.233 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:15:14.230+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.74:6802/10096,v1:172.21.15.74:6803/10096] for 45sec e220 v220) 2019-11-29T03:15:14.271 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:15:14.267+0000 1694c700 -1 osd.1 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:59.408529+0000 front 2019-11-29T03:13:59.403068+0000 (oldest deadline 2019-11-29T03:14:44.060736+0000) 2019-11-29T03:15:14.291 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:15:14.286+0000 1694c700 -1 osd.7 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:03.319187+0000 front 2019-11-29T03:14:01.051962+0000 (oldest deadline 2019-11-29T03:14:43.020024+0000) 2019-11-29T03:15:14.660 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:15:14.654+0000 1694c700 -1 osd.4 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.814852+0000 front 2019-11-29T03:13:58.822962+0000 (oldest deadline 2019-11-29T03:14:43.433628+0000) 2019-11-29T03:15:14.930 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:15:14.926+0000 1694c700 -1 osd.0 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.744452+0000 front 2019-11-29T03:13:59.326943+0000 (oldest deadline 2019-11-29T03:14:44.628567+0000) 2019-11-29T03:15:15.099 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:15:15.095+0000 1694c700 -1 osd.2 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.210122+0000 front 2019-11-29T03:13:58.207924+0000 (oldest deadline 2019-11-29T03:14:43.482546+0000) 2019-11-29T03:15:15.149 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:15:15.144+0000 1694c700 -1 osd.5 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.663857+0000 front 2019-11-29T03:13:59.267128+0000 (oldest deadline 2019-11-29T03:14:43.316789+0000) 2019-11-29T03:15:15.195 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:15:15.190+0000 1694c700 -1 osd.6 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:02.515387+0000 front 2019-11-29T03:14:02.575337+0000 (oldest deadline 2019-11-29T03:14:44.683360+0000) 2019-11-29T03:15:15.302 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:15:15.298+0000 1694c700 -1 osd.1 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:59.408529+0000 front 2019-11-29T03:13:59.403068+0000 (oldest deadline 2019-11-29T03:14:44.060736+0000) 2019-11-29T03:15:15.338 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:15:15.331+0000 1694c700 -1 osd.7 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:03.319187+0000 front 2019-11-29T03:14:01.051962+0000 (oldest deadline 2019-11-29T03:14:43.020024+0000) 2019-11-29T03:15:15.621 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:15:15.616+0000 1694c700 -1 osd.4 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.814852+0000 front 2019-11-29T03:13:58.822962+0000 (oldest deadline 2019-11-29T03:14:43.433628+0000) 2019-11-29T03:15:15.935 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:15:15.931+0000 1694c700 -1 osd.0 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.744452+0000 front 2019-11-29T03:13:59.326943+0000 (oldest deadline 2019-11-29T03:14:44.628567+0000) 2019-11-29T03:15:16.072 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:15:16.069+0000 1694c700 -1 osd.2 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.210122+0000 front 2019-11-29T03:13:58.207924+0000 (oldest deadline 2019-11-29T03:14:43.482546+0000) 2019-11-29T03:15:16.150 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:15:16.145+0000 1694c700 -1 osd.5 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.663857+0000 front 2019-11-29T03:13:59.267128+0000 (oldest deadline 2019-11-29T03:14:43.316789+0000) 2019-11-29T03:15:16.210 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:15:16.205+0000 1694c700 -1 osd.6 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:02.515387+0000 front 2019-11-29T03:14:02.575337+0000 (oldest deadline 2019-11-29T03:14:44.683360+0000) 2019-11-29T03:15:16.290 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:15:16.286+0000 1694c700 -1 osd.1 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:59.408529+0000 front 2019-11-29T03:13:59.403068+0000 (oldest deadline 2019-11-29T03:14:44.060736+0000) 2019-11-29T03:15:16.304 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:15:16.298+0000 1694c700 -1 osd.7 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:03.319187+0000 front 2019-11-29T03:14:01.051962+0000 (oldest deadline 2019-11-29T03:14:43.020024+0000) 2019-11-29T03:15:16.667 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:15:16.662+0000 1694c700 -1 osd.4 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.814852+0000 front 2019-11-29T03:13:58.822962+0000 (oldest deadline 2019-11-29T03:14:43.433628+0000) 2019-11-29T03:15:16.898 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:15:16.894+0000 1694c700 -1 osd.0 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.744452+0000 front 2019-11-29T03:13:59.326943+0000 (oldest deadline 2019-11-29T03:14:44.628567+0000) 2019-11-29T03:15:17.048 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:15:17.044+0000 1694c700 -1 osd.2 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.210122+0000 front 2019-11-29T03:13:58.207924+0000 (oldest deadline 2019-11-29T03:14:43.482546+0000) 2019-11-29T03:15:17.124 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:15:17.118+0000 1694c700 -1 osd.5 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.663857+0000 front 2019-11-29T03:13:59.267128+0000 (oldest deadline 2019-11-29T03:14:43.316789+0000) 2019-11-29T03:15:17.249 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:15:17.243+0000 1694c700 -1 osd.6 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:02.515387+0000 front 2019-11-29T03:14:02.575337+0000 (oldest deadline 2019-11-29T03:14:44.683360+0000) 2019-11-29T03:15:17.273 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:15:17.270+0000 1694c700 -1 osd.1 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:59.408529+0000 front 2019-11-29T03:13:59.403068+0000 (oldest deadline 2019-11-29T03:14:44.060736+0000) 2019-11-29T03:15:17.324 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:15:17.319+0000 1694c700 -1 osd.7 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:03.319187+0000 front 2019-11-29T03:14:01.051962+0000 (oldest deadline 2019-11-29T03:14:43.020024+0000) 2019-11-29T03:15:17.698 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:15:17.693+0000 1694c700 -1 osd.4 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.814852+0000 front 2019-11-29T03:13:58.822962+0000 (oldest deadline 2019-11-29T03:14:43.433628+0000) 2019-11-29T03:15:17.920 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:15:17.915+0000 1694c700 -1 osd.0 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.744452+0000 front 2019-11-29T03:13:59.326943+0000 (oldest deadline 2019-11-29T03:14:44.628567+0000) 2019-11-29T03:15:18.052 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:15:18.048+0000 1694c700 -1 osd.2 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.210122+0000 front 2019-11-29T03:13:58.207924+0000 (oldest deadline 2019-11-29T03:14:43.482546+0000) 2019-11-29T03:15:18.153 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:15:18.148+0000 1694c700 -1 osd.5 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.663857+0000 front 2019-11-29T03:13:59.267128+0000 (oldest deadline 2019-11-29T03:14:43.316789+0000) 2019-11-29T03:15:18.239 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:15:18.233+0000 1694c700 -1 osd.6 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:02.515387+0000 front 2019-11-29T03:14:02.575337+0000 (oldest deadline 2019-11-29T03:14:44.683360+0000) 2019-11-29T03:15:18.311 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:15:18.305+0000 1694c700 -1 osd.7 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:03.319187+0000 front 2019-11-29T03:14:01.051962+0000 (oldest deadline 2019-11-29T03:14:43.020024+0000) 2019-11-29T03:15:18.317 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:15:18.314+0000 1694c700 -1 osd.1 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:59.408529+0000 front 2019-11-29T03:13:59.403068+0000 (oldest deadline 2019-11-29T03:14:44.060736+0000) 2019-11-29T03:15:18.725 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:15:18.720+0000 1694c700 -1 osd.4 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.814852+0000 front 2019-11-29T03:13:58.822962+0000 (oldest deadline 2019-11-29T03:14:43.433628+0000) 2019-11-29T03:15:18.958 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:15:18.952+0000 1694c700 -1 osd.0 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.744452+0000 front 2019-11-29T03:13:59.326943+0000 (oldest deadline 2019-11-29T03:14:44.628567+0000) 2019-11-29T03:15:19.017 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:15:19.012+0000 1694c700 -1 osd.2 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.210122+0000 front 2019-11-29T03:13:58.207924+0000 (oldest deadline 2019-11-29T03:14:43.482546+0000) 2019-11-29T03:15:19.111 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:15:19.106+0000 1694c700 -1 osd.5 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.663857+0000 front 2019-11-29T03:13:59.267128+0000 (oldest deadline 2019-11-29T03:14:43.316789+0000) 2019-11-29T03:15:19.246 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:15:19.240+0000 1694c700 -1 osd.6 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:02.515387+0000 front 2019-11-29T03:14:02.575337+0000 (oldest deadline 2019-11-29T03:14:44.683360+0000) 2019-11-29T03:15:19.297 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:15:19.292+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.74:6802/10096,v1:172.21.15.74:6803/10096] for 45sec e220 v220) 2019-11-29T03:15:19.356 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:15:19.350+0000 1694c700 -1 osd.1 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:59.408529+0000 front 2019-11-29T03:13:59.403068+0000 (oldest deadline 2019-11-29T03:14:44.060736+0000) 2019-11-29T03:15:19.358 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:15:19.353+0000 1694c700 -1 osd.7 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:14:03.319187+0000 front 2019-11-29T03:14:01.051962+0000 (oldest deadline 2019-11-29T03:14:43.020024+0000) 2019-11-29T03:15:19.922 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:15:19.912+0000 1694c700 -1 osd.0 220 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:13:58.744452+0000 front 2019-11-29T03:13:59.326943+0000 (oldest deadline 2019-11-29T03:14:44.628567+0000) 2019-11-29T03:15:49.903 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:29:32.121 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:15:49.909 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:29:32.127 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:15:49.918 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:29:32.138 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:15:49.919 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:29:32.148 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:15:49.924 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:29:32.143 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:15:49.932 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:29:32.161 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:15:50.053 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:29:32.271 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:15:50.096 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:29:32.316 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:15:50.127 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:29:32.356 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:16:09.799 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:29:52.017 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:16:09.802 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:29:52.020 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:16:09.861 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:29:52.080 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:16:09.863 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:29:52.082 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:16:09.872 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:29:52.097 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:16:09.872 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:29:52.099 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:16:09.882 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:29:52.100 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:16:09.906 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:29:52.125 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:16:09.914 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:29:52.143 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:16:14.634 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:14.629+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:15.227 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:15.223+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:15.688 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:15.684+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:15.767 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:15.762+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:15.827 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:15.823+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:16.182 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:16.178+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:16.685 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:16.680+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:16.792 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:16.788+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:16.812 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:16.808+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:17.178 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:17.175+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:17.639 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:17.635+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:17.703 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:17.698+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:17.785 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:17.781+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:17.787 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:17.781+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:17.817 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:17.813+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:18.186 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:18.180+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:18.652 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:18.648+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:18.677 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:18.673+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:18.751 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:18.748+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:18.809 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:18.804+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:18.851 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:18.846+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:19.226 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:19.222+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:19.696 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:19.690+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:19.703 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:19.699+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:19.748 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:19.744+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:19.858 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:19.851+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:19.906 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:19.897+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:20.260 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:20.256+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:20.707 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:20.700+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:20.708 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:20.703+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:20.743 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:20.739+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:20.864 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:20.858+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:20.866 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:20.861+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:21.299 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:21.292+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:21.686 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:21.680+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:21.693 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:21.689+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:21.766 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:21.762+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:21.852 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:21.845+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:21.863 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:21.856+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:22.254 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:22.251+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:22.653 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:22.651+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:22.721 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:22.715+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:22.754 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:22.751+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:22.874 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:22.869+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:22.884 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:22.877+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:23.275 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:23.272+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:23.639 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:23.636+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:23.685 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:23.680+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:23.716 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:23.713+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:23.835 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:23.830+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:23.840 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:23.834+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:24.261 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:24.258+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:24.690 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:24.688+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:24.737 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:24.733+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:24.738 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:24.736+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:24.827 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:24.823+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:24.853 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:24.848+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:25.301 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:25.298+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:25.690 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:25.686+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:25.769 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:25.765+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:25.781 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:25.775+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:25.808 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:25.803+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:25.861 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:25.855+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:26.061 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:26.058+0000 1694c700 -1 osd.3 226 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e224) 2019-11-29T03:16:26.286 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:26.283+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:26.726 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:26.723+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:26.748 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:26.741+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:26.770 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:26.768+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:26.812 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:26.807+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:26.827 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:26.822+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:27.080 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:27.077+0000 1694c700 -1 osd.3 226 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e224) 2019-11-29T03:16:27.333 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:27.330+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:27.720 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:27.715+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:27.753 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:27.748+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:27.807 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:27.803+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:27.816 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:27.813+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:27.823 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:27.818+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:28.121 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:28.118+0000 1694c700 -1 osd.3 226 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e224) 2019-11-29T03:16:28.293 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:28.290+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:28.716 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:28.714+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:28.728 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:28.723+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:28.795 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:28.787+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:28.818 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:28.813+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:28.865 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:28.863+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:29.121 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:29.119+0000 1694c700 -1 osd.3 226 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e224) 2019-11-29T03:16:29.314 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:29.311+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:29.683 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:29.680+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:29.807 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:29.777+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:29.807 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:29.789+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:29.811 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:29.806+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:29.897 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:29.893+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:30.087 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:30.085+0000 1694c700 -1 osd.3 226 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e224) 2019-11-29T03:16:30.291 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:30.288+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:30.684 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:30.681+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:30.781 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:30.774+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:30.827 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:30.822+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:30.844 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:30.839+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:30.867 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:30.865+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:31.105 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:31.103+0000 1694c700 -1 osd.3 226 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e224) 2019-11-29T03:16:31.271 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:31.268+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:31.735 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:31.733+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:31.817 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:31.812+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:31.845 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:31.841+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:31.876 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:31.871+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:31.883 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:31.880+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:32.143 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:32.139+0000 1694c700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:15:51.197117+0000 (oldest deadline 2019-11-29T03:16:31.197117+0000) 2019-11-29T03:16:32.144 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:32.141+0000 1694c700 -1 osd.3 226 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e224) 2019-11-29T03:16:32.311 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:32.308+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:32.774 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:32.771+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:32.839 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:32.834+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:32.846 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:32.841+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:32.920 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:32.915+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:32.935 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:32.932+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:33.192 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:33.188+0000 1694c700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:15:51.197117+0000 (oldest deadline 2019-11-29T03:16:31.197117+0000) 2019-11-29T03:16:33.193 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:33.190+0000 1694c700 -1 osd.3 226 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e224) 2019-11-29T03:16:33.266 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:33.264+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:33.745 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:33.742+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:33.816 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:33.811+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:33.843 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:33.838+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:33.955 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:33.951+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:33.974 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:33.971+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:34.177 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:34.173+0000 1694c700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:15:51.197117+0000 (oldest deadline 2019-11-29T03:16:31.197117+0000) 2019-11-29T03:16:34.178 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:34.175+0000 1694c700 -1 osd.3 226 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e224) 2019-11-29T03:16:34.290 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:34.287+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:34.715 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:34.712+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:34.785 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:34.780+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:34.834 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:34.829+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:34.951 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:34.947+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:34.985 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:34.982+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:35.167 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:35.165+0000 1694c700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:15:51.197117+0000 (oldest deadline 2019-11-29T03:16:31.197117+0000) 2019-11-29T03:16:35.167 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:35.165+0000 1694c700 -1 osd.3 226 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e224) 2019-11-29T03:16:35.296 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:35.293+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:35.749 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:35.746+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:35.767 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:35.763+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:35.833 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:35.828+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:35.913 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:35.909+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:35.941 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:35.937+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:36.208 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:36.202+0000 1694c700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:15:51.197117+0000 (oldest deadline 2019-11-29T03:16:31.197117+0000) 2019-11-29T03:16:36.212 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:36.205+0000 1694c700 -1 osd.3 226 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e224) 2019-11-29T03:16:36.310 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:36.306+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:36.718 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:36.714+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:36.822 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:36.817+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:36.824 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:36.818+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:36.871 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:36.865+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:36.983 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:36.980+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:37.190 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:37.185+0000 1694c700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:15:51.197117+0000 (oldest deadline 2019-11-29T03:16:31.197117+0000) 2019-11-29T03:16:37.190 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:37.187+0000 1694c700 -1 osd.3 226 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e224) 2019-11-29T03:16:37.299 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:37.295+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:37.767 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:37.763+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:37.786 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:37.781+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:37.876 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:37.871+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:37.901 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:37.896+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:38.024 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:38.020+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:38.210 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:38.206+0000 1694c700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:15:51.197117+0000 (oldest deadline 2019-11-29T03:16:31.197117+0000) 2019-11-29T03:16:38.211 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:38.207+0000 1694c700 -1 osd.3 226 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e224) 2019-11-29T03:16:38.275 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:38.272+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:38.729 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:38.725+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:38.820 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:38.814+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:38.874 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:38.868+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:38.939 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:38.934+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:39.061 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:39.058+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:39.185 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:39.182+0000 1694c700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:15:51.197117+0000 (oldest deadline 2019-11-29T03:16:31.197117+0000) 2019-11-29T03:16:39.188 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:39.185+0000 1694c700 -1 osd.3 226 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e224) 2019-11-29T03:16:39.272 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:39.269+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:39.709 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:39.704+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:39.837 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:39.833+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:39.849 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:39.844+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:39.958 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:39.953+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:40.100 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:40.094+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:40.217 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:40.213+0000 1694c700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:15:51.197117+0000 (oldest deadline 2019-11-29T03:16:31.197117+0000) 2019-11-29T03:16:40.220 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:40.217+0000 1694c700 -1 osd.3 226 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e224) 2019-11-29T03:16:40.316 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:40.312+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:40.756 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:40.752+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:40.829 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:40.824+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:40.841 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:40.834+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:40.951 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:40.946+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:41.094 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:41.090+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:41.185 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:41.181+0000 1694c700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:15:51.197117+0000 (oldest deadline 2019-11-29T03:16:31.197117+0000) 2019-11-29T03:16:41.190 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:41.186+0000 1694c700 -1 osd.3 226 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e224) 2019-11-29T03:16:41.335 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:41.331+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:41.734 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:41.729+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:41.838 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:41.832+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:41.869 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:41.864+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:41.940 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:41.935+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:42.070 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:42.066+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:42.211 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:42.207+0000 1694c700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:15:51.197117+0000 (oldest deadline 2019-11-29T03:16:31.197117+0000) 2019-11-29T03:16:42.211 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:42.208+0000 1694c700 -1 osd.3 226 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e224) 2019-11-29T03:16:42.380 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:42.376+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:42.701 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:42.698+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:42.828 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:42.823+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:42.845 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:42.840+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:42.919 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:42.914+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:43.072 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:43.068+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:43.244 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:43.240+0000 1694c700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:15:51.197117+0000 (oldest deadline 2019-11-29T03:16:31.197117+0000) 2019-11-29T03:16:43.247 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:43.244+0000 1694c700 -1 osd.3 226 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e224) 2019-11-29T03:16:43.337 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:43.333+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:43.722 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:43.718+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:43.843 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:43.839+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:43.883 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:43.878+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:43.941 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:43.937+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:44.047 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:44.044+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:44.250 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:44.246+0000 1694c700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:15:51.197117+0000 (oldest deadline 2019-11-29T03:16:31.197117+0000) 2019-11-29T03:16:44.253 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:44.250+0000 1694c700 -1 osd.3 226 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e224) 2019-11-29T03:16:44.362 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:44.358+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:44.775 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:44.771+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:44.788 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:16:44.781+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 44sec e226 v226) 2019-11-29T03:16:44.814 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:44.809+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:44.883 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:44.877+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:44.919 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:44.915+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:45.026 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:45.022+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:45.256 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:45.253+0000 1694c700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:15:51.197117+0000 (oldest deadline 2019-11-29T03:16:31.197117+0000) 2019-11-29T03:16:45.259 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:45.256+0000 1694c700 -1 osd.3 226 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e224) 2019-11-29T03:16:45.376 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:45.372+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:45.779 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:45.773+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:45.802 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:45.798+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:45.850 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:45.845+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:45.957 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:45.952+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:46.063 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:46.060+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:46.300 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:46.296+0000 1694c700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:15:51.197117+0000 (oldest deadline 2019-11-29T03:16:31.197117+0000) 2019-11-29T03:16:46.303 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:46.300+0000 1694c700 -1 osd.3 226 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e224) 2019-11-29T03:16:46.380 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:46.377+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:46.774 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:46.771+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:46.825 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:46.820+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:46.875 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:46.871+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:46.987 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:46.983+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:47.081 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:47.077+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:47.271 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:47.266+0000 1694c700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:15:51.197117+0000 (oldest deadline 2019-11-29T03:16:31.197117+0000) 2019-11-29T03:16:47.271 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:47.268+0000 1694c700 -1 osd.3 226 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e224) 2019-11-29T03:16:47.355 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:47.351+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:47.802 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:47.797+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:47.838 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:47.833+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:47.878 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:47.872+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:48.040 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:48.034+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:48.089 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:48.084+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:48.245 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:48.240+0000 1694c700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:15:51.197117+0000 (oldest deadline 2019-11-29T03:16:31.197117+0000) 2019-11-29T03:16:48.246 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:48.242+0000 1694c700 -1 osd.3 226 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e224) 2019-11-29T03:16:48.391 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:48.387+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:48.792 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:48.787+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:48.837 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:48.831+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:48.881 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:48.875+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:49.028 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:49.023+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:49.088 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:49.082+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:49.202 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:49.198+0000 1694c700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:15:51.197117+0000 (oldest deadline 2019-11-29T03:16:31.197117+0000) 2019-11-29T03:16:49.205 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:49.201+0000 1694c700 -1 osd.3 226 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e224) 2019-11-29T03:16:49.391 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:49.386+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:49.798 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:16:49.793+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 44sec e226 v226) 2019-11-29T03:16:49.815 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:49.812+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:49.861 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:49.856+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:49.930 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:49.926+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:50.070 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:50.065+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:50.132 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:50.127+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:50.186 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:50.181+0000 1694c700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:15:51.197117+0000 (oldest deadline 2019-11-29T03:16:31.197117+0000) 2019-11-29T03:16:50.186 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:50.183+0000 1694c700 -1 osd.3 226 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e224) 2019-11-29T03:16:50.382 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:50.374+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:50.798 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:50.793+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:50.847 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:50.842+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:50.896 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:50.891+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:51.077 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:51.070+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:51.106 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:51.103+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:51.225 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:51.221+0000 1694c700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:15:51.197117+0000 (oldest deadline 2019-11-29T03:16:31.197117+0000) 2019-11-29T03:16:51.228 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:51.225+0000 1694c700 -1 osd.3 226 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e224) 2019-11-29T03:16:51.352 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:51.347+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:51.807 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:51.803+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:51.900 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:51.895+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:51.914 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:51.909+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:52.048 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:52.043+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:52.154 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:52.150+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:52.203 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:52.200+0000 1694c700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:15:51.197117+0000 (oldest deadline 2019-11-29T03:16:31.197117+0000) 2019-11-29T03:16:52.205 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:52.203+0000 1694c700 -1 osd.3 226 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e224) 2019-11-29T03:16:52.358 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:52.353+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:52.797 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:52.793+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:52.861 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:52.856+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:52.935 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:52.930+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:53.073 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:53.068+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:53.177 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:53.173+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:53.178 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:53.172+0000 1694c700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:15:51.197117+0000 (oldest deadline 2019-11-29T03:16:31.197117+0000) 2019-11-29T03:16:53.178 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:53.174+0000 1694c700 -1 osd.3 226 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e224) 2019-11-29T03:16:53.398 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:53.393+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:53.841 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:53.836+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:53.844 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:53.840+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:53.985 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:53.980+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:54.048 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:54.043+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:54.208 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:54.200+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:54.221 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:54.217+0000 1694c700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:15:51.197117+0000 (oldest deadline 2019-11-29T03:16:31.197117+0000) 2019-11-29T03:16:54.224 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:54.221+0000 1694c700 -1 osd.3 226 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e224) 2019-11-29T03:16:54.415 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:54.410+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:54.811 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:54.805+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:54.813 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:16:54.809+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 44sec e226 v226) 2019-11-29T03:16:54.878 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:54.874+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:54.976 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:54.971+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:55.074 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:55.070+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:55.185 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:55.180+0000 1694c700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:15:51.197117+0000 (oldest deadline 2019-11-29T03:16:31.197117+0000) 2019-11-29T03:16:55.186 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:55.182+0000 1694c700 -1 osd.3 226 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e224) 2019-11-29T03:16:55.218 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:55.215+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:55.458 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:55.454+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:55.825 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:55.820+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:55.879 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:55.876+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:56.020 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:56.015+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:56.090 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:56.085+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:56.229 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:56.225+0000 1694c700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:15:51.197117+0000 (oldest deadline 2019-11-29T03:16:31.197117+0000) 2019-11-29T03:16:56.230 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:56.226+0000 1694c700 -1 osd.3 226 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e224) 2019-11-29T03:16:56.232 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:56.229+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:56.468 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:56.463+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:56.867 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:56.861+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:56.910 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:56.906+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:57.025 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:57.020+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:57.082 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:57.077+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:57.185 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:57.180+0000 1694c700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:15:51.197117+0000 (oldest deadline 2019-11-29T03:16:31.197117+0000) 2019-11-29T03:16:57.186 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:57.182+0000 1694c700 -1 osd.3 226 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e224) 2019-11-29T03:16:57.257 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:57.253+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:57.436 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:57.431+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:57.832 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:57.827+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:57.871 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:57.866+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:57.988 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:57.984+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:58.096 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:58.092+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:58.179 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:58.174+0000 1694c700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:15:51.197117+0000 (oldest deadline 2019-11-29T03:16:31.197117+0000) 2019-11-29T03:16:58.179 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:58.176+0000 1694c700 -1 osd.3 226 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e224) 2019-11-29T03:16:58.228 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:58.224+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:58.474 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:58.470+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:58.856 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:58.850+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:58.868 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:58.863+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:16:58.996 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:16:58.992+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:16:59.111 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:16:59.098+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:16:59.204 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:59.200+0000 1694c700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:15:51.197117+0000 (oldest deadline 2019-11-29T03:16:31.197117+0000) 2019-11-29T03:16:59.204 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:16:59.201+0000 1694c700 -1 osd.3 226 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e224) 2019-11-29T03:16:59.249 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:16:59.245+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:16:59.439 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:16:59.434+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:16:59.826 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:16:59.823+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 44sec e226 v226) 2019-11-29T03:16:59.888 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:16:59.885+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:16:59.897 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:16:59.893+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:17:00.033 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:17:00.029+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:17:00.083 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:17:00.079+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:17:00.194 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:17:00.189+0000 1694c700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:15:51.197117+0000 (oldest deadline 2019-11-29T03:16:31.197117+0000) 2019-11-29T03:17:00.195 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:17:00.191+0000 1694c700 -1 osd.3 226 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e224) 2019-11-29T03:17:00.240 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:17:00.236+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:17:00.448 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:17:00.445+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:17:00.855 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:17:00.850+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:17:00.889 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:17:00.885+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:17:01.050 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:17:01.045+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:17:01.096 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:17:01.090+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:17:01.197 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:17:01.192+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:17:01.229 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:17:01.223+0000 1694c700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:15:51.197117+0000 (oldest deadline 2019-11-29T03:16:31.197117+0000) 2019-11-29T03:17:01.230 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:17:01.225+0000 1694c700 -1 osd.3 226 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e224) 2019-11-29T03:17:01.429 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:17:01.425+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:17:01.876 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:17:01.871+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:17:01.887 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:17:01.883+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:17:02.059 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:17:02.054+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:17:02.100 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:17:02.094+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:17:02.230 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:17:02.225+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:17:02.250 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:17:02.246+0000 1694c700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:15:51.197117+0000 (oldest deadline 2019-11-29T03:16:31.197117+0000) 2019-11-29T03:17:02.250 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:17:02.247+0000 1694c700 -1 osd.3 226 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e224) 2019-11-29T03:17:02.447 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:17:02.443+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:17:02.839 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:17:02.834+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:17:02.904 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:17:02.900+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:17:03.094 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:17:03.089+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:17:03.098 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:17:03.093+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:17:03.238 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:17:03.233+0000 1694c700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:15:51.197117+0000 (oldest deadline 2019-11-29T03:16:31.197117+0000) 2019-11-29T03:17:03.239 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:17:03.235+0000 1694c700 -1 osd.3 226 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e224) 2019-11-29T03:17:03.270 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:17:03.267+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:17:03.488 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:17:03.484+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:17:03.867 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:17:03.861+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:17:03.943 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:17:03.940+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:17:04.114 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:17:04.104+0000 1694c700 -1 osd.7 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.631594+0000 front 2019-11-29T03:15:33.719629+0000 (oldest deadline 2019-11-29T03:16:17.252287+0000) 2019-11-29T03:17:04.150 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:17:04.144+0000 1694c700 -1 osd.6 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:32.622252+0000 front 2019-11-29T03:15:36.189610+0000 (oldest deadline 2019-11-29T03:16:15.290798+0000) 2019-11-29T03:17:04.231 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:17:04.227+0000 1694c700 -1 osd.3 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:15:51.197117+0000 (oldest deadline 2019-11-29T03:16:31.197117+0000) 2019-11-29T03:17:04.235 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:17:04.231+0000 1694c700 -1 osd.3 226 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e224) 2019-11-29T03:17:04.254 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:17:04.246+0000 1694c700 -1 osd.2 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:30.602659+0000 front 2019-11-29T03:15:36.177379+0000 (oldest deadline 2019-11-29T03:16:13.856680+0000) 2019-11-29T03:17:04.497 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:17:04.493+0000 1694c700 -1 osd.0 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.317498+0000 front 2019-11-29T03:15:32.632364+0000 (oldest deadline 2019-11-29T03:16:14.290328+0000) 2019-11-29T03:17:04.897 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:17:04.893+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 44sec e226 v226) 2019-11-29T03:17:04.916 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:17:04.913+0000 1694c700 -1 osd.1 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.661564+0000 front 2019-11-29T03:15:36.192126+0000 (oldest deadline 2019-11-29T03:16:15.342827+0000) 2019-11-29T03:17:04.919 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:17:04.915+0000 1694c700 -1 osd.4 226 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:15:34.741598+0000 front 2019-11-29T03:15:34.739989+0000 (oldest deadline 2019-11-29T03:16:17.588731+0000) 2019-11-29T03:18:35.119 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:18:35.111+0000 1694c700 -1 osd.4 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:51.610299+0000 front 2019-11-29T03:17:51.658038+0000 (oldest deadline 2019-11-29T03:18:34.477474+0000) 2019-11-29T03:18:35.625 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:18:35.618+0000 1694c700 -1 osd.6 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.895745+0000 front 2019-11-29T03:17:53.894040+0000 (oldest deadline 2019-11-29T03:18:34.810411+0000) 2019-11-29T03:18:35.979 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:18:35.973+0000 1694c700 -1 osd.5 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.874289+0000 front 2019-11-29T03:17:53.824594+0000 (oldest deadline 2019-11-29T03:18:35.914158+0000) 2019-11-29T03:18:36.073 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:18:36.067+0000 1694c700 -1 osd.4 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:51.610299+0000 front 2019-11-29T03:17:51.658038+0000 (oldest deadline 2019-11-29T03:18:34.477474+0000) 2019-11-29T03:18:36.650 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:18:36.645+0000 1694c700 -1 osd.6 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.895745+0000 front 2019-11-29T03:17:53.894040+0000 (oldest deadline 2019-11-29T03:18:34.810411+0000) 2019-11-29T03:18:36.982 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:18:36.975+0000 1694c700 -1 osd.5 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.874289+0000 front 2019-11-29T03:17:53.824594+0000 (oldest deadline 2019-11-29T03:18:35.914158+0000) 2019-11-29T03:18:37.117 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:18:37.112+0000 1694c700 -1 osd.4 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:51.610299+0000 front 2019-11-29T03:17:51.658038+0000 (oldest deadline 2019-11-29T03:18:34.477474+0000) 2019-11-29T03:18:37.151 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:18:37.148+0000 1694c700 -1 osd.2 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.420214+0000 front 2019-11-29T03:17:53.421005+0000 (oldest deadline 2019-11-29T03:18:36.934205+0000) 2019-11-29T03:18:37.276 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:18:37.272+0000 1694c700 -1 osd.0 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.915742+0000 front 2019-11-29T03:17:53.937938+0000 (oldest deadline 2019-11-29T03:18:36.758931+0000) 2019-11-29T03:18:37.485 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:18:37.480+0000 1694c700 -1 osd.7 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:50.671486+0000 front 2019-11-29T03:17:50.606946+0000 (oldest deadline 2019-11-29T03:18:36.466386+0000) 2019-11-29T03:18:37.666 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:18:37.661+0000 1694c700 -1 osd.6 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.895745+0000 front 2019-11-29T03:17:53.894040+0000 (oldest deadline 2019-11-29T03:18:34.810411+0000) 2019-11-29T03:18:37.993 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:18:37.987+0000 1694c700 -1 osd.5 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.874289+0000 front 2019-11-29T03:17:53.824594+0000 (oldest deadline 2019-11-29T03:18:35.914158+0000) 2019-11-29T03:18:38.121 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:18:38.115+0000 1694c700 -1 osd.4 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:51.610299+0000 front 2019-11-29T03:17:51.658038+0000 (oldest deadline 2019-11-29T03:18:34.477474+0000) 2019-11-29T03:18:38.172 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:18:38.170+0000 1694c700 -1 osd.2 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.420214+0000 front 2019-11-29T03:17:53.421005+0000 (oldest deadline 2019-11-29T03:18:36.934205+0000) 2019-11-29T03:18:38.288 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:18:38.285+0000 1694c700 -1 osd.0 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.915742+0000 front 2019-11-29T03:17:53.937938+0000 (oldest deadline 2019-11-29T03:18:36.758931+0000) 2019-11-29T03:18:38.502 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:18:38.496+0000 1694c700 -1 osd.7 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:50.671486+0000 front 2019-11-29T03:17:50.606946+0000 (oldest deadline 2019-11-29T03:18:36.466386+0000) 2019-11-29T03:18:38.715 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:18:38.708+0000 1694c700 -1 osd.6 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.895745+0000 front 2019-11-29T03:17:53.894040+0000 (oldest deadline 2019-11-29T03:18:34.810411+0000) 2019-11-29T03:18:39.050 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:18:39.039+0000 1694c700 -1 osd.5 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.874289+0000 front 2019-11-29T03:17:53.824594+0000 (oldest deadline 2019-11-29T03:18:35.914158+0000) 2019-11-29T03:18:39.095 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:18:39.090+0000 1694c700 -1 osd.4 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:51.610299+0000 front 2019-11-29T03:17:51.658038+0000 (oldest deadline 2019-11-29T03:18:34.477474+0000) 2019-11-29T03:18:39.216 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:18:39.213+0000 1694c700 -1 osd.2 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.420214+0000 front 2019-11-29T03:17:53.421005+0000 (oldest deadline 2019-11-29T03:18:36.934205+0000) 2019-11-29T03:18:39.294 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:18:39.292+0000 1694c700 -1 osd.0 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.915742+0000 front 2019-11-29T03:17:53.937938+0000 (oldest deadline 2019-11-29T03:18:36.758931+0000) 2019-11-29T03:18:39.512 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:18:39.508+0000 1694c700 -1 osd.7 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:50.671486+0000 front 2019-11-29T03:17:50.606946+0000 (oldest deadline 2019-11-29T03:18:36.466386+0000) 2019-11-29T03:18:39.711 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:18:39.706+0000 1694c700 -1 osd.6 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.895745+0000 front 2019-11-29T03:17:53.894040+0000 (oldest deadline 2019-11-29T03:18:34.810411+0000) 2019-11-29T03:18:40.017 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:18:40.006+0000 1694c700 -1 osd.5 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.874289+0000 front 2019-11-29T03:17:53.824594+0000 (oldest deadline 2019-11-29T03:18:35.914158+0000) 2019-11-29T03:18:40.139 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:18:40.134+0000 1694c700 -1 osd.4 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:51.610299+0000 front 2019-11-29T03:17:51.658038+0000 (oldest deadline 2019-11-29T03:18:34.477474+0000) 2019-11-29T03:18:40.192 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:18:40.189+0000 1694c700 -1 osd.2 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.420214+0000 front 2019-11-29T03:17:53.421005+0000 (oldest deadline 2019-11-29T03:18:36.934205+0000) 2019-11-29T03:18:40.336 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:18:40.333+0000 1694c700 -1 osd.0 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.915742+0000 front 2019-11-29T03:17:53.937938+0000 (oldest deadline 2019-11-29T03:18:36.758931+0000) 2019-11-29T03:18:40.545 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:18:40.541+0000 1694c700 -1 osd.7 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:50.671486+0000 front 2019-11-29T03:17:50.606946+0000 (oldest deadline 2019-11-29T03:18:36.466386+0000) 2019-11-29T03:18:40.673 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:18:40.668+0000 1694c700 -1 osd.6 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.895745+0000 front 2019-11-29T03:17:53.894040+0000 (oldest deadline 2019-11-29T03:18:34.810411+0000) 2019-11-29T03:18:41.017 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:18:41.013+0000 1694c700 -1 osd.5 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.874289+0000 front 2019-11-29T03:17:53.824594+0000 (oldest deadline 2019-11-29T03:18:35.914158+0000) 2019-11-29T03:18:41.180 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:18:41.173+0000 1694c700 -1 osd.4 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:51.610299+0000 front 2019-11-29T03:17:51.658038+0000 (oldest deadline 2019-11-29T03:18:34.477474+0000) 2019-11-29T03:18:41.211 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:18:41.208+0000 1694c700 -1 osd.2 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.420214+0000 front 2019-11-29T03:17:53.421005+0000 (oldest deadline 2019-11-29T03:18:36.934205+0000) 2019-11-29T03:18:41.381 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:18:41.378+0000 1694c700 -1 osd.0 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.915742+0000 front 2019-11-29T03:17:53.937938+0000 (oldest deadline 2019-11-29T03:18:36.758931+0000) 2019-11-29T03:18:41.567 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:18:41.556+0000 1694c700 -1 osd.7 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:50.671486+0000 front 2019-11-29T03:17:50.606946+0000 (oldest deadline 2019-11-29T03:18:36.466386+0000) 2019-11-29T03:18:41.639 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:18:41.632+0000 1694c700 -1 osd.6 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.895745+0000 front 2019-11-29T03:17:53.894040+0000 (oldest deadline 2019-11-29T03:18:34.810411+0000) 2019-11-29T03:18:41.981 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:18:41.974+0000 1694c700 -1 osd.5 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.874289+0000 front 2019-11-29T03:17:53.824594+0000 (oldest deadline 2019-11-29T03:18:35.914158+0000) 2019-11-29T03:18:42.160 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:18:42.153+0000 1694c700 -1 osd.4 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:51.610299+0000 front 2019-11-29T03:17:51.658038+0000 (oldest deadline 2019-11-29T03:18:34.477474+0000) 2019-11-29T03:18:42.166 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:18:42.163+0000 1694c700 -1 osd.2 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.420214+0000 front 2019-11-29T03:17:53.421005+0000 (oldest deadline 2019-11-29T03:18:36.934205+0000) 2019-11-29T03:18:42.397 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:18:42.394+0000 1694c700 -1 osd.0 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.915742+0000 front 2019-11-29T03:17:53.937938+0000 (oldest deadline 2019-11-29T03:18:36.758931+0000) 2019-11-29T03:18:42.543 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:18:42.537+0000 1694c700 -1 osd.7 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:50.671486+0000 front 2019-11-29T03:17:50.606946+0000 (oldest deadline 2019-11-29T03:18:36.466386+0000) 2019-11-29T03:18:42.634 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:18:42.627+0000 1694c700 -1 osd.6 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.895745+0000 front 2019-11-29T03:17:53.894040+0000 (oldest deadline 2019-11-29T03:18:34.810411+0000) 2019-11-29T03:18:42.969 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:18:42.962+0000 1694c700 -1 osd.5 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.874289+0000 front 2019-11-29T03:17:53.824594+0000 (oldest deadline 2019-11-29T03:18:35.914158+0000) 2019-11-29T03:18:43.136 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:18:43.130+0000 1694c700 -1 osd.4 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:51.610299+0000 front 2019-11-29T03:17:51.658038+0000 (oldest deadline 2019-11-29T03:18:34.477474+0000) 2019-11-29T03:18:43.193 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:18:43.189+0000 1694c700 -1 osd.2 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.420214+0000 front 2019-11-29T03:17:53.421005+0000 (oldest deadline 2019-11-29T03:18:36.934205+0000) 2019-11-29T03:18:43.372 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:18:43.369+0000 1694c700 -1 osd.0 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.915742+0000 front 2019-11-29T03:17:53.937938+0000 (oldest deadline 2019-11-29T03:18:36.758931+0000) 2019-11-29T03:18:43.570 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:18:43.562+0000 1694c700 -1 osd.7 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:50.671486+0000 front 2019-11-29T03:17:50.606946+0000 (oldest deadline 2019-11-29T03:18:36.466386+0000) 2019-11-29T03:18:43.613 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:18:43.607+0000 1694c700 -1 osd.6 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.895745+0000 front 2019-11-29T03:17:53.894040+0000 (oldest deadline 2019-11-29T03:18:34.810411+0000) 2019-11-29T03:18:44.002 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:18:43.995+0000 1694c700 -1 osd.5 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.874289+0000 front 2019-11-29T03:17:53.824594+0000 (oldest deadline 2019-11-29T03:18:35.914158+0000) 2019-11-29T03:18:44.150 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:18:44.144+0000 1694c700 -1 osd.4 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:51.610299+0000 front 2019-11-29T03:17:51.658038+0000 (oldest deadline 2019-11-29T03:18:34.477474+0000) 2019-11-29T03:18:44.237 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:18:44.234+0000 1694c700 -1 osd.2 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.420214+0000 front 2019-11-29T03:17:53.421005+0000 (oldest deadline 2019-11-29T03:18:36.934205+0000) 2019-11-29T03:18:44.353 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:18:44.350+0000 1694c700 -1 osd.0 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.915742+0000 front 2019-11-29T03:17:53.937938+0000 (oldest deadline 2019-11-29T03:18:36.758931+0000) 2019-11-29T03:18:44.575 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:18:44.569+0000 1694c700 -1 osd.6 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.895745+0000 front 2019-11-29T03:17:53.894040+0000 (oldest deadline 2019-11-29T03:18:34.810411+0000) 2019-11-29T03:18:44.611 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:18:44.606+0000 1694c700 -1 osd.7 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:50.671486+0000 front 2019-11-29T03:17:50.606946+0000 (oldest deadline 2019-11-29T03:18:36.466386+0000) 2019-11-29T03:18:44.998 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:18:44.993+0000 1694c700 -1 osd.5 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.874289+0000 front 2019-11-29T03:17:53.824594+0000 (oldest deadline 2019-11-29T03:18:35.914158+0000) 2019-11-29T03:18:45.133 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:18:45.128+0000 1694c700 -1 osd.4 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:51.610299+0000 front 2019-11-29T03:17:51.658038+0000 (oldest deadline 2019-11-29T03:18:34.477474+0000) 2019-11-29T03:18:45.267 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:18:45.265+0000 1694c700 -1 osd.2 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.420214+0000 front 2019-11-29T03:17:53.421005+0000 (oldest deadline 2019-11-29T03:18:36.934205+0000) 2019-11-29T03:18:45.345 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:18:45.340+0000 1694c700 -1 osd.0 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.915742+0000 front 2019-11-29T03:17:53.937938+0000 (oldest deadline 2019-11-29T03:18:36.758931+0000) 2019-11-29T03:18:45.576 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:18:45.570+0000 1694c700 -1 osd.7 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:50.671486+0000 front 2019-11-29T03:17:50.606946+0000 (oldest deadline 2019-11-29T03:18:36.466386+0000) 2019-11-29T03:18:45.588 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:18:45.582+0000 1694c700 -1 osd.6 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.895745+0000 front 2019-11-29T03:17:53.894040+0000 (oldest deadline 2019-11-29T03:18:34.810411+0000) 2019-11-29T03:18:46.013 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:18:46.007+0000 1694c700 -1 osd.5 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.874289+0000 front 2019-11-29T03:17:53.824594+0000 (oldest deadline 2019-11-29T03:18:35.914158+0000) 2019-11-29T03:18:46.129 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:18:46.123+0000 1694c700 -1 osd.4 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:51.610299+0000 front 2019-11-29T03:17:51.658038+0000 (oldest deadline 2019-11-29T03:18:34.477474+0000) 2019-11-29T03:18:46.247 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:18:46.244+0000 1694c700 -1 osd.2 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.420214+0000 front 2019-11-29T03:17:53.421005+0000 (oldest deadline 2019-11-29T03:18:36.934205+0000) 2019-11-29T03:18:46.329 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:18:46.326+0000 1694c700 -1 osd.0 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.915742+0000 front 2019-11-29T03:17:53.937938+0000 (oldest deadline 2019-11-29T03:18:36.758931+0000) 2019-11-29T03:18:46.564 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:18:46.559+0000 1694c700 -1 osd.6 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.895745+0000 front 2019-11-29T03:17:53.894040+0000 (oldest deadline 2019-11-29T03:18:34.810411+0000) 2019-11-29T03:18:46.581 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:18:46.575+0000 1694c700 -1 osd.7 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:50.671486+0000 front 2019-11-29T03:17:50.606946+0000 (oldest deadline 2019-11-29T03:18:36.466386+0000) 2019-11-29T03:18:47.012 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:18:47.007+0000 1694c700 -1 osd.5 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.874289+0000 front 2019-11-29T03:17:53.824594+0000 (oldest deadline 2019-11-29T03:18:35.914158+0000) 2019-11-29T03:18:47.161 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:18:47.155+0000 1694c700 -1 osd.4 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:51.610299+0000 front 2019-11-29T03:17:51.658038+0000 (oldest deadline 2019-11-29T03:18:34.477474+0000) 2019-11-29T03:18:47.273 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:18:47.269+0000 1694c700 -1 osd.2 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.420214+0000 front 2019-11-29T03:17:53.421005+0000 (oldest deadline 2019-11-29T03:18:36.934205+0000) 2019-11-29T03:18:47.288 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:18:47.284+0000 1694c700 -1 osd.0 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.915742+0000 front 2019-11-29T03:17:53.937938+0000 (oldest deadline 2019-11-29T03:18:36.758931+0000) 2019-11-29T03:18:47.589 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:18:47.572+0000 1694c700 -1 osd.7 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:50.671486+0000 front 2019-11-29T03:17:50.606946+0000 (oldest deadline 2019-11-29T03:18:36.466386+0000) 2019-11-29T03:18:47.589 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:18:47.581+0000 1694c700 -1 osd.6 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.895745+0000 front 2019-11-29T03:17:53.894040+0000 (oldest deadline 2019-11-29T03:18:34.810411+0000) 2019-11-29T03:18:48.026 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:18:48.020+0000 1694c700 -1 osd.5 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.874289+0000 front 2019-11-29T03:17:53.824594+0000 (oldest deadline 2019-11-29T03:18:35.914158+0000) 2019-11-29T03:18:48.161 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:18:48.155+0000 1694c700 -1 osd.4 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:51.610299+0000 front 2019-11-29T03:17:51.658038+0000 (oldest deadline 2019-11-29T03:18:34.477474+0000) 2019-11-29T03:18:48.255 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:18:48.250+0000 1694c700 -1 osd.0 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.915742+0000 front 2019-11-29T03:17:53.937938+0000 (oldest deadline 2019-11-29T03:18:36.758931+0000) 2019-11-29T03:18:48.307 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:18:48.305+0000 1694c700 -1 osd.2 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.420214+0000 front 2019-11-29T03:17:53.421005+0000 (oldest deadline 2019-11-29T03:18:36.934205+0000) 2019-11-29T03:18:48.564 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:18:48.558+0000 1694c700 -1 osd.7 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:50.671486+0000 front 2019-11-29T03:17:50.606946+0000 (oldest deadline 2019-11-29T03:18:36.466386+0000) 2019-11-29T03:18:48.609 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:18:48.603+0000 1694c700 -1 osd.6 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.895745+0000 front 2019-11-29T03:17:53.894040+0000 (oldest deadline 2019-11-29T03:18:34.810411+0000) 2019-11-29T03:18:49.059 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:18:49.054+0000 1694c700 -1 osd.5 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.874289+0000 front 2019-11-29T03:17:53.824594+0000 (oldest deadline 2019-11-29T03:18:35.914158+0000) 2019-11-29T03:18:49.169 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:18:49.163+0000 1694c700 -1 osd.4 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:51.610299+0000 front 2019-11-29T03:17:51.658038+0000 (oldest deadline 2019-11-29T03:18:34.477474+0000) 2019-11-29T03:18:49.283 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:18:49.279+0000 1694c700 -1 osd.2 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.420214+0000 front 2019-11-29T03:17:53.421005+0000 (oldest deadline 2019-11-29T03:18:36.934205+0000) 2019-11-29T03:18:49.303 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:18:49.300+0000 1694c700 -1 osd.0 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.915742+0000 front 2019-11-29T03:17:53.937938+0000 (oldest deadline 2019-11-29T03:18:36.758931+0000) 2019-11-29T03:18:49.562 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:18:49.556+0000 1694c700 -1 osd.7 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:50.671486+0000 front 2019-11-29T03:17:50.606946+0000 (oldest deadline 2019-11-29T03:18:36.466386+0000) 2019-11-29T03:18:49.588 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:18:49.583+0000 1694c700 -1 osd.6 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.895745+0000 front 2019-11-29T03:17:53.894040+0000 (oldest deadline 2019-11-29T03:18:34.810411+0000) 2019-11-29T03:18:50.095 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:18:50.089+0000 1694c700 -1 osd.5 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.874289+0000 front 2019-11-29T03:17:53.824594+0000 (oldest deadline 2019-11-29T03:18:35.914158+0000) 2019-11-29T03:18:50.167 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:18:50.162+0000 1694c700 -1 osd.4 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:51.610299+0000 front 2019-11-29T03:17:51.658038+0000 (oldest deadline 2019-11-29T03:18:34.477474+0000) 2019-11-29T03:18:50.279 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:18:50.276+0000 1694c700 -1 osd.0 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.915742+0000 front 2019-11-29T03:17:53.937938+0000 (oldest deadline 2019-11-29T03:18:36.758931+0000) 2019-11-29T03:18:50.304 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:18:50.301+0000 1694c700 -1 osd.2 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.420214+0000 front 2019-11-29T03:17:53.421005+0000 (oldest deadline 2019-11-29T03:18:36.934205+0000) 2019-11-29T03:18:50.568 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:18:50.562+0000 1694c700 -1 osd.6 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.895745+0000 front 2019-11-29T03:17:53.894040+0000 (oldest deadline 2019-11-29T03:18:34.810411+0000) 2019-11-29T03:18:50.614 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:18:50.608+0000 1694c700 -1 osd.7 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:50.671486+0000 front 2019-11-29T03:17:50.606946+0000 (oldest deadline 2019-11-29T03:18:36.466386+0000) 2019-11-29T03:18:51.077 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:18:51.072+0000 1694c700 -1 osd.5 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.874289+0000 front 2019-11-29T03:17:53.824594+0000 (oldest deadline 2019-11-29T03:18:35.914158+0000) 2019-11-29T03:18:51.165 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:18:51.160+0000 1694c700 -1 osd.4 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:51.610299+0000 front 2019-11-29T03:17:51.658038+0000 (oldest deadline 2019-11-29T03:18:34.477474+0000) 2019-11-29T03:18:51.291 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:18:51.287+0000 1694c700 -1 osd.0 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.915742+0000 front 2019-11-29T03:17:53.937938+0000 (oldest deadline 2019-11-29T03:18:36.758931+0000) 2019-11-29T03:18:51.337 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:18:51.334+0000 1694c700 -1 osd.2 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.420214+0000 front 2019-11-29T03:17:53.421005+0000 (oldest deadline 2019-11-29T03:18:36.934205+0000) 2019-11-29T03:18:51.577 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:18:51.572+0000 1694c700 -1 osd.7 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:50.671486+0000 front 2019-11-29T03:17:50.606946+0000 (oldest deadline 2019-11-29T03:18:36.466386+0000) 2019-11-29T03:18:51.606 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:18:51.600+0000 1694c700 -1 osd.6 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.895745+0000 front 2019-11-29T03:17:53.894040+0000 (oldest deadline 2019-11-29T03:18:34.810411+0000) 2019-11-29T03:18:52.094 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:18:52.088+0000 1694c700 -1 osd.5 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.874289+0000 front 2019-11-29T03:17:53.824594+0000 (oldest deadline 2019-11-29T03:18:35.914158+0000) 2019-11-29T03:18:52.196 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:18:52.191+0000 1694c700 -1 osd.4 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:51.610299+0000 front 2019-11-29T03:17:51.658038+0000 (oldest deadline 2019-11-29T03:18:34.477474+0000) 2019-11-29T03:18:52.321 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:18:52.316+0000 1694c700 -1 osd.0 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.915742+0000 front 2019-11-29T03:17:53.937938+0000 (oldest deadline 2019-11-29T03:18:36.758931+0000) 2019-11-29T03:18:52.371 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:18:52.366+0000 1694c700 -1 osd.2 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.420214+0000 front 2019-11-29T03:17:53.421005+0000 (oldest deadline 2019-11-29T03:18:36.934205+0000) 2019-11-29T03:18:52.630 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:18:52.624+0000 1694c700 -1 osd.7 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:50.671486+0000 front 2019-11-29T03:17:50.606946+0000 (oldest deadline 2019-11-29T03:18:36.466386+0000) 2019-11-29T03:18:52.633 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:18:52.628+0000 1694c700 -1 osd.6 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.895745+0000 front 2019-11-29T03:17:53.894040+0000 (oldest deadline 2019-11-29T03:18:34.810411+0000) 2019-11-29T03:18:53.068 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:18:53.062+0000 1694c700 -1 osd.5 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.874289+0000 front 2019-11-29T03:17:53.824594+0000 (oldest deadline 2019-11-29T03:18:35.914158+0000) 2019-11-29T03:18:53.154 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:18:53.150+0000 1694c700 -1 osd.4 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:51.610299+0000 front 2019-11-29T03:17:51.658038+0000 (oldest deadline 2019-11-29T03:18:34.477474+0000) 2019-11-29T03:18:53.277 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:18:53.273+0000 1694c700 -1 osd.0 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.915742+0000 front 2019-11-29T03:17:53.937938+0000 (oldest deadline 2019-11-29T03:18:36.758931+0000) 2019-11-29T03:18:53.402 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:18:53.398+0000 1694c700 -1 osd.2 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.420214+0000 front 2019-11-29T03:17:53.421005+0000 (oldest deadline 2019-11-29T03:18:36.934205+0000) 2019-11-29T03:18:53.600 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:18:53.594+0000 1694c700 -1 osd.6 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.895745+0000 front 2019-11-29T03:17:53.894040+0000 (oldest deadline 2019-11-29T03:18:34.810411+0000) 2019-11-29T03:18:53.617 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:18:53.612+0000 1694c700 -1 osd.7 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:50.671486+0000 front 2019-11-29T03:17:50.606946+0000 (oldest deadline 2019-11-29T03:18:36.466386+0000) 2019-11-29T03:18:54.067 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:18:54.061+0000 1694c700 -1 osd.5 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.874289+0000 front 2019-11-29T03:17:53.824594+0000 (oldest deadline 2019-11-29T03:18:35.914158+0000) 2019-11-29T03:18:54.177 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:18:54.172+0000 1694c700 -1 osd.4 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:51.610299+0000 front 2019-11-29T03:17:51.658038+0000 (oldest deadline 2019-11-29T03:18:34.477474+0000) 2019-11-29T03:18:54.238 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:18:54.234+0000 1694c700 -1 osd.0 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.915742+0000 front 2019-11-29T03:17:53.937938+0000 (oldest deadline 2019-11-29T03:18:36.758931+0000) 2019-11-29T03:18:54.415 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:18:54.411+0000 1694c700 -1 osd.2 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.420214+0000 front 2019-11-29T03:17:53.421005+0000 (oldest deadline 2019-11-29T03:18:36.934205+0000) 2019-11-29T03:18:54.600 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:18:54.594+0000 1694c700 -1 osd.6 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.895745+0000 front 2019-11-29T03:17:53.894040+0000 (oldest deadline 2019-11-29T03:18:34.810411+0000) 2019-11-29T03:18:54.652 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:18:54.646+0000 1694c700 -1 osd.7 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:50.671486+0000 front 2019-11-29T03:17:50.606946+0000 (oldest deadline 2019-11-29T03:18:36.466386+0000) 2019-11-29T03:18:55.083 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:18:55.077+0000 1694c700 -1 osd.5 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.874289+0000 front 2019-11-29T03:17:53.824594+0000 (oldest deadline 2019-11-29T03:18:35.914158+0000) 2019-11-29T03:18:55.206 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:18:55.203+0000 1694c700 -1 osd.0 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.915742+0000 front 2019-11-29T03:17:53.937938+0000 (oldest deadline 2019-11-29T03:18:36.758931+0000) 2019-11-29T03:18:55.229 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:18:55.224+0000 1694c700 -1 osd.4 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:51.610299+0000 front 2019-11-29T03:17:51.658038+0000 (oldest deadline 2019-11-29T03:18:34.477474+0000) 2019-11-29T03:18:55.372 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:18:55.368+0000 1694c700 -1 osd.2 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.420214+0000 front 2019-11-29T03:17:53.421005+0000 (oldest deadline 2019-11-29T03:18:36.934205+0000) 2019-11-29T03:18:55.561 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:18:55.555+0000 1694c700 -1 osd.6 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.895745+0000 front 2019-11-29T03:17:53.894040+0000 (oldest deadline 2019-11-29T03:18:34.810411+0000) 2019-11-29T03:18:55.675 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:18:55.669+0000 1694c700 -1 osd.7 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:50.671486+0000 front 2019-11-29T03:17:50.606946+0000 (oldest deadline 2019-11-29T03:18:36.466386+0000) 2019-11-29T03:18:56.136 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:18:56.130+0000 1694c700 -1 osd.5 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.874289+0000 front 2019-11-29T03:17:53.824594+0000 (oldest deadline 2019-11-29T03:18:35.914158+0000) 2019-11-29T03:18:56.199 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:18:56.194+0000 1694c700 -1 osd.0 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.915742+0000 front 2019-11-29T03:17:53.937938+0000 (oldest deadline 2019-11-29T03:18:36.758931+0000) 2019-11-29T03:18:56.225 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:18:56.219+0000 1694c700 -1 osd.4 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:51.610299+0000 front 2019-11-29T03:17:51.658038+0000 (oldest deadline 2019-11-29T03:18:34.477474+0000) 2019-11-29T03:18:56.422 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:18:56.418+0000 1694c700 -1 osd.2 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.420214+0000 front 2019-11-29T03:17:53.421005+0000 (oldest deadline 2019-11-29T03:18:36.934205+0000) 2019-11-29T03:18:56.564 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:18:56.558+0000 1694c700 -1 osd.6 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.895745+0000 front 2019-11-29T03:17:53.894040+0000 (oldest deadline 2019-11-29T03:18:34.810411+0000) 2019-11-29T03:18:56.661 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:18:56.656+0000 1694c700 -1 osd.7 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:50.671486+0000 front 2019-11-29T03:17:50.606946+0000 (oldest deadline 2019-11-29T03:18:36.466386+0000) 2019-11-29T03:18:57.140 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:18:57.134+0000 1694c700 -1 osd.5 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.874289+0000 front 2019-11-29T03:17:53.824594+0000 (oldest deadline 2019-11-29T03:18:35.914158+0000) 2019-11-29T03:18:57.197 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:18:57.191+0000 1694c700 -1 osd.4 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:51.610299+0000 front 2019-11-29T03:17:51.658038+0000 (oldest deadline 2019-11-29T03:18:34.477474+0000) 2019-11-29T03:18:57.247 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:18:57.242+0000 1694c700 -1 osd.0 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.915742+0000 front 2019-11-29T03:17:53.937938+0000 (oldest deadline 2019-11-29T03:18:36.758931+0000) 2019-11-29T03:18:57.441 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:18:57.436+0000 1694c700 -1 osd.2 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.420214+0000 front 2019-11-29T03:17:53.421005+0000 (oldest deadline 2019-11-29T03:18:36.934205+0000) 2019-11-29T03:18:57.603 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:18:57.598+0000 1694c700 -1 osd.6 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.895745+0000 front 2019-11-29T03:17:53.894040+0000 (oldest deadline 2019-11-29T03:18:34.810411+0000) 2019-11-29T03:18:57.710 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:18:57.705+0000 1694c700 -1 osd.7 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:50.671486+0000 front 2019-11-29T03:17:50.606946+0000 (oldest deadline 2019-11-29T03:18:36.466386+0000) 2019-11-29T03:18:58.100 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:18:58.095+0000 1694c700 -1 osd.5 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.874289+0000 front 2019-11-29T03:17:53.824594+0000 (oldest deadline 2019-11-29T03:18:35.914158+0000) 2019-11-29T03:18:58.242 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:18:58.237+0000 1694c700 -1 osd.0 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.915742+0000 front 2019-11-29T03:17:53.937938+0000 (oldest deadline 2019-11-29T03:18:36.758931+0000) 2019-11-29T03:18:58.252 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:18:58.247+0000 1694c700 -1 osd.4 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:51.610299+0000 front 2019-11-29T03:17:51.658038+0000 (oldest deadline 2019-11-29T03:18:34.477474+0000) 2019-11-29T03:18:58.434 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:18:58.429+0000 1694c700 -1 osd.2 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.420214+0000 front 2019-11-29T03:17:53.421005+0000 (oldest deadline 2019-11-29T03:18:36.934205+0000) 2019-11-29T03:18:58.596 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:18:58.590+0000 1694c700 -1 osd.6 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.895745+0000 front 2019-11-29T03:17:53.894040+0000 (oldest deadline 2019-11-29T03:18:34.810411+0000) 2019-11-29T03:18:58.730 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:18:58.725+0000 1694c700 -1 osd.7 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:50.671486+0000 front 2019-11-29T03:17:50.606946+0000 (oldest deadline 2019-11-29T03:18:36.466386+0000) 2019-11-29T03:18:59.134 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:18:59.128+0000 1694c700 -1 osd.5 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.874289+0000 front 2019-11-29T03:17:53.824594+0000 (oldest deadline 2019-11-29T03:18:35.914158+0000) 2019-11-29T03:18:59.200 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:18:59.196+0000 1694c700 -1 osd.0 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.915742+0000 front 2019-11-29T03:17:53.937938+0000 (oldest deadline 2019-11-29T03:18:36.758931+0000) 2019-11-29T03:18:59.302 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:18:59.298+0000 1694c700 -1 osd.4 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:51.610299+0000 front 2019-11-29T03:17:51.658038+0000 (oldest deadline 2019-11-29T03:18:34.477474+0000) 2019-11-29T03:18:59.397 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:18:59.394+0000 1694c700 -1 osd.2 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.420214+0000 front 2019-11-29T03:17:53.421005+0000 (oldest deadline 2019-11-29T03:18:36.934205+0000) 2019-11-29T03:18:59.625 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:18:59.619+0000 1694c700 -1 osd.6 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.895745+0000 front 2019-11-29T03:17:53.894040+0000 (oldest deadline 2019-11-29T03:18:34.810411+0000) 2019-11-29T03:18:59.772 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:18:59.767+0000 1694c700 -1 osd.7 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:50.671486+0000 front 2019-11-29T03:17:50.606946+0000 (oldest deadline 2019-11-29T03:18:36.466386+0000) 2019-11-29T03:19:00.098 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:19:00.092+0000 1694c700 -1 osd.5 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.874289+0000 front 2019-11-29T03:17:53.824594+0000 (oldest deadline 2019-11-29T03:18:35.914158+0000) 2019-11-29T03:19:00.215 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:19:00.211+0000 1694c700 -1 osd.0 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.915742+0000 front 2019-11-29T03:17:53.937938+0000 (oldest deadline 2019-11-29T03:18:36.758931+0000) 2019-11-29T03:19:00.274 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:19:00.269+0000 1694c700 -1 osd.4 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:51.610299+0000 front 2019-11-29T03:17:51.658038+0000 (oldest deadline 2019-11-29T03:18:34.477474+0000) 2019-11-29T03:19:00.443 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:19:00.439+0000 1694c700 -1 osd.2 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.420214+0000 front 2019-11-29T03:17:53.421005+0000 (oldest deadline 2019-11-29T03:18:36.934205+0000) 2019-11-29T03:19:00.675 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:19:00.670+0000 1694c700 -1 osd.6 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.895745+0000 front 2019-11-29T03:17:53.894040+0000 (oldest deadline 2019-11-29T03:18:34.810411+0000) 2019-11-29T03:19:00.729 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:19:00.723+0000 1694c700 -1 osd.7 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:50.671486+0000 front 2019-11-29T03:17:50.606946+0000 (oldest deadline 2019-11-29T03:18:36.466386+0000) 2019-11-29T03:19:01.132 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:19:01.126+0000 1694c700 -1 osd.5 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.874289+0000 front 2019-11-29T03:17:53.824594+0000 (oldest deadline 2019-11-29T03:18:35.914158+0000) 2019-11-29T03:19:01.217 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:19:01.213+0000 1694c700 -1 osd.0 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.915742+0000 front 2019-11-29T03:17:53.937938+0000 (oldest deadline 2019-11-29T03:18:36.758931+0000) 2019-11-29T03:19:01.287 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:19:01.282+0000 1694c700 -1 osd.4 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:51.610299+0000 front 2019-11-29T03:17:51.658038+0000 (oldest deadline 2019-11-29T03:18:34.477474+0000) 2019-11-29T03:19:01.446 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:19:01.443+0000 1694c700 -1 osd.2 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.420214+0000 front 2019-11-29T03:17:53.421005+0000 (oldest deadline 2019-11-29T03:18:36.934205+0000) 2019-11-29T03:19:01.670 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:19:01.665+0000 1694c700 -1 osd.6 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.895745+0000 front 2019-11-29T03:17:53.894040+0000 (oldest deadline 2019-11-29T03:18:34.810411+0000) 2019-11-29T03:19:01.755 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:19:01.750+0000 1694c700 -1 osd.7 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:50.671486+0000 front 2019-11-29T03:17:50.606946+0000 (oldest deadline 2019-11-29T03:18:36.466386+0000) 2019-11-29T03:19:02.174 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:19:02.169+0000 1694c700 -1 osd.0 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.915742+0000 front 2019-11-29T03:17:53.937938+0000 (oldest deadline 2019-11-29T03:18:36.758931+0000) 2019-11-29T03:19:02.175 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:19:02.170+0000 1694c700 -1 osd.5 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.874289+0000 front 2019-11-29T03:17:53.824594+0000 (oldest deadline 2019-11-29T03:18:35.914158+0000) 2019-11-29T03:19:02.272 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:19:02.266+0000 1694c700 -1 osd.4 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:51.610299+0000 front 2019-11-29T03:17:51.658038+0000 (oldest deadline 2019-11-29T03:18:34.477474+0000) 2019-11-29T03:19:02.485 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:19:02.482+0000 1694c700 -1 osd.2 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.420214+0000 front 2019-11-29T03:17:53.421005+0000 (oldest deadline 2019-11-29T03:18:36.934205+0000) 2019-11-29T03:19:02.646 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:19:02.640+0000 1694c700 -1 osd.6 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.895745+0000 front 2019-11-29T03:17:53.894040+0000 (oldest deadline 2019-11-29T03:18:34.810411+0000) 2019-11-29T03:19:02.803 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:19:02.797+0000 1694c700 -1 osd.7 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:50.671486+0000 front 2019-11-29T03:17:50.606946+0000 (oldest deadline 2019-11-29T03:18:36.466386+0000) 2019-11-29T03:19:03.150 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:19:03.144+0000 1694c700 -1 osd.5 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.874289+0000 front 2019-11-29T03:17:53.824594+0000 (oldest deadline 2019-11-29T03:18:35.914158+0000) 2019-11-29T03:19:03.151 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:19:03.147+0000 1694c700 -1 osd.0 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.915742+0000 front 2019-11-29T03:17:53.937938+0000 (oldest deadline 2019-11-29T03:18:36.758931+0000) 2019-11-29T03:19:03.258 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:19:03.252+0000 1694c700 -1 osd.4 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:51.610299+0000 front 2019-11-29T03:17:51.658038+0000 (oldest deadline 2019-11-29T03:18:34.477474+0000) 2019-11-29T03:19:03.536 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:19:03.532+0000 1694c700 -1 osd.2 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.420214+0000 front 2019-11-29T03:17:53.421005+0000 (oldest deadline 2019-11-29T03:18:36.934205+0000) 2019-11-29T03:19:03.622 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:19:03.617+0000 1694c700 -1 osd.6 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.895745+0000 front 2019-11-29T03:17:53.894040+0000 (oldest deadline 2019-11-29T03:18:34.810411+0000) 2019-11-29T03:19:03.834 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:19:03.828+0000 1694c700 -1 osd.7 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:50.671486+0000 front 2019-11-29T03:17:50.606946+0000 (oldest deadline 2019-11-29T03:18:36.466386+0000) 2019-11-29T03:19:04.113 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:19:04.107+0000 1694c700 -1 osd.5 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.874289+0000 front 2019-11-29T03:17:53.824594+0000 (oldest deadline 2019-11-29T03:18:35.914158+0000) 2019-11-29T03:19:04.203 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:19:04.200+0000 1694c700 -1 osd.0 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.915742+0000 front 2019-11-29T03:17:53.937938+0000 (oldest deadline 2019-11-29T03:18:36.758931+0000) 2019-11-29T03:19:04.280 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:19:04.275+0000 1694c700 -1 osd.4 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:51.610299+0000 front 2019-11-29T03:17:51.658038+0000 (oldest deadline 2019-11-29T03:18:34.477474+0000) 2019-11-29T03:19:04.560 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:19:04.557+0000 1694c700 -1 osd.2 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.420214+0000 front 2019-11-29T03:17:53.421005+0000 (oldest deadline 2019-11-29T03:18:36.934205+0000) 2019-11-29T03:19:04.616 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:19:04.610+0000 1694c700 -1 osd.6 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.895745+0000 front 2019-11-29T03:17:53.894040+0000 (oldest deadline 2019-11-29T03:18:34.810411+0000) 2019-11-29T03:19:04.885 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:19:04.879+0000 1694c700 -1 osd.7 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:50.671486+0000 front 2019-11-29T03:17:50.606946+0000 (oldest deadline 2019-11-29T03:18:36.466386+0000) 2019-11-29T03:19:05.109 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:19:05.103+0000 1694c700 -1 osd.5 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.874289+0000 front 2019-11-29T03:17:53.824594+0000 (oldest deadline 2019-11-29T03:18:35.914158+0000) 2019-11-29T03:19:05.221 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:19:05.216+0000 1694c700 -1 osd.0 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.915742+0000 front 2019-11-29T03:17:53.937938+0000 (oldest deadline 2019-11-29T03:18:36.758931+0000) 2019-11-29T03:19:05.260 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:19:05.257+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.74:6802/10096,v1:172.21.15.74:6803/10096] for 43sec e230 v230) 2019-11-29T03:19:05.325 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:19:05.318+0000 1694c700 -1 osd.4 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:51.610299+0000 front 2019-11-29T03:17:51.658038+0000 (oldest deadline 2019-11-29T03:18:34.477474+0000) 2019-11-29T03:19:05.593 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:19:05.587+0000 1694c700 -1 osd.6 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.895745+0000 front 2019-11-29T03:17:53.894040+0000 (oldest deadline 2019-11-29T03:18:34.810411+0000) 2019-11-29T03:19:05.600 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:19:05.595+0000 1694c700 -1 osd.2 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.420214+0000 front 2019-11-29T03:17:53.421005+0000 (oldest deadline 2019-11-29T03:18:36.934205+0000) 2019-11-29T03:19:05.912 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:19:05.906+0000 1694c700 -1 osd.7 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:50.671486+0000 front 2019-11-29T03:17:50.606946+0000 (oldest deadline 2019-11-29T03:18:36.466386+0000) 2019-11-29T03:19:06.070 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:19:06.064+0000 1694c700 -1 osd.5 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.874289+0000 front 2019-11-29T03:17:53.824594+0000 (oldest deadline 2019-11-29T03:18:35.914158+0000) 2019-11-29T03:19:06.222 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:19:06.217+0000 1694c700 -1 osd.0 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.915742+0000 front 2019-11-29T03:17:53.937938+0000 (oldest deadline 2019-11-29T03:18:36.758931+0000) 2019-11-29T03:19:06.279 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:19:06.274+0000 1694c700 -1 osd.4 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:51.610299+0000 front 2019-11-29T03:17:51.658038+0000 (oldest deadline 2019-11-29T03:18:34.477474+0000) 2019-11-29T03:19:06.578 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:19:06.572+0000 1694c700 -1 osd.6 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.895745+0000 front 2019-11-29T03:17:53.894040+0000 (oldest deadline 2019-11-29T03:18:34.810411+0000) 2019-11-29T03:19:06.589 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:19:06.584+0000 1694c700 -1 osd.2 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.420214+0000 front 2019-11-29T03:17:53.421005+0000 (oldest deadline 2019-11-29T03:18:36.934205+0000) 2019-11-29T03:19:06.894 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:19:06.885+0000 1694c700 -1 osd.7 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:50.671486+0000 front 2019-11-29T03:17:50.606946+0000 (oldest deadline 2019-11-29T03:18:36.466386+0000) 2019-11-29T03:19:07.112 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:19:07.106+0000 1694c700 -1 osd.5 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.874289+0000 front 2019-11-29T03:17:53.824594+0000 (oldest deadline 2019-11-29T03:18:35.914158+0000) 2019-11-29T03:19:07.185 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:19:07.181+0000 1694c700 -1 osd.0 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.915742+0000 front 2019-11-29T03:17:53.937938+0000 (oldest deadline 2019-11-29T03:18:36.758931+0000) 2019-11-29T03:19:07.240 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:19:07.234+0000 1694c700 -1 osd.4 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:51.610299+0000 front 2019-11-29T03:17:51.658038+0000 (oldest deadline 2019-11-29T03:18:34.477474+0000) 2019-11-29T03:19:07.542 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:19:07.536+0000 1694c700 -1 osd.6 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.895745+0000 front 2019-11-29T03:17:53.894040+0000 (oldest deadline 2019-11-29T03:18:34.810411+0000) 2019-11-29T03:19:07.569 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:19:07.565+0000 1694c700 -1 osd.2 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.420214+0000 front 2019-11-29T03:17:53.421005+0000 (oldest deadline 2019-11-29T03:18:36.934205+0000) 2019-11-29T03:19:07.741 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:19:07.737+0000 1694c700 -1 osd.1 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.742719+0000 front 2019-11-29T03:17:53.338477+0000 (oldest deadline 2019-11-29T03:19:07.432445+0000) 2019-11-29T03:19:07.931 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:19:07.925+0000 1694c700 -1 osd.7 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:50.671486+0000 front 2019-11-29T03:17:50.606946+0000 (oldest deadline 2019-11-29T03:18:36.466386+0000) 2019-11-29T03:19:08.113 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:19:08.108+0000 1694c700 -1 osd.5 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.874289+0000 front 2019-11-29T03:17:53.824594+0000 (oldest deadline 2019-11-29T03:18:35.914158+0000) 2019-11-29T03:19:08.143 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:19:08.138+0000 1694c700 -1 osd.0 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.915742+0000 front 2019-11-29T03:17:53.937938+0000 (oldest deadline 2019-11-29T03:18:36.758931+0000) 2019-11-29T03:19:08.291 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:19:08.285+0000 1694c700 -1 osd.4 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:51.610299+0000 front 2019-11-29T03:17:51.658038+0000 (oldest deadline 2019-11-29T03:18:34.477474+0000) 2019-11-29T03:19:08.526 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:19:08.522+0000 1694c700 -1 osd.2 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.420214+0000 front 2019-11-29T03:17:53.421005+0000 (oldest deadline 2019-11-29T03:18:36.934205+0000) 2019-11-29T03:19:08.551 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:19:08.541+0000 1694c700 -1 osd.6 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.895745+0000 front 2019-11-29T03:17:53.894040+0000 (oldest deadline 2019-11-29T03:18:34.810411+0000) 2019-11-29T03:19:08.707 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:19:08.702+0000 1694c700 -1 osd.1 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.742719+0000 front 2019-11-29T03:17:53.338477+0000 (oldest deadline 2019-11-29T03:19:07.432445+0000) 2019-11-29T03:19:08.901 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:19:08.895+0000 1694c700 -1 osd.7 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:50.671486+0000 front 2019-11-29T03:17:50.606946+0000 (oldest deadline 2019-11-29T03:18:36.466386+0000) 2019-11-29T03:19:09.162 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:19:09.156+0000 1694c700 -1 osd.5 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.874289+0000 front 2019-11-29T03:17:53.824594+0000 (oldest deadline 2019-11-29T03:18:35.914158+0000) 2019-11-29T03:19:09.193 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:19:09.190+0000 1694c700 -1 osd.0 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.915742+0000 front 2019-11-29T03:17:53.937938+0000 (oldest deadline 2019-11-29T03:18:36.758931+0000) 2019-11-29T03:19:09.284 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:19:09.277+0000 1694c700 -1 osd.4 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:51.610299+0000 front 2019-11-29T03:17:51.658038+0000 (oldest deadline 2019-11-29T03:18:34.477474+0000) 2019-11-29T03:19:09.531 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:19:09.525+0000 1694c700 -1 osd.2 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.420214+0000 front 2019-11-29T03:17:53.421005+0000 (oldest deadline 2019-11-29T03:18:36.934205+0000) 2019-11-29T03:19:09.589 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:19:09.584+0000 1694c700 -1 osd.6 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.895745+0000 front 2019-11-29T03:17:53.894040+0000 (oldest deadline 2019-11-29T03:18:34.810411+0000) 2019-11-29T03:19:09.748 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:19:09.744+0000 1694c700 -1 osd.1 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.742719+0000 front 2019-11-29T03:17:53.338477+0000 (oldest deadline 2019-11-29T03:19:07.432445+0000) 2019-11-29T03:19:09.879 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:19:09.874+0000 1694c700 -1 osd.7 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:50.671486+0000 front 2019-11-29T03:17:50.606946+0000 (oldest deadline 2019-11-29T03:18:36.466386+0000) 2019-11-29T03:19:10.171 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:19:10.166+0000 1694c700 -1 osd.0 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.915742+0000 front 2019-11-29T03:17:53.937938+0000 (oldest deadline 2019-11-29T03:18:36.758931+0000) 2019-11-29T03:19:10.185 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:19:10.179+0000 1694c700 -1 osd.5 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.874289+0000 front 2019-11-29T03:17:53.824594+0000 (oldest deadline 2019-11-29T03:18:35.914158+0000) 2019-11-29T03:19:10.301 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:19:10.296+0000 1694c700 -1 osd.4 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:51.610299+0000 front 2019-11-29T03:17:51.658038+0000 (oldest deadline 2019-11-29T03:18:34.477474+0000) 2019-11-29T03:19:10.346 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:19:10.337+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.74:6802/10096,v1:172.21.15.74:6803/10096] for 43sec e230 v230) 2019-11-29T03:19:10.485 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:19:10.481+0000 1694c700 -1 osd.2 230 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:17:53.420214+0000 front 2019-11-29T03:17:53.421005+0000 (oldest deadline 2019-11-29T03:18:36.934205+0000) 2019-11-29T03:19:42.672 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:33:24.889 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:19:42.679 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:33:24.895 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:19:42.687 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:33:24.905 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:19:42.692 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:33:24.910 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:19:42.709 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:33:24.937 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:19:42.724 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:33:24.953 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:19:42.884 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:33:25.102 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:19:42.944 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:33:25.161 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:19:43.001 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:33:25.230 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:20:07.407 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:07.401+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:08.409 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:08.404+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:08.990 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:08.985+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:09.143 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:09.137+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:09.410 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:09.404+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:09.695 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:09.691+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:10.042 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:10.037+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:10.176 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:10.174+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:10.372 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:10.367+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:10.394 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:10.391+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:10.405 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:10.399+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:10.665 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:10.661+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:11.063 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:11.056+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:11.135 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:11.128+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:11.419 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:11.417+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:11.420 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:11.414+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:11.423 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:11.417+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:11.670 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:11.668+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:12.034 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:12.029+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:12.109 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:12.106+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:12.271 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:12.269+0000 1694c700 -1 osd.3 236 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:106605 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e234) 2019-11-29T03:20:12.376 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:12.372+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:12.410 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:12.405+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:12.445 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:12.441+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:12.688 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:12.685+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:13.008 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:13.003+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:13.104 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:13.102+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:13.324 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:13.322+0000 1694c700 -1 osd.3 236 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:106605 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e234) 2019-11-29T03:20:13.413 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:13.407+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:13.417 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:13.414+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:13.450 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:13.444+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:13.668 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:13.665+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:13.963 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:13.959+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:14.143 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:14.141+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:14.336 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:14.334+0000 1694c700 -1 osd.3 236 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:106605 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e234) 2019-11-29T03:20:14.379 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:14.375+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:14.418 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:14.412+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:14.447 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:14.442+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:14.672 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:14.669+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:15.016 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:15.011+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:15.112 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:15.109+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:15.328 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:15.326+0000 1694c700 -1 osd.3 236 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:106605 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e234) 2019-11-29T03:20:15.350 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:15.348+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:15.372 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:15.368+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:15.477 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:15.467+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:15.644 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:15.641+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:15.978 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:15.973+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:16.118 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:16.109+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:16.336 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:16.333+0000 1694c700 -1 osd.3 236 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:106605 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e234) 2019-11-29T03:20:16.354 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:16.352+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:16.357 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:16.351+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:16.472 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:16.467+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:16.663 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:16.661+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:16.972 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:16.966+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:17.090 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:17.087+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:17.308 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:17.306+0000 1694c700 -1 osd.3 236 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:106605 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e234) 2019-11-29T03:20:17.390 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:17.387+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:17.402 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:17.395+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:17.472 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:17.467+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:17.671 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:17.668+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:17.969 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:17.963+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:18.129 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:18.126+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:18.314 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:18.312+0000 1694c700 -1 osd.3 236 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:106605 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e234) 2019-11-29T03:20:18.417 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:18.415+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:18.423 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:18.417+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:18.466 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:18.461+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:18.720 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:18.717+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:19.023 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:19.017+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:19.156 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:19.153+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:19.296 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:19.293+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:19:38.618672+0000 (oldest deadline 2019-11-29T03:20:18.618672+0000) 2019-11-29T03:20:19.297 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:19.294+0000 1694c700 -1 osd.3 236 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:106605 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e234) 2019-11-29T03:20:19.402 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:19.399+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:19.428 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:19.422+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:19.513 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:19.506+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:19.746 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:19.743+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:20.045 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:20.041+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:20.149 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:20.146+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:20.278 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:20.276+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:19:38.618672+0000 (oldest deadline 2019-11-29T03:20:18.618672+0000) 2019-11-29T03:20:20.281 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:20.279+0000 1694c700 -1 osd.3 236 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:106605 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e234) 2019-11-29T03:20:20.426 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:20.421+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:20.440 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:20.436+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:20.549 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:20.545+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:20.767 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:20.764+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:21.061 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:21.055+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:21.158 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:21.155+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:21.261 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:21.258+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:19:38.618672+0000 (oldest deadline 2019-11-29T03:20:18.618672+0000) 2019-11-29T03:20:21.264 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:21.262+0000 1694c700 -1 osd.3 236 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:106605 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e234) 2019-11-29T03:20:21.438 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:21.433+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:21.476 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:21.470+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:21.585 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:21.580+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:21.750 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:21.746+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:22.110 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:22.106+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:22.138 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:22.135+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:22.272 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:22.269+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:19:38.618672+0000 (oldest deadline 2019-11-29T03:20:18.618672+0000) 2019-11-29T03:20:22.276 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:22.274+0000 1694c700 -1 osd.3 236 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:106605 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e234) 2019-11-29T03:20:22.421 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:22.415+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:22.456 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:22.451+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:22.548 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:22.543+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:22.714 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:22.710+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:23.118 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:23.113+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:23.132 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:23.128+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:23.239 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:23.234+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:19:38.618672+0000 (oldest deadline 2019-11-29T03:20:18.618672+0000) 2019-11-29T03:20:23.240 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:23.236+0000 1694c700 -1 osd.3 236 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:106605 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e234) 2019-11-29T03:20:23.440 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:23.436+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:23.467 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:23.463+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:23.543 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:23.538+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:23.699 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:23.695+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:24.096 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:24.092+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:24.144 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:24.139+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:24.262 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:24.258+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:19:38.618672+0000 (oldest deadline 2019-11-29T03:20:18.618672+0000) 2019-11-29T03:20:24.263 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:24.259+0000 1694c700 -1 osd.3 236 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:106605 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e234) 2019-11-29T03:20:24.419 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:24.414+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:24.453 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:24.449+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:24.565 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:24.560+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:24.739 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:24.735+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:25.051 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:25.048+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:25.118 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:25.114+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:25.220 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:25.216+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:19:38.618672+0000 (oldest deadline 2019-11-29T03:20:18.618672+0000) 2019-11-29T03:20:25.221 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:25.217+0000 1694c700 -1 osd.3 236 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:106605 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e234) 2019-11-29T03:20:25.406 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:25.400+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:25.501 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:25.498+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:25.549 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:25.544+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:25.777 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:25.773+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:26.052 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:26.048+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:26.106 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:26.101+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:26.238 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:26.232+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:19:38.618672+0000 (oldest deadline 2019-11-29T03:20:18.618672+0000) 2019-11-29T03:20:26.238 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:26.235+0000 1694c700 -1 osd.3 236 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:106605 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e234) 2019-11-29T03:20:26.447 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:26.442+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:26.467 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:26.462+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:26.531 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:26.525+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:26.756 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:26.751+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:27.102 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:27.099+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:27.159 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:27.155+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:27.271 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:27.267+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:19:38.618672+0000 (oldest deadline 2019-11-29T03:20:18.618672+0000) 2019-11-29T03:20:27.273 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:27.270+0000 1694c700 -1 osd.3 236 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:106605 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e234) 2019-11-29T03:20:27.421 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:27.415+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:27.469 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:27.465+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:27.567 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:27.562+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:27.805 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:27.801+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:28.059 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:28.056+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:28.168 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:28.163+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:28.302 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:28.298+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:19:38.618672+0000 (oldest deadline 2019-11-29T03:20:18.618672+0000) 2019-11-29T03:20:28.303 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:28.300+0000 1694c700 -1 osd.3 236 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:106605 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e234) 2019-11-29T03:20:28.452 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:28.445+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:28.457 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:28.453+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:28.557 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:28.552+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:28.813 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:28.809+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:29.053 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:29.049+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:29.175 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:29.170+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:29.321 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:29.317+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:19:38.618672+0000 (oldest deadline 2019-11-29T03:20:18.618672+0000) 2019-11-29T03:20:29.324 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:29.321+0000 1694c700 -1 osd.3 236 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:106605 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e234) 2019-11-29T03:20:29.414 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:29.409+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:29.428 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:29.417+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:29.565 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:29.558+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:29.842 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:29.839+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:30.035 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:30.031+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:30.170 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:30.165+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:30.335 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:30.331+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:19:38.618672+0000 (oldest deadline 2019-11-29T03:20:18.618672+0000) 2019-11-29T03:20:30.338 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:30.335+0000 1694c700 -1 osd.3 236 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:106605 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e234) 2019-11-29T03:20:30.432 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:30.428+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:30.472 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:30.461+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:30.557 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:30.552+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:30.817 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:30.813+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:31.062 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:31.057+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:31.209 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:31.204+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:31.296 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:31.293+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:19:38.618672+0000 (oldest deadline 2019-11-29T03:20:18.618672+0000) 2019-11-29T03:20:31.298 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:31.296+0000 1694c700 -1 osd.3 236 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:106605 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e234) 2019-11-29T03:20:31.436 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:31.432+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:31.482 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:31.479+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:31.596 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:31.591+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:31.813 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:31.808+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:32.054 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:32.050+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:32.208 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:32.203+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:32.255 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:32.251+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:19:38.618672+0000 (oldest deadline 2019-11-29T03:20:18.618672+0000) 2019-11-29T03:20:32.257 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:32.254+0000 1694c700 -1 osd.3 236 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:106605 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e234) 2019-11-29T03:20:32.430 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:32.426+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:32.468 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:32.465+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:32.603 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:32.598+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:32.863 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:32.859+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:33.052 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:33.048+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:33.176 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:33.171+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:33.224 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:33.221+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:19:38.618672+0000 (oldest deadline 2019-11-29T03:20:18.618672+0000) 2019-11-29T03:20:33.226 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:33.223+0000 1694c700 -1 osd.3 236 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:106605 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e234) 2019-11-29T03:20:33.460 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:33.455+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:33.515 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:33.512+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:33.620 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:33.615+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:33.874 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:33.870+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:34.033 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:34.030+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:34.171 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:34.167+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:34.214 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:34.206+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:19:38.618672+0000 (oldest deadline 2019-11-29T03:20:18.618672+0000) 2019-11-29T03:20:34.216 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:34.209+0000 1694c700 -1 osd.3 236 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:106605 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e234) 2019-11-29T03:20:34.511 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:34.506+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:34.534 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:34.530+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:34.649 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:34.646+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:34.829 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:34.824+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:35.027 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:35.023+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:35.175 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:35.170+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:35.181 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:35.178+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:19:38.618672+0000 (oldest deadline 2019-11-29T03:20:18.618672+0000) 2019-11-29T03:20:35.183 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:35.180+0000 1694c700 -1 osd.3 236 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:106605 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e234) 2019-11-29T03:20:35.506 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:35.500+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:35.522 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:35.515+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:35.609 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:35.604+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:35.798 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:35.793+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:36.043 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:36.039+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:36.197 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:36.193+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:19:38.618672+0000 (oldest deadline 2019-11-29T03:20:18.618672+0000) 2019-11-29T03:20:36.198 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:36.194+0000 1694c700 -1 osd.3 236 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:106605 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e234) 2019-11-29T03:20:36.205 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:36.200+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:36.534 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:36.529+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:36.552 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:36.545+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:36.625 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:36.620+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:36.813 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:36.809+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:37.071 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:37.068+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:37.152 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:37.149+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:19:38.618672+0000 (oldest deadline 2019-11-29T03:20:18.618672+0000) 2019-11-29T03:20:37.154 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:37.152+0000 1694c700 -1 osd.3 236 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:106605 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e234) 2019-11-29T03:20:37.162 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:37.157+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:37.555 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:37.550+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:37.584 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:37.581+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:37.644 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:37.640+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:37.785 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:37.781+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:38.117 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:38.112+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:38.138 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:38.133+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:19:38.618672+0000 (oldest deadline 2019-11-29T03:20:18.618672+0000) 2019-11-29T03:20:38.139 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:38.135+0000 1694c700 -1 osd.3 236 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:106605 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e234) 2019-11-29T03:20:38.163 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:38.158+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:38.547 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:38.543+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:38.605 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:38.601+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:38.684 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:38.679+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:38.799 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:38.796+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:39.095 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:39.090+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:39.156 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:39.152+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:19:38.618672+0000 (oldest deadline 2019-11-29T03:20:18.618672+0000) 2019-11-29T03:20:39.160 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:39.157+0000 1694c700 -1 osd.3 236 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:106605 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e234) 2019-11-29T03:20:39.218 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:39.213+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:39.585 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:39.581+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:39.652 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:39.647+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:39.692 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:39.687+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:39.800 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:39.795+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:40.085 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:40.081+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:40.165 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:40.160+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:19:38.618672+0000 (oldest deadline 2019-11-29T03:20:18.618672+0000) 2019-11-29T03:20:40.165 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:40.162+0000 1694c700 -1 osd.3 236 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:106605 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e234) 2019-11-29T03:20:40.221 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:40.217+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:40.585 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:40.581+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:40.587 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:20:40.583+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 45sec e236 v236) 2019-11-29T03:20:40.646 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:40.640+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:40.718 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:40.713+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:40.756 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:40.752+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:41.071 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:41.067+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:41.149 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:41.145+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:19:38.618672+0000 (oldest deadline 2019-11-29T03:20:18.618672+0000) 2019-11-29T03:20:41.150 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:41.146+0000 1694c700 -1 osd.3 236 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:106605 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e234) 2019-11-29T03:20:41.273 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:41.268+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:41.604 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:41.600+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:41.642 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:41.638+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:41.695 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:41.691+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:41.801 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:41.797+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:42.045 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:42.041+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:42.149 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:42.145+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:19:38.618672+0000 (oldest deadline 2019-11-29T03:20:18.618672+0000) 2019-11-29T03:20:42.151 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:42.149+0000 1694c700 -1 osd.3 236 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:106605 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e234) 2019-11-29T03:20:42.318 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:42.313+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:42.634 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:42.630+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:42.652 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:42.647+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:42.693 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:42.688+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:42.795 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:42.792+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:43.071 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:43.067+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:43.113 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:43.108+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:19:38.618672+0000 (oldest deadline 2019-11-29T03:20:18.618672+0000) 2019-11-29T03:20:43.113 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:43.110+0000 1694c700 -1 osd.3 236 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:106605 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e234) 2019-11-29T03:20:43.327 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:43.322+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:43.606 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:43.601+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:43.641 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:43.637+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:43.663 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:43.658+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:43.788 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:43.779+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:44.076 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:44.073+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:44.114 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:44.111+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:19:38.618672+0000 (oldest deadline 2019-11-29T03:20:18.618672+0000) 2019-11-29T03:20:44.117 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:44.114+0000 1694c700 -1 osd.3 236 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:106605 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e234) 2019-11-29T03:20:44.284 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:44.279+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:44.612 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:44.606+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:44.618 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:44.614+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:44.632 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:44.627+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:44.790 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:44.785+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:45.070 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:45.066+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:45.073 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:45.069+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:19:38.618672+0000 (oldest deadline 2019-11-29T03:20:18.618672+0000) 2019-11-29T03:20:45.073 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:45.070+0000 1694c700 -1 osd.3 236 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:106605 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e234) 2019-11-29T03:20:45.299 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:45.294+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:45.594 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:45.588+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:45.606 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:45.596+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:45.608 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:20:45.604+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 45sec e236 v236) 2019-11-29T03:20:45.648 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:45.643+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:45.747 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:45.743+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:46.047 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:46.040+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:19:38.618672+0000 (oldest deadline 2019-11-29T03:20:18.618672+0000) 2019-11-29T03:20:46.051 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:46.042+0000 1694c700 -1 osd.3 236 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:106605 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e234) 2019-11-29T03:20:46.094 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:46.091+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:46.304 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:46.295+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:46.563 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:46.557+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:46.587 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:46.581+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:46.696 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:46.692+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:46.786 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:46.781+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:47.026 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:47.023+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:19:38.618672+0000 (oldest deadline 2019-11-29T03:20:18.618672+0000) 2019-11-29T03:20:47.028 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:47.026+0000 1694c700 -1 osd.3 236 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:106605 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e234) 2019-11-29T03:20:47.101 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:47.097+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:47.351 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:47.346+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:47.547 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:47.542+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:47.634 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:47.630+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:47.650 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:47.646+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:47.770 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:47.767+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:47.993 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:47.989+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:19:38.618672+0000 (oldest deadline 2019-11-29T03:20:18.618672+0000) 2019-11-29T03:20:47.999 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:47.996+0000 1694c700 -1 osd.3 236 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:106605 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e234) 2019-11-29T03:20:48.055 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:48.052+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:48.379 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:48.375+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:48.585 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:48.580+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:48.617 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:48.608+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:48.638 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:48.635+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:48.755 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:48.751+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:49.012 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:49.008+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:49.048 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:49.044+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:19:38.618672+0000 (oldest deadline 2019-11-29T03:20:18.618672+0000) 2019-11-29T03:20:49.048 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:49.045+0000 1694c700 -1 osd.3 236 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:106605 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e234) 2019-11-29T03:20:49.357 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:49.353+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:49.555 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:49.550+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:49.609 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:49.604+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:49.649 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:49.645+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:49.760 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:49.756+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:50.011 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:50.007+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:20:50.034 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:50.031+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:19:38.618672+0000 (oldest deadline 2019-11-29T03:20:18.618672+0000) 2019-11-29T03:20:50.037 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:20:50.034+0000 1694c700 -1 osd.3 236 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:106605 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e234) 2019-11-29T03:20:50.396 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:20:50.391+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:23.931800+0000 front 2019-11-29T03:19:24.042290+0000 (oldest deadline 2019-11-29T03:20:08.624884+0000) 2019-11-29T03:20:50.565 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:20:50.560+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.789065+0000 front 2019-11-29T03:19:24.966750+0000 (oldest deadline 2019-11-29T03:20:09.487275+0000) 2019-11-29T03:20:50.662 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:20:50.656+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:28.048378+0000 front 2019-11-29T03:19:24.968587+0000 (oldest deadline 2019-11-29T03:20:07.293568+0000) 2019-11-29T03:20:50.672 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:20:50.668+0000 1694c700 -1 osd.0 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:24.953456+0000 front 2019-11-29T03:19:24.892871+0000 (oldest deadline 2019-11-29T03:20:09.887480+0000) 2019-11-29T03:20:50.744 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:20:50.736+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 45sec e236 v236) 2019-11-29T03:20:50.802 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:20:50.798+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:27.101389+0000 front 2019-11-29T03:19:25.864875+0000 (oldest deadline 2019-11-29T03:20:09.675241+0000) 2019-11-29T03:20:50.996 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:20:50.992+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:19:25.916711+0000 front 2019-11-29T03:19:25.914726+0000 (oldest deadline 2019-11-29T03:20:08.679913+0000) 2019-11-29T03:22:27.781 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:22:27.778+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.310038+0000 front 2019-11-29T03:21:46.476779+0000 (oldest deadline 2019-11-29T03:22:27.378834+0000) 2019-11-29T03:22:27.982 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:22:27.978+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.151237+0000 front 2019-11-29T03:21:45.956398+0000 (oldest deadline 2019-11-29T03:22:27.647362+0000) 2019-11-29T03:22:28.507 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:22:28.501+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.975870+0000 front 2019-11-29T03:21:46.966449+0000 (oldest deadline 2019-11-29T03:22:28.034777+0000) 2019-11-29T03:22:28.768 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:22:28.765+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.310038+0000 front 2019-11-29T03:21:46.476779+0000 (oldest deadline 2019-11-29T03:22:27.378834+0000) 2019-11-29T03:22:28.897 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:22:28.894+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.449099+0000 front 2019-11-29T03:21:46.481383+0000 (oldest deadline 2019-11-29T03:22:28.736458+0000) 2019-11-29T03:22:29.005 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:22:29.002+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.151237+0000 front 2019-11-29T03:21:45.956398+0000 (oldest deadline 2019-11-29T03:22:27.647362+0000) 2019-11-29T03:22:29.422 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:22:29.417+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:45.750586+0000 front 2019-11-29T03:21:45.739277+0000 (oldest deadline 2019-11-29T03:22:29.210598+0000) 2019-11-29T03:22:29.512 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:22:29.507+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.975870+0000 front 2019-11-29T03:21:46.966449+0000 (oldest deadline 2019-11-29T03:22:28.034777+0000) 2019-11-29T03:22:29.791 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:22:29.786+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.310038+0000 front 2019-11-29T03:21:46.476779+0000 (oldest deadline 2019-11-29T03:22:27.378834+0000) 2019-11-29T03:22:29.939 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:22:29.935+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.449099+0000 front 2019-11-29T03:21:46.481383+0000 (oldest deadline 2019-11-29T03:22:28.736458+0000) 2019-11-29T03:22:30.032 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:22:30.028+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.151237+0000 front 2019-11-29T03:21:45.956398+0000 (oldest deadline 2019-11-29T03:22:27.647362+0000) 2019-11-29T03:22:30.389 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:22:30.382+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:45.750586+0000 front 2019-11-29T03:21:45.739277+0000 (oldest deadline 2019-11-29T03:22:29.210598+0000) 2019-11-29T03:22:30.540 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:22:30.535+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.975870+0000 front 2019-11-29T03:21:46.966449+0000 (oldest deadline 2019-11-29T03:22:28.034777+0000) 2019-11-29T03:22:30.560 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:22:30.555+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.880838+0000 front 2019-11-29T03:21:46.914084+0000 (oldest deadline 2019-11-29T03:22:30.316167+0000) 2019-11-29T03:22:30.761 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:22:30.758+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.310038+0000 front 2019-11-29T03:21:46.476779+0000 (oldest deadline 2019-11-29T03:22:27.378834+0000) 2019-11-29T03:22:30.952 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:22:30.947+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.449099+0000 front 2019-11-29T03:21:46.481383+0000 (oldest deadline 2019-11-29T03:22:28.736458+0000) 2019-11-29T03:22:31.069 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:22:31.064+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.151237+0000 front 2019-11-29T03:21:45.956398+0000 (oldest deadline 2019-11-29T03:22:27.647362+0000) 2019-11-29T03:22:31.440 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:22:31.435+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:45.750586+0000 front 2019-11-29T03:21:45.739277+0000 (oldest deadline 2019-11-29T03:22:29.210598+0000) 2019-11-29T03:22:31.587 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:22:31.581+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.975870+0000 front 2019-11-29T03:21:46.966449+0000 (oldest deadline 2019-11-29T03:22:28.034777+0000) 2019-11-29T03:22:31.613 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:22:31.608+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.880838+0000 front 2019-11-29T03:21:46.914084+0000 (oldest deadline 2019-11-29T03:22:30.316167+0000) 2019-11-29T03:22:31.755 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:22:31.753+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.310038+0000 front 2019-11-29T03:21:46.476779+0000 (oldest deadline 2019-11-29T03:22:27.378834+0000) 2019-11-29T03:22:31.915 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:22:31.912+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.449099+0000 front 2019-11-29T03:21:46.481383+0000 (oldest deadline 2019-11-29T03:22:28.736458+0000) 2019-11-29T03:22:32.066 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:22:32.062+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.151237+0000 front 2019-11-29T03:21:45.956398+0000 (oldest deadline 2019-11-29T03:22:27.647362+0000) 2019-11-29T03:22:32.406 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:22:32.399+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:45.750586+0000 front 2019-11-29T03:21:45.739277+0000 (oldest deadline 2019-11-29T03:22:29.210598+0000) 2019-11-29T03:22:32.577 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:22:32.571+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.880838+0000 front 2019-11-29T03:21:46.914084+0000 (oldest deadline 2019-11-29T03:22:30.316167+0000) 2019-11-29T03:22:32.588 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:22:32.582+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.975870+0000 front 2019-11-29T03:21:46.966449+0000 (oldest deadline 2019-11-29T03:22:28.034777+0000) 2019-11-29T03:22:32.757 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:22:32.754+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.310038+0000 front 2019-11-29T03:21:46.476779+0000 (oldest deadline 2019-11-29T03:22:27.378834+0000) 2019-11-29T03:22:32.889 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:22:32.886+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.449099+0000 front 2019-11-29T03:21:46.481383+0000 (oldest deadline 2019-11-29T03:22:28.736458+0000) 2019-11-29T03:22:33.067 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:22:33.065+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.151237+0000 front 2019-11-29T03:21:45.956398+0000 (oldest deadline 2019-11-29T03:22:27.647362+0000) 2019-11-29T03:22:33.423 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:22:33.409+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:45.750586+0000 front 2019-11-29T03:21:45.739277+0000 (oldest deadline 2019-11-29T03:22:29.210598+0000) 2019-11-29T03:22:33.625 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:22:33.611+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.880838+0000 front 2019-11-29T03:21:46.914084+0000 (oldest deadline 2019-11-29T03:22:30.316167+0000) 2019-11-29T03:22:33.651 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:22:33.636+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.975870+0000 front 2019-11-29T03:21:46.966449+0000 (oldest deadline 2019-11-29T03:22:28.034777+0000) 2019-11-29T03:22:33.737 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:22:33.730+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.310038+0000 front 2019-11-29T03:21:46.476779+0000 (oldest deadline 2019-11-29T03:22:27.378834+0000) 2019-11-29T03:22:33.853 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:22:33.844+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.449099+0000 front 2019-11-29T03:21:46.481383+0000 (oldest deadline 2019-11-29T03:22:28.736458+0000) 2019-11-29T03:22:34.026 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:22:34.023+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.151237+0000 front 2019-11-29T03:21:45.956398+0000 (oldest deadline 2019-11-29T03:22:27.647362+0000) 2019-11-29T03:22:34.437 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:22:34.431+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:45.750586+0000 front 2019-11-29T03:21:45.739277+0000 (oldest deadline 2019-11-29T03:22:29.210598+0000) 2019-11-29T03:22:34.582 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:22:34.577+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.880838+0000 front 2019-11-29T03:21:46.914084+0000 (oldest deadline 2019-11-29T03:22:30.316167+0000) 2019-11-29T03:22:34.652 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:22:34.646+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.975870+0000 front 2019-11-29T03:21:46.966449+0000 (oldest deadline 2019-11-29T03:22:28.034777+0000) 2019-11-29T03:22:34.779 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:22:34.775+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.310038+0000 front 2019-11-29T03:21:46.476779+0000 (oldest deadline 2019-11-29T03:22:27.378834+0000) 2019-11-29T03:22:34.860 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:22:34.857+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.449099+0000 front 2019-11-29T03:21:46.481383+0000 (oldest deadline 2019-11-29T03:22:28.736458+0000) 2019-11-29T03:22:35.072 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:22:35.069+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.151237+0000 front 2019-11-29T03:21:45.956398+0000 (oldest deadline 2019-11-29T03:22:27.647362+0000) 2019-11-29T03:22:35.485 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:22:35.479+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:45.750586+0000 front 2019-11-29T03:21:45.739277+0000 (oldest deadline 2019-11-29T03:22:29.210598+0000) 2019-11-29T03:22:35.612 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:22:35.604+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.880838+0000 front 2019-11-29T03:21:46.914084+0000 (oldest deadline 2019-11-29T03:22:30.316167+0000) 2019-11-29T03:22:35.623 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:22:35.616+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.975870+0000 front 2019-11-29T03:21:46.966449+0000 (oldest deadline 2019-11-29T03:22:28.034777+0000) 2019-11-29T03:22:35.781 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:22:35.777+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.310038+0000 front 2019-11-29T03:21:46.476779+0000 (oldest deadline 2019-11-29T03:22:27.378834+0000) 2019-11-29T03:22:35.910 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:22:35.905+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.449099+0000 front 2019-11-29T03:21:46.481383+0000 (oldest deadline 2019-11-29T03:22:28.736458+0000) 2019-11-29T03:22:36.107 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:22:36.105+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.151237+0000 front 2019-11-29T03:21:45.956398+0000 (oldest deadline 2019-11-29T03:22:27.647362+0000) 2019-11-29T03:22:36.448 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:22:36.442+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:45.750586+0000 front 2019-11-29T03:21:45.739277+0000 (oldest deadline 2019-11-29T03:22:29.210598+0000) 2019-11-29T03:22:36.568 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:22:36.562+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.880838+0000 front 2019-11-29T03:21:46.914084+0000 (oldest deadline 2019-11-29T03:22:30.316167+0000) 2019-11-29T03:22:36.587 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:22:36.581+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.975870+0000 front 2019-11-29T03:21:46.966449+0000 (oldest deadline 2019-11-29T03:22:28.034777+0000) 2019-11-29T03:22:36.808 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:22:36.806+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.310038+0000 front 2019-11-29T03:21:46.476779+0000 (oldest deadline 2019-11-29T03:22:27.378834+0000) 2019-11-29T03:22:37.088 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:22:37.085+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.151237+0000 front 2019-11-29T03:21:45.956398+0000 (oldest deadline 2019-11-29T03:22:27.647362+0000) 2019-11-29T03:22:37.497 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:22:37.491+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:45.750586+0000 front 2019-11-29T03:21:45.739277+0000 (oldest deadline 2019-11-29T03:22:29.210598+0000) 2019-11-29T03:22:37.528 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:22:37.522+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.880838+0000 front 2019-11-29T03:21:46.914084+0000 (oldest deadline 2019-11-29T03:22:30.316167+0000) 2019-11-29T03:22:37.617 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:22:37.611+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.975870+0000 front 2019-11-29T03:21:46.966449+0000 (oldest deadline 2019-11-29T03:22:28.034777+0000) 2019-11-29T03:22:37.806 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:22:37.803+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.310038+0000 front 2019-11-29T03:21:46.476779+0000 (oldest deadline 2019-11-29T03:22:27.378834+0000) 2019-11-29T03:22:38.104 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:22:38.102+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.151237+0000 front 2019-11-29T03:21:45.956398+0000 (oldest deadline 2019-11-29T03:22:27.647362+0000) 2019-11-29T03:22:38.498 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:22:38.491+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.880838+0000 front 2019-11-29T03:21:46.914084+0000 (oldest deadline 2019-11-29T03:22:30.316167+0000) 2019-11-29T03:22:38.550 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:22:38.544+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:45.750586+0000 front 2019-11-29T03:21:45.739277+0000 (oldest deadline 2019-11-29T03:22:29.210598+0000) 2019-11-29T03:22:38.612 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:22:38.605+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.975870+0000 front 2019-11-29T03:21:46.966449+0000 (oldest deadline 2019-11-29T03:22:28.034777+0000) 2019-11-29T03:22:38.776 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:22:38.773+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.310038+0000 front 2019-11-29T03:21:46.476779+0000 (oldest deadline 2019-11-29T03:22:27.378834+0000) 2019-11-29T03:22:39.147 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:22:39.142+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.151237+0000 front 2019-11-29T03:21:45.956398+0000 (oldest deadline 2019-11-29T03:22:27.647362+0000) 2019-11-29T03:22:39.544 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:22:39.538+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.880838+0000 front 2019-11-29T03:21:46.914084+0000 (oldest deadline 2019-11-29T03:22:30.316167+0000) 2019-11-29T03:22:39.573 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:22:39.567+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:45.750586+0000 front 2019-11-29T03:21:45.739277+0000 (oldest deadline 2019-11-29T03:22:29.210598+0000) 2019-11-29T03:22:39.609 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:22:39.603+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.975870+0000 front 2019-11-29T03:21:46.966449+0000 (oldest deadline 2019-11-29T03:22:28.034777+0000) 2019-11-29T03:22:39.806 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:22:39.802+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.310038+0000 front 2019-11-29T03:21:46.476779+0000 (oldest deadline 2019-11-29T03:22:27.378834+0000) 2019-11-29T03:22:40.131 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:22:40.123+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.151237+0000 front 2019-11-29T03:21:45.956398+0000 (oldest deadline 2019-11-29T03:22:27.647362+0000) 2019-11-29T03:22:40.570 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:22:40.560+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.880838+0000 front 2019-11-29T03:21:46.914084+0000 (oldest deadline 2019-11-29T03:22:30.316167+0000) 2019-11-29T03:22:40.573 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:22:40.568+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:45.750586+0000 front 2019-11-29T03:21:45.739277+0000 (oldest deadline 2019-11-29T03:22:29.210598+0000) 2019-11-29T03:22:40.591 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:22:40.586+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.975870+0000 front 2019-11-29T03:21:46.966449+0000 (oldest deadline 2019-11-29T03:22:28.034777+0000) 2019-11-29T03:22:40.770 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:22:40.766+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.310038+0000 front 2019-11-29T03:21:46.476779+0000 (oldest deadline 2019-11-29T03:22:27.378834+0000) 2019-11-29T03:22:41.149 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:22:41.145+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.151237+0000 front 2019-11-29T03:21:45.956398+0000 (oldest deadline 2019-11-29T03:22:27.647362+0000) 2019-11-29T03:22:41.548 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:22:41.542+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:45.750586+0000 front 2019-11-29T03:21:45.739277+0000 (oldest deadline 2019-11-29T03:22:29.210598+0000) 2019-11-29T03:22:41.556 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:22:41.551+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.880838+0000 front 2019-11-29T03:21:46.914084+0000 (oldest deadline 2019-11-29T03:22:30.316167+0000) 2019-11-29T03:22:41.640 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:22:41.634+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.975870+0000 front 2019-11-29T03:21:46.966449+0000 (oldest deadline 2019-11-29T03:22:28.034777+0000) 2019-11-29T03:22:41.790 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:22:41.787+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.310038+0000 front 2019-11-29T03:21:46.476779+0000 (oldest deadline 2019-11-29T03:22:27.378834+0000) 2019-11-29T03:22:42.113 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:22:42.109+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.151237+0000 front 2019-11-29T03:21:45.956398+0000 (oldest deadline 2019-11-29T03:22:27.647362+0000) 2019-11-29T03:22:42.514 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:22:42.508+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.880838+0000 front 2019-11-29T03:21:46.914084+0000 (oldest deadline 2019-11-29T03:22:30.316167+0000) 2019-11-29T03:22:42.586 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:22:42.580+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:45.750586+0000 front 2019-11-29T03:21:45.739277+0000 (oldest deadline 2019-11-29T03:22:29.210598+0000) 2019-11-29T03:22:42.694 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:22:42.687+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.975870+0000 front 2019-11-29T03:21:46.966449+0000 (oldest deadline 2019-11-29T03:22:28.034777+0000) 2019-11-29T03:22:42.759 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:22:42.756+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.310038+0000 front 2019-11-29T03:21:46.476779+0000 (oldest deadline 2019-11-29T03:22:27.378834+0000) 2019-11-29T03:22:43.109 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:22:43.105+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.151237+0000 front 2019-11-29T03:21:45.956398+0000 (oldest deadline 2019-11-29T03:22:27.647362+0000) 2019-11-29T03:22:43.505 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:22:43.500+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.880838+0000 front 2019-11-29T03:21:46.914084+0000 (oldest deadline 2019-11-29T03:22:30.316167+0000) 2019-11-29T03:22:43.640 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:22:43.634+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:45.750586+0000 front 2019-11-29T03:21:45.739277+0000 (oldest deadline 2019-11-29T03:22:29.210598+0000) 2019-11-29T03:22:43.744 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:22:43.738+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.975870+0000 front 2019-11-29T03:21:46.966449+0000 (oldest deadline 2019-11-29T03:22:28.034777+0000) 2019-11-29T03:22:43.757 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:22:43.754+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.310038+0000 front 2019-11-29T03:21:46.476779+0000 (oldest deadline 2019-11-29T03:22:27.378834+0000) 2019-11-29T03:22:44.162 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:22:44.158+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.151237+0000 front 2019-11-29T03:21:45.956398+0000 (oldest deadline 2019-11-29T03:22:27.647362+0000) 2019-11-29T03:22:44.466 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:22:44.460+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.880838+0000 front 2019-11-29T03:21:46.914084+0000 (oldest deadline 2019-11-29T03:22:30.316167+0000) 2019-11-29T03:22:44.677 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:22:44.671+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:45.750586+0000 front 2019-11-29T03:21:45.739277+0000 (oldest deadline 2019-11-29T03:22:29.210598+0000) 2019-11-29T03:22:44.723 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:22:44.717+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.975870+0000 front 2019-11-29T03:21:46.966449+0000 (oldest deadline 2019-11-29T03:22:28.034777+0000) 2019-11-29T03:22:44.796 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:22:44.791+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.310038+0000 front 2019-11-29T03:21:46.476779+0000 (oldest deadline 2019-11-29T03:22:27.378834+0000) 2019-11-29T03:22:45.172 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:22:45.165+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.151237+0000 front 2019-11-29T03:21:45.956398+0000 (oldest deadline 2019-11-29T03:22:27.647362+0000) 2019-11-29T03:22:45.497 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:22:45.491+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.880838+0000 front 2019-11-29T03:21:46.914084+0000 (oldest deadline 2019-11-29T03:22:30.316167+0000) 2019-11-29T03:22:45.661 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:22:45.655+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:45.750586+0000 front 2019-11-29T03:21:45.739277+0000 (oldest deadline 2019-11-29T03:22:29.210598+0000) 2019-11-29T03:22:45.688 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:22:45.682+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.975870+0000 front 2019-11-29T03:21:46.966449+0000 (oldest deadline 2019-11-29T03:22:28.034777+0000) 2019-11-29T03:22:45.822 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:22:45.819+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.310038+0000 front 2019-11-29T03:21:46.476779+0000 (oldest deadline 2019-11-29T03:22:27.378834+0000) 2019-11-29T03:22:46.216 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:22:46.211+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.151237+0000 front 2019-11-29T03:21:45.956398+0000 (oldest deadline 2019-11-29T03:22:27.647362+0000) 2019-11-29T03:22:46.502 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:22:46.497+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.880838+0000 front 2019-11-29T03:21:46.914084+0000 (oldest deadline 2019-11-29T03:22:30.316167+0000) 2019-11-29T03:22:46.680 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:22:46.674+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:45.750586+0000 front 2019-11-29T03:21:45.739277+0000 (oldest deadline 2019-11-29T03:22:29.210598+0000) 2019-11-29T03:22:46.713 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:22:46.707+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.975870+0000 front 2019-11-29T03:21:46.966449+0000 (oldest deadline 2019-11-29T03:22:28.034777+0000) 2019-11-29T03:22:46.858 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:22:46.854+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.310038+0000 front 2019-11-29T03:21:46.476779+0000 (oldest deadline 2019-11-29T03:22:27.378834+0000) 2019-11-29T03:22:47.252 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:22:47.248+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.151237+0000 front 2019-11-29T03:21:45.956398+0000 (oldest deadline 2019-11-29T03:22:27.647362+0000) 2019-11-29T03:22:47.500 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:22:47.493+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.880838+0000 front 2019-11-29T03:21:46.914084+0000 (oldest deadline 2019-11-29T03:22:30.316167+0000) 2019-11-29T03:22:47.674 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:22:47.669+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:45.750586+0000 front 2019-11-29T03:21:45.739277+0000 (oldest deadline 2019-11-29T03:22:29.210598+0000) 2019-11-29T03:22:47.754 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:22:47.749+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.975870+0000 front 2019-11-29T03:21:46.966449+0000 (oldest deadline 2019-11-29T03:22:28.034777+0000) 2019-11-29T03:22:47.879 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:22:47.874+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.310038+0000 front 2019-11-29T03:21:46.476779+0000 (oldest deadline 2019-11-29T03:22:27.378834+0000) 2019-11-29T03:22:48.268 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:22:48.264+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.151237+0000 front 2019-11-29T03:21:45.956398+0000 (oldest deadline 2019-11-29T03:22:27.647362+0000) 2019-11-29T03:22:48.531 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:22:48.525+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.880838+0000 front 2019-11-29T03:21:46.914084+0000 (oldest deadline 2019-11-29T03:22:30.316167+0000) 2019-11-29T03:22:48.653 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:22:48.647+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:45.750586+0000 front 2019-11-29T03:21:45.739277+0000 (oldest deadline 2019-11-29T03:22:29.210598+0000) 2019-11-29T03:22:48.789 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:22:48.783+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.975870+0000 front 2019-11-29T03:21:46.966449+0000 (oldest deadline 2019-11-29T03:22:28.034777+0000) 2019-11-29T03:22:48.895 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:22:48.892+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.310038+0000 front 2019-11-29T03:21:46.476779+0000 (oldest deadline 2019-11-29T03:22:27.378834+0000) 2019-11-29T03:22:49.234 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:22:49.230+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.151237+0000 front 2019-11-29T03:21:45.956398+0000 (oldest deadline 2019-11-29T03:22:27.647362+0000) 2019-11-29T03:22:49.506 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:22:49.501+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.880838+0000 front 2019-11-29T03:21:46.914084+0000 (oldest deadline 2019-11-29T03:22:30.316167+0000) 2019-11-29T03:22:49.659 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:22:49.653+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:45.750586+0000 front 2019-11-29T03:21:45.739277+0000 (oldest deadline 2019-11-29T03:22:29.210598+0000) 2019-11-29T03:22:49.787 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:22:49.777+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.975870+0000 front 2019-11-29T03:21:46.966449+0000 (oldest deadline 2019-11-29T03:22:28.034777+0000) 2019-11-29T03:22:49.939 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:22:49.935+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.310038+0000 front 2019-11-29T03:21:46.476779+0000 (oldest deadline 2019-11-29T03:22:27.378834+0000) 2019-11-29T03:22:50.255 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:22:50.251+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.151237+0000 front 2019-11-29T03:21:45.956398+0000 (oldest deadline 2019-11-29T03:22:27.647362+0000) 2019-11-29T03:22:50.498 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:22:50.492+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.880838+0000 front 2019-11-29T03:21:46.914084+0000 (oldest deadline 2019-11-29T03:22:30.316167+0000) 2019-11-29T03:22:50.627 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:22:50.621+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:45.750586+0000 front 2019-11-29T03:21:45.739277+0000 (oldest deadline 2019-11-29T03:22:29.210598+0000) 2019-11-29T03:22:50.813 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:22:50.807+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.975870+0000 front 2019-11-29T03:21:46.966449+0000 (oldest deadline 2019-11-29T03:22:28.034777+0000) 2019-11-29T03:22:50.989 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:22:50.986+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.310038+0000 front 2019-11-29T03:21:46.476779+0000 (oldest deadline 2019-11-29T03:22:27.378834+0000) 2019-11-29T03:22:51.308 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:22:51.305+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.151237+0000 front 2019-11-29T03:21:45.956398+0000 (oldest deadline 2019-11-29T03:22:27.647362+0000) 2019-11-29T03:22:51.542 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:22:51.536+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.880838+0000 front 2019-11-29T03:21:46.914084+0000 (oldest deadline 2019-11-29T03:22:30.316167+0000) 2019-11-29T03:22:51.633 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:22:51.627+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:45.750586+0000 front 2019-11-29T03:21:45.739277+0000 (oldest deadline 2019-11-29T03:22:29.210598+0000) 2019-11-29T03:22:51.857 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:22:51.850+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.975870+0000 front 2019-11-29T03:21:46.966449+0000 (oldest deadline 2019-11-29T03:22:28.034777+0000) 2019-11-29T03:22:52.027 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:22:52.023+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.310038+0000 front 2019-11-29T03:21:46.476779+0000 (oldest deadline 2019-11-29T03:22:27.378834+0000) 2019-11-29T03:22:52.338 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:22:52.334+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.151237+0000 front 2019-11-29T03:21:45.956398+0000 (oldest deadline 2019-11-29T03:22:27.647362+0000) 2019-11-29T03:22:52.561 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:22:52.556+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.880838+0000 front 2019-11-29T03:21:46.914084+0000 (oldest deadline 2019-11-29T03:22:30.316167+0000) 2019-11-29T03:22:52.644 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:22:52.639+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:45.750586+0000 front 2019-11-29T03:21:45.739277+0000 (oldest deadline 2019-11-29T03:22:29.210598+0000) 2019-11-29T03:22:52.899 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:22:52.892+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.975870+0000 front 2019-11-29T03:21:46.966449+0000 (oldest deadline 2019-11-29T03:22:28.034777+0000) 2019-11-29T03:22:53.004 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:22:53.001+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.310038+0000 front 2019-11-29T03:21:46.476779+0000 (oldest deadline 2019-11-29T03:22:27.378834+0000) 2019-11-29T03:22:53.270 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:22:53.265+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.702148+0000 front 2019-11-29T03:21:46.709568+0000 (oldest deadline 2019-11-29T03:22:52.377702+0000) 2019-11-29T03:22:53.379 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:22:53.376+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.151237+0000 front 2019-11-29T03:21:45.956398+0000 (oldest deadline 2019-11-29T03:22:27.647362+0000) 2019-11-29T03:22:53.569 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:22:53.563+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.880838+0000 front 2019-11-29T03:21:46.914084+0000 (oldest deadline 2019-11-29T03:22:30.316167+0000) 2019-11-29T03:22:53.653 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:22:53.647+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:45.750586+0000 front 2019-11-29T03:21:45.739277+0000 (oldest deadline 2019-11-29T03:22:29.210598+0000) 2019-11-29T03:22:53.954 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:22:53.947+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.975870+0000 front 2019-11-29T03:21:46.966449+0000 (oldest deadline 2019-11-29T03:22:28.034777+0000) 2019-11-29T03:22:53.989 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:22:53.985+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.310038+0000 front 2019-11-29T03:21:46.476779+0000 (oldest deadline 2019-11-29T03:22:27.378834+0000) 2019-11-29T03:22:54.236 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:22:54.230+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.702148+0000 front 2019-11-29T03:21:46.709568+0000 (oldest deadline 2019-11-29T03:22:52.377702+0000) 2019-11-29T03:22:54.359 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:22:54.356+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.151237+0000 front 2019-11-29T03:21:45.956398+0000 (oldest deadline 2019-11-29T03:22:27.647362+0000) 2019-11-29T03:22:54.546 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:22:54.541+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.880838+0000 front 2019-11-29T03:21:46.914084+0000 (oldest deadline 2019-11-29T03:22:30.316167+0000) 2019-11-29T03:22:54.687 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:22:54.682+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:45.750586+0000 front 2019-11-29T03:21:45.739277+0000 (oldest deadline 2019-11-29T03:22:29.210598+0000) 2019-11-29T03:22:54.948 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:22:54.943+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.310038+0000 front 2019-11-29T03:21:46.476779+0000 (oldest deadline 2019-11-29T03:22:27.378834+0000) 2019-11-29T03:22:54.980 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:22:54.974+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.975870+0000 front 2019-11-29T03:21:46.966449+0000 (oldest deadline 2019-11-29T03:22:28.034777+0000) 2019-11-29T03:22:55.286 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:22:55.280+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.702148+0000 front 2019-11-29T03:21:46.709568+0000 (oldest deadline 2019-11-29T03:22:52.377702+0000) 2019-11-29T03:22:55.313 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:22:55.309+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.151237+0000 front 2019-11-29T03:21:45.956398+0000 (oldest deadline 2019-11-29T03:22:27.647362+0000) 2019-11-29T03:22:55.504 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:22:55.498+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.880838+0000 front 2019-11-29T03:21:46.914084+0000 (oldest deadline 2019-11-29T03:22:30.316167+0000) 2019-11-29T03:22:55.667 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:22:55.661+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:45.750586+0000 front 2019-11-29T03:21:45.739277+0000 (oldest deadline 2019-11-29T03:22:29.210598+0000) 2019-11-29T03:22:55.908 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:22:55.902+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.310038+0000 front 2019-11-29T03:21:46.476779+0000 (oldest deadline 2019-11-29T03:22:27.378834+0000) 2019-11-29T03:22:56.023 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:22:56.018+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.975870+0000 front 2019-11-29T03:21:46.966449+0000 (oldest deadline 2019-11-29T03:22:28.034777+0000) 2019-11-29T03:22:56.279 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:22:56.275+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.151237+0000 front 2019-11-29T03:21:45.956398+0000 (oldest deadline 2019-11-29T03:22:27.647362+0000) 2019-11-29T03:22:56.298 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:22:56.292+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.702148+0000 front 2019-11-29T03:21:46.709568+0000 (oldest deadline 2019-11-29T03:22:52.377702+0000) 2019-11-29T03:22:56.467 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:22:56.462+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.880838+0000 front 2019-11-29T03:21:46.914084+0000 (oldest deadline 2019-11-29T03:22:30.316167+0000) 2019-11-29T03:22:56.669 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:22:56.664+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:45.750586+0000 front 2019-11-29T03:21:45.739277+0000 (oldest deadline 2019-11-29T03:22:29.210598+0000) 2019-11-29T03:22:56.862 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:22:56.857+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.310038+0000 front 2019-11-29T03:21:46.476779+0000 (oldest deadline 2019-11-29T03:22:27.378834+0000) 2019-11-29T03:22:57.030 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:22:57.024+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.975870+0000 front 2019-11-29T03:21:46.966449+0000 (oldest deadline 2019-11-29T03:22:28.034777+0000) 2019-11-29T03:22:57.270 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:22:57.267+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.151237+0000 front 2019-11-29T03:21:45.956398+0000 (oldest deadline 2019-11-29T03:22:27.647362+0000) 2019-11-29T03:22:57.297 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:22:57.290+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.702148+0000 front 2019-11-29T03:21:46.709568+0000 (oldest deadline 2019-11-29T03:22:52.377702+0000) 2019-11-29T03:22:57.430 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:22:57.425+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.880838+0000 front 2019-11-29T03:21:46.914084+0000 (oldest deadline 2019-11-29T03:22:30.316167+0000) 2019-11-29T03:22:57.704 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:22:57.699+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:45.750586+0000 front 2019-11-29T03:21:45.739277+0000 (oldest deadline 2019-11-29T03:22:29.210598+0000) 2019-11-29T03:22:57.863 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:22:57.858+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.310038+0000 front 2019-11-29T03:21:46.476779+0000 (oldest deadline 2019-11-29T03:22:27.378834+0000) 2019-11-29T03:22:58.010 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:22:58.004+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.975870+0000 front 2019-11-29T03:21:46.966449+0000 (oldest deadline 2019-11-29T03:22:28.034777+0000) 2019-11-29T03:22:58.285 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:22:58.282+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.151237+0000 front 2019-11-29T03:21:45.956398+0000 (oldest deadline 2019-11-29T03:22:27.647362+0000) 2019-11-29T03:22:58.348 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:22:58.342+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.702148+0000 front 2019-11-29T03:21:46.709568+0000 (oldest deadline 2019-11-29T03:22:52.377702+0000) 2019-11-29T03:22:58.480 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:22:58.474+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.880838+0000 front 2019-11-29T03:21:46.914084+0000 (oldest deadline 2019-11-29T03:22:30.316167+0000) 2019-11-29T03:22:58.685 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:22:58.680+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:45.750586+0000 front 2019-11-29T03:21:45.739277+0000 (oldest deadline 2019-11-29T03:22:29.210598+0000) 2019-11-29T03:22:58.880 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:22:58.877+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.310038+0000 front 2019-11-29T03:21:46.476779+0000 (oldest deadline 2019-11-29T03:22:27.378834+0000) 2019-11-29T03:22:59.005 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:22:59.000+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.975870+0000 front 2019-11-29T03:21:46.966449+0000 (oldest deadline 2019-11-29T03:22:28.034777+0000) 2019-11-29T03:22:59.262 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:22:59.259+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.151237+0000 front 2019-11-29T03:21:45.956398+0000 (oldest deadline 2019-11-29T03:22:27.647362+0000) 2019-11-29T03:22:59.416 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:22:59.410+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.702148+0000 front 2019-11-29T03:21:46.709568+0000 (oldest deadline 2019-11-29T03:22:52.377702+0000) 2019-11-29T03:22:59.465 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:22:59.459+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.880838+0000 front 2019-11-29T03:21:46.914084+0000 (oldest deadline 2019-11-29T03:22:30.316167+0000) 2019-11-29T03:22:59.690 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:22:59.685+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:45.750586+0000 front 2019-11-29T03:21:45.739277+0000 (oldest deadline 2019-11-29T03:22:29.210598+0000) 2019-11-29T03:22:59.892 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:22:59.887+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.310038+0000 front 2019-11-29T03:21:46.476779+0000 (oldest deadline 2019-11-29T03:22:27.378834+0000) 2019-11-29T03:23:00.026 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:23:00.021+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.975870+0000 front 2019-11-29T03:21:46.966449+0000 (oldest deadline 2019-11-29T03:22:28.034777+0000) 2019-11-29T03:23:00.305 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:23:00.302+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.151237+0000 front 2019-11-29T03:21:45.956398+0000 (oldest deadline 2019-11-29T03:22:27.647362+0000) 2019-11-29T03:23:00.397 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:23:00.392+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.702148+0000 front 2019-11-29T03:21:46.709568+0000 (oldest deadline 2019-11-29T03:22:52.377702+0000) 2019-11-29T03:23:00.475 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:23:00.470+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.880838+0000 front 2019-11-29T03:21:46.914084+0000 (oldest deadline 2019-11-29T03:22:30.316167+0000) 2019-11-29T03:23:00.718 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:23:00.713+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:45.750586+0000 front 2019-11-29T03:21:45.739277+0000 (oldest deadline 2019-11-29T03:22:29.210598+0000) 2019-11-29T03:23:00.883 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:23:00.880+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.310038+0000 front 2019-11-29T03:21:46.476779+0000 (oldest deadline 2019-11-29T03:22:27.378834+0000) 2019-11-29T03:23:01.062 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:23:01.057+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.975870+0000 front 2019-11-29T03:21:46.966449+0000 (oldest deadline 2019-11-29T03:22:28.034777+0000) 2019-11-29T03:23:01.303 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:23:01.298+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.74:6802/10096,v1:172.21.15.74:6803/10096] for 42sec e242 v242) 2019-11-29T03:23:01.319 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:23:01.316+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.151237+0000 front 2019-11-29T03:21:45.956398+0000 (oldest deadline 2019-11-29T03:22:27.647362+0000) 2019-11-29T03:23:01.393 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:23:01.370+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:21:46.702148+0000 front 2019-11-29T03:21:46.709568+0000 (oldest deadline 2019-11-29T03:22:52.377702+0000) 2019-11-29T03:23:35.158 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:23:35.112+0000 37f90700 -1 osd.6 246 build_incremental_map_msg missing incremental map 246 2019-11-29T03:23:35.234 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:23:35.227+0000 11cac700 -1 osd.6 246 build_incremental_map_msg missing incremental map 246 2019-11-29T03:23:35.397 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:23:35.278+0000 35f8c700 -1 osd.6 246 build_incremental_map_msg missing incremental map 246 2019-11-29T03:23:35.413 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:23:35.296+0000 32785700 -1 osd.6 246 build_incremental_map_msg missing incremental map 246 2019-11-29T03:23:35.415 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:23:35.305+0000 35f8c700 -1 osd.6 246 build_incremental_map_msg missing incremental map 246 2019-11-29T03:23:35.767 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:23:35.761+0000 3678d700 -1 osd.6 246 build_incremental_map_msg missing incremental map 246 2019-11-29T03:23:37.662 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:37:19.880 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:23:37.667 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:37:19.885 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:23:37.675 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:37:19.904 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:23:37.678 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:37:19.907 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:23:37.686 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:37:19.905 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:23:37.690 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:37:19.910 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:23:37.918 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:37:20.147 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:23:37.978 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:37:20.197 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:23:37.978 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:37:20.197 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:23:59.844 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:23:59.841+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.987099+0000 front 2019-11-29T03:23:20.480044+0000 (oldest deadline 2019-11-29T03:23:58.942693+0000) 2019-11-29T03:23:59.885 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:23:59.880+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.718717+0000 front 2019-11-29T03:23:20.483604+0000 (oldest deadline 2019-11-29T03:23:59.799644+0000) 2019-11-29T03:24:00.356 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:24:00.352+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.322522+0000 front 2019-11-29T03:23:18.299971+0000 (oldest deadline 2019-11-29T03:23:59.374349+0000) 2019-11-29T03:24:00.799 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:24:00.796+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.987099+0000 front 2019-11-29T03:23:20.480044+0000 (oldest deadline 2019-11-29T03:23:58.942693+0000) 2019-11-29T03:24:00.890 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:24:00.884+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.718717+0000 front 2019-11-29T03:23:20.483604+0000 (oldest deadline 2019-11-29T03:23:59.799644+0000) 2019-11-29T03:24:01.343 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:24:01.337+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.322522+0000 front 2019-11-29T03:23:18.299971+0000 (oldest deadline 2019-11-29T03:23:59.374349+0000) 2019-11-29T03:24:01.653 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:24:01.650+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.484875+0000 front 2019-11-29T03:23:20.482762+0000 (oldest deadline 2019-11-29T03:24:01.431500+0000) 2019-11-29T03:24:01.759 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:24:01.757+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.987099+0000 front 2019-11-29T03:23:20.480044+0000 (oldest deadline 2019-11-29T03:23:58.942693+0000) 2019-11-29T03:24:01.894 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:24:01.888+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.718717+0000 front 2019-11-29T03:23:20.483604+0000 (oldest deadline 2019-11-29T03:23:59.799644+0000) 2019-11-29T03:24:02.350 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:24:02.344+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.322522+0000 front 2019-11-29T03:23:18.299971+0000 (oldest deadline 2019-11-29T03:23:59.374349+0000) 2019-11-29T03:24:02.616 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:24:02.612+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.484875+0000 front 2019-11-29T03:23:20.482762+0000 (oldest deadline 2019-11-29T03:24:01.431500+0000) 2019-11-29T03:24:02.793 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:24:02.790+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.987099+0000 front 2019-11-29T03:23:20.480044+0000 (oldest deadline 2019-11-29T03:23:58.942693+0000) 2019-11-29T03:24:02.906 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:24:02.899+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.718717+0000 front 2019-11-29T03:23:20.483604+0000 (oldest deadline 2019-11-29T03:23:59.799644+0000) 2019-11-29T03:24:03.311 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:24:03.305+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.322522+0000 front 2019-11-29T03:23:18.299971+0000 (oldest deadline 2019-11-29T03:23:59.374349+0000) 2019-11-29T03:24:03.667 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:24:03.664+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.484875+0000 front 2019-11-29T03:23:20.482762+0000 (oldest deadline 2019-11-29T03:24:01.431500+0000) 2019-11-29T03:24:03.758 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:24:03.756+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.987099+0000 front 2019-11-29T03:23:20.480044+0000 (oldest deadline 2019-11-29T03:23:58.942693+0000) 2019-11-29T03:24:03.897 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:24:03.893+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.718717+0000 front 2019-11-29T03:23:20.483604+0000 (oldest deadline 2019-11-29T03:23:59.799644+0000) 2019-11-29T03:24:04.302 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:24:04.297+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.322522+0000 front 2019-11-29T03:23:18.299971+0000 (oldest deadline 2019-11-29T03:23:59.374349+0000) 2019-11-29T03:24:04.492 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:24:04.489+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.481622+0000 front 2019-11-29T03:23:18.689374+0000 (oldest deadline 2019-11-29T03:24:03.846861+0000) 2019-11-29T03:24:04.626 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:24:04.622+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.484875+0000 front 2019-11-29T03:23:20.482762+0000 (oldest deadline 2019-11-29T03:24:01.431500+0000) 2019-11-29T03:24:04.737 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:24:04.732+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.987099+0000 front 2019-11-29T03:23:20.480044+0000 (oldest deadline 2019-11-29T03:23:58.942693+0000) 2019-11-29T03:24:04.864 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:24:04.860+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.718717+0000 front 2019-11-29T03:23:20.483604+0000 (oldest deadline 2019-11-29T03:23:59.799644+0000) 2019-11-29T03:24:04.989 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:24:04.984+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.122822+0000 front 2019-11-29T03:23:20.117598+0000 (oldest deadline 2019-11-29T03:24:04.183433+0000) 2019-11-29T03:24:05.267 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:24:05.262+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.322522+0000 front 2019-11-29T03:23:18.299971+0000 (oldest deadline 2019-11-29T03:23:59.374349+0000) 2019-11-29T03:24:05.483 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:24:05.479+0000 1694c700 -1 osd.0 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.481622+0000 front 2019-11-29T03:23:18.689374+0000 (oldest deadline 2019-11-29T03:24:03.846861+0000) 2019-11-29T03:24:05.585 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:24:05.583+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.484875+0000 front 2019-11-29T03:23:20.482762+0000 (oldest deadline 2019-11-29T03:24:01.431500+0000) 2019-11-29T03:24:05.747 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:24:05.744+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.987099+0000 front 2019-11-29T03:23:20.480044+0000 (oldest deadline 2019-11-29T03:23:58.942693+0000) 2019-11-29T03:24:05.868 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:24:05.863+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.718717+0000 front 2019-11-29T03:23:20.483604+0000 (oldest deadline 2019-11-29T03:23:59.799644+0000) 2019-11-29T03:24:05.946 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:24:05.940+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.122822+0000 front 2019-11-29T03:23:20.117598+0000 (oldest deadline 2019-11-29T03:24:04.183433+0000) 2019-11-29T03:24:06.283 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:24:06.278+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.322522+0000 front 2019-11-29T03:23:18.299971+0000 (oldest deadline 2019-11-29T03:23:59.374349+0000) 2019-11-29T03:24:06.556 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:24:06.553+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.484875+0000 front 2019-11-29T03:23:20.482762+0000 (oldest deadline 2019-11-29T03:24:01.431500+0000) 2019-11-29T03:24:06.727 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:24:06.723+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.987099+0000 front 2019-11-29T03:23:20.480044+0000 (oldest deadline 2019-11-29T03:23:58.942693+0000) 2019-11-29T03:24:06.913 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:24:06.908+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.718717+0000 front 2019-11-29T03:23:20.483604+0000 (oldest deadline 2019-11-29T03:23:59.799644+0000) 2019-11-29T03:24:06.916 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:24:06.911+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.122822+0000 front 2019-11-29T03:23:20.117598+0000 (oldest deadline 2019-11-29T03:24:04.183433+0000) 2019-11-29T03:24:07.243 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:24:07.238+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.322522+0000 front 2019-11-29T03:23:18.299971+0000 (oldest deadline 2019-11-29T03:23:59.374349+0000) 2019-11-29T03:24:07.559 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:24:07.557+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.484875+0000 front 2019-11-29T03:23:20.482762+0000 (oldest deadline 2019-11-29T03:24:01.431500+0000) 2019-11-29T03:24:07.717 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:24:07.715+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.987099+0000 front 2019-11-29T03:23:20.480044+0000 (oldest deadline 2019-11-29T03:23:58.942693+0000) 2019-11-29T03:24:07.880 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:24:07.871+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.718717+0000 front 2019-11-29T03:23:20.483604+0000 (oldest deadline 2019-11-29T03:23:59.799644+0000) 2019-11-29T03:24:07.947 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:24:07.942+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.122822+0000 front 2019-11-29T03:23:20.117598+0000 (oldest deadline 2019-11-29T03:24:04.183433+0000) 2019-11-29T03:24:08.253 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:24:08.247+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.322522+0000 front 2019-11-29T03:23:18.299971+0000 (oldest deadline 2019-11-29T03:23:59.374349+0000) 2019-11-29T03:24:08.542 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:24:08.540+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.484875+0000 front 2019-11-29T03:23:20.482762+0000 (oldest deadline 2019-11-29T03:24:01.431500+0000) 2019-11-29T03:24:08.724 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:24:08.721+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.987099+0000 front 2019-11-29T03:23:20.480044+0000 (oldest deadline 2019-11-29T03:23:58.942693+0000) 2019-11-29T03:24:08.837 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:24:08.832+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.718717+0000 front 2019-11-29T03:23:20.483604+0000 (oldest deadline 2019-11-29T03:23:59.799644+0000) 2019-11-29T03:24:08.969 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:24:08.963+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.122822+0000 front 2019-11-29T03:23:20.117598+0000 (oldest deadline 2019-11-29T03:24:04.183433+0000) 2019-11-29T03:24:09.226 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:24:09.221+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.322522+0000 front 2019-11-29T03:23:18.299971+0000 (oldest deadline 2019-11-29T03:23:59.374349+0000) 2019-11-29T03:24:09.541 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:24:09.538+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.484875+0000 front 2019-11-29T03:23:20.482762+0000 (oldest deadline 2019-11-29T03:24:01.431500+0000) 2019-11-29T03:24:09.736 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:24:09.732+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.987099+0000 front 2019-11-29T03:23:20.480044+0000 (oldest deadline 2019-11-29T03:23:58.942693+0000) 2019-11-29T03:24:09.827 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:24:09.822+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.718717+0000 front 2019-11-29T03:23:20.483604+0000 (oldest deadline 2019-11-29T03:23:59.799644+0000) 2019-11-29T03:24:10.025 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:24:10.019+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.122822+0000 front 2019-11-29T03:23:20.117598+0000 (oldest deadline 2019-11-29T03:24:04.183433+0000) 2019-11-29T03:24:10.246 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:24:10.242+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.322522+0000 front 2019-11-29T03:23:18.299971+0000 (oldest deadline 2019-11-29T03:23:59.374349+0000) 2019-11-29T03:24:10.509 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:24:10.505+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.484875+0000 front 2019-11-29T03:23:20.482762+0000 (oldest deadline 2019-11-29T03:24:01.431500+0000) 2019-11-29T03:24:10.775 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:24:10.771+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.987099+0000 front 2019-11-29T03:23:20.480044+0000 (oldest deadline 2019-11-29T03:23:58.942693+0000) 2019-11-29T03:24:10.858 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:24:10.854+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.718717+0000 front 2019-11-29T03:23:20.483604+0000 (oldest deadline 2019-11-29T03:23:59.799644+0000) 2019-11-29T03:24:11.040 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:24:11.036+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.122822+0000 front 2019-11-29T03:23:20.117598+0000 (oldest deadline 2019-11-29T03:24:04.183433+0000) 2019-11-29T03:24:11.103 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:24:11.099+0000 1694c700 -1 osd.3 248 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-29T03:24:11.235 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:24:11.229+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.322522+0000 front 2019-11-29T03:23:18.299971+0000 (oldest deadline 2019-11-29T03:23:59.374349+0000) 2019-11-29T03:24:11.539 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:24:11.535+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.484875+0000 front 2019-11-29T03:23:20.482762+0000 (oldest deadline 2019-11-29T03:24:01.431500+0000) 2019-11-29T03:24:11.756 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:24:11.753+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.987099+0000 front 2019-11-29T03:23:20.480044+0000 (oldest deadline 2019-11-29T03:23:58.942693+0000) 2019-11-29T03:24:11.828 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:24:11.822+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.718717+0000 front 2019-11-29T03:23:20.483604+0000 (oldest deadline 2019-11-29T03:23:59.799644+0000) 2019-11-29T03:24:12.015 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:24:12.009+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.122822+0000 front 2019-11-29T03:23:20.117598+0000 (oldest deadline 2019-11-29T03:24:04.183433+0000) 2019-11-29T03:24:12.127 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:24:12.123+0000 1694c700 -1 osd.3 248 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-29T03:24:12.269 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:24:12.263+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.322522+0000 front 2019-11-29T03:23:18.299971+0000 (oldest deadline 2019-11-29T03:23:59.374349+0000) 2019-11-29T03:24:12.570 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:24:12.566+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.484875+0000 front 2019-11-29T03:23:20.482762+0000 (oldest deadline 2019-11-29T03:24:01.431500+0000) 2019-11-29T03:24:12.786 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:24:12.780+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.718717+0000 front 2019-11-29T03:23:20.483604+0000 (oldest deadline 2019-11-29T03:23:59.799644+0000) 2019-11-29T03:24:12.807 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:24:12.804+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.987099+0000 front 2019-11-29T03:23:20.480044+0000 (oldest deadline 2019-11-29T03:23:58.942693+0000) 2019-11-29T03:24:12.973 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:24:12.968+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.122822+0000 front 2019-11-29T03:23:20.117598+0000 (oldest deadline 2019-11-29T03:24:04.183433+0000) 2019-11-29T03:24:13.101 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:24:13.097+0000 1694c700 -1 osd.3 248 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-29T03:24:13.261 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:24:13.255+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.322522+0000 front 2019-11-29T03:23:18.299971+0000 (oldest deadline 2019-11-29T03:23:59.374349+0000) 2019-11-29T03:24:13.545 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:24:13.541+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.484875+0000 front 2019-11-29T03:23:20.482762+0000 (oldest deadline 2019-11-29T03:24:01.431500+0000) 2019-11-29T03:24:13.764 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:24:13.758+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.718717+0000 front 2019-11-29T03:23:20.483604+0000 (oldest deadline 2019-11-29T03:23:59.799644+0000) 2019-11-29T03:24:13.777 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:24:13.773+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.987099+0000 front 2019-11-29T03:23:20.480044+0000 (oldest deadline 2019-11-29T03:23:58.942693+0000) 2019-11-29T03:24:13.944 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:24:13.938+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.122822+0000 front 2019-11-29T03:23:20.117598+0000 (oldest deadline 2019-11-29T03:24:04.183433+0000) 2019-11-29T03:24:14.146 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:24:14.143+0000 1694c700 -1 osd.3 248 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-29T03:24:14.229 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:24:14.223+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.322522+0000 front 2019-11-29T03:23:18.299971+0000 (oldest deadline 2019-11-29T03:23:59.374349+0000) 2019-11-29T03:24:14.594 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:24:14.591+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.484875+0000 front 2019-11-29T03:23:20.482762+0000 (oldest deadline 2019-11-29T03:24:01.431500+0000) 2019-11-29T03:24:14.774 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:24:14.769+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.987099+0000 front 2019-11-29T03:23:20.480044+0000 (oldest deadline 2019-11-29T03:23:58.942693+0000) 2019-11-29T03:24:14.819 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:24:14.814+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.718717+0000 front 2019-11-29T03:23:20.483604+0000 (oldest deadline 2019-11-29T03:23:59.799644+0000) 2019-11-29T03:24:14.919 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:24:14.915+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.122822+0000 front 2019-11-29T03:23:20.117598+0000 (oldest deadline 2019-11-29T03:24:04.183433+0000) 2019-11-29T03:24:15.184 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:24:15.180+0000 1694c700 -1 osd.3 248 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-29T03:24:15.248 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:24:15.244+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.322522+0000 front 2019-11-29T03:23:18.299971+0000 (oldest deadline 2019-11-29T03:23:59.374349+0000) 2019-11-29T03:24:15.566 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:24:15.562+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.484875+0000 front 2019-11-29T03:23:20.482762+0000 (oldest deadline 2019-11-29T03:24:01.431500+0000) 2019-11-29T03:24:15.730 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:24:15.726+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.987099+0000 front 2019-11-29T03:23:20.480044+0000 (oldest deadline 2019-11-29T03:23:58.942693+0000) 2019-11-29T03:24:15.840 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:24:15.836+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.718717+0000 front 2019-11-29T03:23:20.483604+0000 (oldest deadline 2019-11-29T03:23:59.799644+0000) 2019-11-29T03:24:15.909 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:24:15.904+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.122822+0000 front 2019-11-29T03:23:20.117598+0000 (oldest deadline 2019-11-29T03:24:04.183433+0000) 2019-11-29T03:24:16.175 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:24:16.172+0000 1694c700 -1 osd.3 248 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-29T03:24:16.209 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:24:16.204+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.322522+0000 front 2019-11-29T03:23:18.299971+0000 (oldest deadline 2019-11-29T03:23:59.374349+0000) 2019-11-29T03:24:16.588 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:24:16.585+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.484875+0000 front 2019-11-29T03:23:20.482762+0000 (oldest deadline 2019-11-29T03:24:01.431500+0000) 2019-11-29T03:24:16.684 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:24:16.681+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.987099+0000 front 2019-11-29T03:23:20.480044+0000 (oldest deadline 2019-11-29T03:23:58.942693+0000) 2019-11-29T03:24:16.865 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:24:16.860+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.718717+0000 front 2019-11-29T03:23:20.483604+0000 (oldest deadline 2019-11-29T03:23:59.799644+0000) 2019-11-29T03:24:16.875 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:24:16.870+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.122822+0000 front 2019-11-29T03:23:20.117598+0000 (oldest deadline 2019-11-29T03:24:04.183433+0000) 2019-11-29T03:24:17.144 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:24:17.141+0000 1694c700 -1 osd.3 248 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-29T03:24:17.175 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:24:17.169+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.322522+0000 front 2019-11-29T03:23:18.299971+0000 (oldest deadline 2019-11-29T03:23:59.374349+0000) 2019-11-29T03:24:17.623 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:24:17.619+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.484875+0000 front 2019-11-29T03:23:20.482762+0000 (oldest deadline 2019-11-29T03:24:01.431500+0000) 2019-11-29T03:24:17.654 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:24:17.649+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.987099+0000 front 2019-11-29T03:23:20.480044+0000 (oldest deadline 2019-11-29T03:23:58.942693+0000) 2019-11-29T03:24:17.843 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:24:17.839+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.718717+0000 front 2019-11-29T03:23:20.483604+0000 (oldest deadline 2019-11-29T03:23:59.799644+0000) 2019-11-29T03:24:17.902 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:24:17.897+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.122822+0000 front 2019-11-29T03:23:20.117598+0000 (oldest deadline 2019-11-29T03:24:04.183433+0000) 2019-11-29T03:24:18.133 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:24:18.129+0000 1694c700 -1 osd.3 248 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-29T03:24:18.178 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:24:18.172+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.322522+0000 front 2019-11-29T03:23:18.299971+0000 (oldest deadline 2019-11-29T03:23:59.374349+0000) 2019-11-29T03:24:18.604 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:24:18.600+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.484875+0000 front 2019-11-29T03:23:20.482762+0000 (oldest deadline 2019-11-29T03:24:01.431500+0000) 2019-11-29T03:24:18.642 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:24:18.638+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.987099+0000 front 2019-11-29T03:23:20.480044+0000 (oldest deadline 2019-11-29T03:23:58.942693+0000) 2019-11-29T03:24:18.828 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:24:18.823+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.718717+0000 front 2019-11-29T03:23:20.483604+0000 (oldest deadline 2019-11-29T03:23:59.799644+0000) 2019-11-29T03:24:18.892 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:24:18.887+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.122822+0000 front 2019-11-29T03:23:20.117598+0000 (oldest deadline 2019-11-29T03:24:04.183433+0000) 2019-11-29T03:24:19.181 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:24:19.178+0000 1694c700 -1 osd.3 248 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-29T03:24:19.211 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:24:19.206+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.322522+0000 front 2019-11-29T03:23:18.299971+0000 (oldest deadline 2019-11-29T03:23:59.374349+0000) 2019-11-29T03:24:19.599 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:24:19.595+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.484875+0000 front 2019-11-29T03:23:20.482762+0000 (oldest deadline 2019-11-29T03:24:01.431500+0000) 2019-11-29T03:24:19.699 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:24:19.690+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.987099+0000 front 2019-11-29T03:23:20.480044+0000 (oldest deadline 2019-11-29T03:23:58.942693+0000) 2019-11-29T03:24:19.799 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:24:19.794+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.718717+0000 front 2019-11-29T03:23:20.483604+0000 (oldest deadline 2019-11-29T03:23:59.799644+0000) 2019-11-29T03:24:19.850 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:24:19.845+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.122822+0000 front 2019-11-29T03:23:20.117598+0000 (oldest deadline 2019-11-29T03:24:04.183433+0000) 2019-11-29T03:24:20.178 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:24:20.175+0000 1694c700 -1 osd.3 248 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-29T03:24:20.203 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:24:20.198+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.322522+0000 front 2019-11-29T03:23:18.299971+0000 (oldest deadline 2019-11-29T03:23:59.374349+0000) 2019-11-29T03:24:20.573 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:24:20.570+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.484875+0000 front 2019-11-29T03:23:20.482762+0000 (oldest deadline 2019-11-29T03:24:01.431500+0000) 2019-11-29T03:24:20.711 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:24:20.707+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.987099+0000 front 2019-11-29T03:23:20.480044+0000 (oldest deadline 2019-11-29T03:23:58.942693+0000) 2019-11-29T03:24:20.778 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:24:20.774+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.718717+0000 front 2019-11-29T03:23:20.483604+0000 (oldest deadline 2019-11-29T03:23:59.799644+0000) 2019-11-29T03:24:20.832 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:24:20.827+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.122822+0000 front 2019-11-29T03:23:20.117598+0000 (oldest deadline 2019-11-29T03:24:04.183433+0000) 2019-11-29T03:24:21.197 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:24:21.191+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.322522+0000 front 2019-11-29T03:23:18.299971+0000 (oldest deadline 2019-11-29T03:23:59.374349+0000) 2019-11-29T03:24:21.214 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:24:21.211+0000 1694c700 -1 osd.3 248 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-29T03:24:21.535 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:24:21.531+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.484875+0000 front 2019-11-29T03:23:20.482762+0000 (oldest deadline 2019-11-29T03:24:01.431500+0000) 2019-11-29T03:24:21.690 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:24:21.686+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.987099+0000 front 2019-11-29T03:23:20.480044+0000 (oldest deadline 2019-11-29T03:23:58.942693+0000) 2019-11-29T03:24:21.799 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:24:21.794+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.718717+0000 front 2019-11-29T03:23:20.483604+0000 (oldest deadline 2019-11-29T03:23:59.799644+0000) 2019-11-29T03:24:21.841 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:24:21.836+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.122822+0000 front 2019-11-29T03:23:20.117598+0000 (oldest deadline 2019-11-29T03:24:04.183433+0000) 2019-11-29T03:24:22.191 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:24:22.185+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.322522+0000 front 2019-11-29T03:23:18.299971+0000 (oldest deadline 2019-11-29T03:23:59.374349+0000) 2019-11-29T03:24:22.207 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:24:22.203+0000 1694c700 -1 osd.3 248 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-29T03:24:22.556 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:24:22.552+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.484875+0000 front 2019-11-29T03:23:20.482762+0000 (oldest deadline 2019-11-29T03:24:01.431500+0000) 2019-11-29T03:24:22.695 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:24:22.691+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.987099+0000 front 2019-11-29T03:23:20.480044+0000 (oldest deadline 2019-11-29T03:23:58.942693+0000) 2019-11-29T03:24:22.821 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:24:22.816+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.718717+0000 front 2019-11-29T03:23:20.483604+0000 (oldest deadline 2019-11-29T03:23:59.799644+0000) 2019-11-29T03:24:22.852 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:24:22.847+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.122822+0000 front 2019-11-29T03:23:20.117598+0000 (oldest deadline 2019-11-29T03:24:04.183433+0000) 2019-11-29T03:24:23.226 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:24:23.223+0000 1694c700 -1 osd.3 248 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-29T03:24:23.242 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:24:23.237+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.322522+0000 front 2019-11-29T03:23:18.299971+0000 (oldest deadline 2019-11-29T03:23:59.374349+0000) 2019-11-29T03:24:23.587 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:24:23.582+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.484875+0000 front 2019-11-29T03:23:20.482762+0000 (oldest deadline 2019-11-29T03:24:01.431500+0000) 2019-11-29T03:24:23.667 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:24:23.663+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.987099+0000 front 2019-11-29T03:23:20.480044+0000 (oldest deadline 2019-11-29T03:23:58.942693+0000) 2019-11-29T03:24:23.826 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:24:23.821+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.122822+0000 front 2019-11-29T03:23:20.117598+0000 (oldest deadline 2019-11-29T03:24:04.183433+0000) 2019-11-29T03:24:23.830 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:24:23.825+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.718717+0000 front 2019-11-29T03:23:20.483604+0000 (oldest deadline 2019-11-29T03:23:59.799644+0000) 2019-11-29T03:24:24.196 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:24:24.193+0000 1694c700 -1 osd.3 248 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-29T03:24:24.258 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:24:24.254+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.322522+0000 front 2019-11-29T03:23:18.299971+0000 (oldest deadline 2019-11-29T03:23:59.374349+0000) 2019-11-29T03:24:24.553 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:24:24.549+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.484875+0000 front 2019-11-29T03:23:20.482762+0000 (oldest deadline 2019-11-29T03:24:01.431500+0000) 2019-11-29T03:24:24.649 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:24:24.645+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.987099+0000 front 2019-11-29T03:23:20.480044+0000 (oldest deadline 2019-11-29T03:23:58.942693+0000) 2019-11-29T03:24:24.838 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:24:24.834+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.718717+0000 front 2019-11-29T03:23:20.483604+0000 (oldest deadline 2019-11-29T03:23:59.799644+0000) 2019-11-29T03:24:24.860 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:24:24.855+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.122822+0000 front 2019-11-29T03:23:20.117598+0000 (oldest deadline 2019-11-29T03:24:04.183433+0000) 2019-11-29T03:24:25.212 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:24:25.209+0000 1694c700 -1 osd.3 248 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-29T03:24:25.227 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:24:25.222+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.322522+0000 front 2019-11-29T03:23:18.299971+0000 (oldest deadline 2019-11-29T03:23:59.374349+0000) 2019-11-29T03:24:25.518 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:24:25.514+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.484875+0000 front 2019-11-29T03:23:20.482762+0000 (oldest deadline 2019-11-29T03:24:01.431500+0000) 2019-11-29T03:24:25.651 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:24:25.648+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.987099+0000 front 2019-11-29T03:23:20.480044+0000 (oldest deadline 2019-11-29T03:23:58.942693+0000) 2019-11-29T03:24:25.869 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:24:25.864+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.718717+0000 front 2019-11-29T03:23:20.483604+0000 (oldest deadline 2019-11-29T03:23:59.799644+0000) 2019-11-29T03:24:25.882 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:24:25.877+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.122822+0000 front 2019-11-29T03:23:20.117598+0000 (oldest deadline 2019-11-29T03:24:04.183433+0000) 2019-11-29T03:24:26.209 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:24:26.206+0000 1694c700 -1 osd.3 248 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-29T03:24:26.281 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:24:26.276+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.322522+0000 front 2019-11-29T03:23:18.299971+0000 (oldest deadline 2019-11-29T03:23:59.374349+0000) 2019-11-29T03:24:26.568 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:24:26.564+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.484875+0000 front 2019-11-29T03:23:20.482762+0000 (oldest deadline 2019-11-29T03:24:01.431500+0000) 2019-11-29T03:24:26.700 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:24:26.697+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.987099+0000 front 2019-11-29T03:23:20.480044+0000 (oldest deadline 2019-11-29T03:23:58.942693+0000) 2019-11-29T03:24:26.896 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:24:26.891+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.122822+0000 front 2019-11-29T03:23:20.117598+0000 (oldest deadline 2019-11-29T03:24:04.183433+0000) 2019-11-29T03:24:26.899 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:24:26.894+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.718717+0000 front 2019-11-29T03:23:20.483604+0000 (oldest deadline 2019-11-29T03:23:59.799644+0000) 2019-11-29T03:24:27.253 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:24:27.250+0000 1694c700 -1 osd.3 248 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-29T03:24:27.281 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:24:27.276+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.322522+0000 front 2019-11-29T03:23:18.299971+0000 (oldest deadline 2019-11-29T03:23:59.374349+0000) 2019-11-29T03:24:27.596 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:24:27.592+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.484875+0000 front 2019-11-29T03:23:20.482762+0000 (oldest deadline 2019-11-29T03:24:01.431500+0000) 2019-11-29T03:24:27.654 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:24:27.651+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.987099+0000 front 2019-11-29T03:23:20.480044+0000 (oldest deadline 2019-11-29T03:23:58.942693+0000) 2019-11-29T03:24:27.886 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:24:27.880+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.718717+0000 front 2019-11-29T03:23:20.483604+0000 (oldest deadline 2019-11-29T03:23:59.799644+0000) 2019-11-29T03:24:27.952 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:24:27.948+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.122822+0000 front 2019-11-29T03:23:20.117598+0000 (oldest deadline 2019-11-29T03:24:04.183433+0000) 2019-11-29T03:24:28.236 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:24:28.231+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.322522+0000 front 2019-11-29T03:23:18.299971+0000 (oldest deadline 2019-11-29T03:23:59.374349+0000) 2019-11-29T03:24:28.284 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:24:28.281+0000 1694c700 -1 osd.3 248 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-29T03:24:28.618 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:24:28.615+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.484875+0000 front 2019-11-29T03:23:20.482762+0000 (oldest deadline 2019-11-29T03:24:01.431500+0000) 2019-11-29T03:24:28.619 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:24:28.617+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.987099+0000 front 2019-11-29T03:23:20.480044+0000 (oldest deadline 2019-11-29T03:23:58.942693+0000) 2019-11-29T03:24:28.910 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:24:28.905+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.122822+0000 front 2019-11-29T03:23:20.117598+0000 (oldest deadline 2019-11-29T03:24:04.183433+0000) 2019-11-29T03:24:28.939 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:24:28.934+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.718717+0000 front 2019-11-29T03:23:20.483604+0000 (oldest deadline 2019-11-29T03:23:59.799644+0000) 2019-11-29T03:24:29.232 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:24:29.227+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.322522+0000 front 2019-11-29T03:23:18.299971+0000 (oldest deadline 2019-11-29T03:23:59.374349+0000) 2019-11-29T03:24:29.304 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:24:29.301+0000 1694c700 -1 osd.3 248 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-29T03:24:29.625 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:24:29.621+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.987099+0000 front 2019-11-29T03:23:20.480044+0000 (oldest deadline 2019-11-29T03:23:58.942693+0000) 2019-11-29T03:24:29.648 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:24:29.644+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.484875+0000 front 2019-11-29T03:23:20.482762+0000 (oldest deadline 2019-11-29T03:24:01.431500+0000) 2019-11-29T03:24:29.864 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:24:29.859+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.122822+0000 front 2019-11-29T03:23:20.117598+0000 (oldest deadline 2019-11-29T03:24:04.183433+0000) 2019-11-29T03:24:29.913 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:24:29.895+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.718717+0000 front 2019-11-29T03:23:20.483604+0000 (oldest deadline 2019-11-29T03:23:59.799644+0000) 2019-11-29T03:24:30.274 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:24:30.269+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.322522+0000 front 2019-11-29T03:23:18.299971+0000 (oldest deadline 2019-11-29T03:23:59.374349+0000) 2019-11-29T03:24:30.299 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:24:30.295+0000 1694c700 -1 osd.3 248 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-29T03:24:30.633 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:24:30.630+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.987099+0000 front 2019-11-29T03:23:20.480044+0000 (oldest deadline 2019-11-29T03:23:58.942693+0000) 2019-11-29T03:24:30.663 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:24:30.660+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.484875+0000 front 2019-11-29T03:23:20.482762+0000 (oldest deadline 2019-11-29T03:24:01.431500+0000) 2019-11-29T03:24:30.878 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:24:30.874+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.718717+0000 front 2019-11-29T03:23:20.483604+0000 (oldest deadline 2019-11-29T03:23:59.799644+0000) 2019-11-29T03:24:30.891 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:24:30.886+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.122822+0000 front 2019-11-29T03:23:20.117598+0000 (oldest deadline 2019-11-29T03:24:04.183433+0000) 2019-11-29T03:24:31.255 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:24:31.251+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:23:33.354091+0000 (oldest deadline 2019-11-29T03:24:30.540401+0000) 2019-11-29T03:24:31.259 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:24:31.255+0000 1694c700 -1 osd.3 248 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-29T03:24:31.259 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:24:31.255+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.322522+0000 front 2019-11-29T03:23:18.299971+0000 (oldest deadline 2019-11-29T03:23:59.374349+0000) 2019-11-29T03:24:31.650 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:24:31.646+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:20.484875+0000 front 2019-11-29T03:23:20.482762+0000 (oldest deadline 2019-11-29T03:24:01.431500+0000) 2019-11-29T03:24:31.682 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:24:31.679+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:23:18.987099+0000 front 2019-11-29T03:23:20.480044+0000 (oldest deadline 2019-11-29T03:23:58.942693+0000) 2019-11-29T03:24:32.262 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:24:32.257+0000 1694c700 -1 osd.3 249 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-29T03:25:16.155 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:25:16.138+0000 30f82700 -1 osd.5 253 build_incremental_map_msg missing incremental map 253 2019-11-29T03:25:16.412 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:25:16.395+0000 37f90700 -1 osd.5 253 build_incremental_map_msg missing incremental map 253 2019-11-29T03:26:15.900 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:26:15.895+0000 1694c700 -1 osd.5 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.939959+0000 front 2019-11-29T03:25:30.948154+0000 (oldest deadline 2019-11-29T03:26:15.307180+0000) 2019-11-29T03:26:16.932 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:26:16.927+0000 1694c700 -1 osd.5 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.939959+0000 front 2019-11-29T03:25:30.948154+0000 (oldest deadline 2019-11-29T03:26:15.307180+0000) 2019-11-29T03:26:17.142 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:26:17.137+0000 1694c700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.688160+0000 front 2019-11-29T03:25:33.503540+0000 (oldest deadline 2019-11-29T03:26:16.172591+0000) 2019-11-29T03:26:17.303 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:26:17.299+0000 1694c700 -1 osd.1 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.617452+0000 front 2019-11-29T03:25:30.522639+0000 (oldest deadline 2019-11-29T03:26:16.404463+0000) 2019-11-29T03:26:17.902 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:26:17.896+0000 1694c700 -1 osd.5 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.939959+0000 front 2019-11-29T03:25:30.948154+0000 (oldest deadline 2019-11-29T03:26:15.307180+0000) 2019-11-29T03:26:17.914 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:26:17.911+0000 1694c700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.766541+0000 front 2019-11-29T03:25:33.750734+0000 (oldest deadline 2019-11-29T03:26:17.814226+0000) 2019-11-29T03:26:18.145 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:26:18.139+0000 1694c700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.688160+0000 front 2019-11-29T03:25:33.503540+0000 (oldest deadline 2019-11-29T03:26:16.172591+0000) 2019-11-29T03:26:18.304 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:26:18.300+0000 1694c700 -1 osd.1 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.617452+0000 front 2019-11-29T03:25:30.522639+0000 (oldest deadline 2019-11-29T03:26:16.404463+0000) 2019-11-29T03:26:18.867 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:26:18.865+0000 1694c700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.766541+0000 front 2019-11-29T03:25:33.750734+0000 (oldest deadline 2019-11-29T03:26:17.814226+0000) 2019-11-29T03:26:18.868 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:26:18.861+0000 1694c700 -1 osd.5 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.939959+0000 front 2019-11-29T03:25:30.948154+0000 (oldest deadline 2019-11-29T03:26:15.307180+0000) 2019-11-29T03:26:19.202 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:26:19.195+0000 1694c700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.688160+0000 front 2019-11-29T03:25:33.503540+0000 (oldest deadline 2019-11-29T03:26:16.172591+0000) 2019-11-29T03:26:19.291 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:26:19.289+0000 1694c700 -1 osd.1 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.617452+0000 front 2019-11-29T03:25:30.522639+0000 (oldest deadline 2019-11-29T03:26:16.404463+0000) 2019-11-29T03:26:19.297 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:26:19.291+0000 1694c700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:34.225209+0000 front 2019-11-29T03:25:33.600261+0000 (oldest deadline 2019-11-29T03:26:18.868663+0000) 2019-11-29T03:26:19.688 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:26:19.682+0000 1694c700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.687904+0000 front 2019-11-29T03:25:34.225846+0000 (oldest deadline 2019-11-29T03:26:19.522883+0000) 2019-11-29T03:26:19.825 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:26:19.820+0000 1694c700 -1 osd.5 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.939959+0000 front 2019-11-29T03:25:30.948154+0000 (oldest deadline 2019-11-29T03:26:15.307180+0000) 2019-11-29T03:26:19.889 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:26:19.885+0000 1694c700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.766541+0000 front 2019-11-29T03:25:33.750734+0000 (oldest deadline 2019-11-29T03:26:17.814226+0000) 2019-11-29T03:26:20.125 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:26:20.123+0000 1694c700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.689841+0000 front 2019-11-29T03:25:33.328471+0000 (oldest deadline 2019-11-29T03:26:19.202228+0000) 2019-11-29T03:26:20.192 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:26:20.186+0000 1694c700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.688160+0000 front 2019-11-29T03:25:33.503540+0000 (oldest deadline 2019-11-29T03:26:16.172591+0000) 2019-11-29T03:26:20.311 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:26:20.308+0000 1694c700 -1 osd.1 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.617452+0000 front 2019-11-29T03:25:30.522639+0000 (oldest deadline 2019-11-29T03:26:16.404463+0000) 2019-11-29T03:26:20.328 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:26:20.323+0000 1694c700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:34.225209+0000 front 2019-11-29T03:25:33.600261+0000 (oldest deadline 2019-11-29T03:26:18.868663+0000) 2019-11-29T03:26:20.656 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:26:20.650+0000 1694c700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.687904+0000 front 2019-11-29T03:25:34.225846+0000 (oldest deadline 2019-11-29T03:26:19.522883+0000) 2019-11-29T03:26:20.868 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:26:20.863+0000 1694c700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.766541+0000 front 2019-11-29T03:25:33.750734+0000 (oldest deadline 2019-11-29T03:26:17.814226+0000) 2019-11-29T03:26:20.872 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:26:20.865+0000 1694c700 -1 osd.5 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.939959+0000 front 2019-11-29T03:25:30.948154+0000 (oldest deadline 2019-11-29T03:26:15.307180+0000) 2019-11-29T03:26:21.123 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:26:21.120+0000 1694c700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.689841+0000 front 2019-11-29T03:25:33.328471+0000 (oldest deadline 2019-11-29T03:26:19.202228+0000) 2019-11-29T03:26:21.158 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:26:21.153+0000 1694c700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.688160+0000 front 2019-11-29T03:25:33.503540+0000 (oldest deadline 2019-11-29T03:26:16.172591+0000) 2019-11-29T03:26:21.278 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:26:21.275+0000 1694c700 -1 osd.1 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.617452+0000 front 2019-11-29T03:25:30.522639+0000 (oldest deadline 2019-11-29T03:26:16.404463+0000) 2019-11-29T03:26:21.327 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:26:21.321+0000 1694c700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:34.225209+0000 front 2019-11-29T03:25:33.600261+0000 (oldest deadline 2019-11-29T03:26:18.868663+0000) 2019-11-29T03:26:21.702 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:26:21.697+0000 1694c700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.687904+0000 front 2019-11-29T03:25:34.225846+0000 (oldest deadline 2019-11-29T03:26:19.522883+0000) 2019-11-29T03:26:21.834 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:26:21.828+0000 1694c700 -1 osd.5 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.939959+0000 front 2019-11-29T03:25:30.948154+0000 (oldest deadline 2019-11-29T03:26:15.307180+0000) 2019-11-29T03:26:21.857 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:26:21.855+0000 1694c700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.766541+0000 front 2019-11-29T03:25:33.750734+0000 (oldest deadline 2019-11-29T03:26:17.814226+0000) 2019-11-29T03:26:22.162 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:26:22.158+0000 1694c700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.689841+0000 front 2019-11-29T03:25:33.328471+0000 (oldest deadline 2019-11-29T03:26:19.202228+0000) 2019-11-29T03:26:22.190 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:26:22.184+0000 1694c700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.688160+0000 front 2019-11-29T03:25:33.503540+0000 (oldest deadline 2019-11-29T03:26:16.172591+0000) 2019-11-29T03:26:22.255 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:26:22.248+0000 1694c700 -1 osd.1 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.617452+0000 front 2019-11-29T03:25:30.522639+0000 (oldest deadline 2019-11-29T03:26:16.404463+0000) 2019-11-29T03:26:22.366 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:26:22.359+0000 1694c700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:34.225209+0000 front 2019-11-29T03:25:33.600261+0000 (oldest deadline 2019-11-29T03:26:18.868663+0000) 2019-11-29T03:26:22.751 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:26:22.745+0000 1694c700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.687904+0000 front 2019-11-29T03:25:34.225846+0000 (oldest deadline 2019-11-29T03:26:19.522883+0000) 2019-11-29T03:26:22.847 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:26:22.843+0000 1694c700 -1 osd.5 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.939959+0000 front 2019-11-29T03:25:30.948154+0000 (oldest deadline 2019-11-29T03:26:15.307180+0000) 2019-11-29T03:26:22.856 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:26:22.854+0000 1694c700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.766541+0000 front 2019-11-29T03:25:33.750734+0000 (oldest deadline 2019-11-29T03:26:17.814226+0000) 2019-11-29T03:26:23.139 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:26:23.136+0000 1694c700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.689841+0000 front 2019-11-29T03:25:33.328471+0000 (oldest deadline 2019-11-29T03:26:19.202228+0000) 2019-11-29T03:26:23.182 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:26:23.176+0000 1694c700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.688160+0000 front 2019-11-29T03:25:33.503540+0000 (oldest deadline 2019-11-29T03:26:16.172591+0000) 2019-11-29T03:26:23.270 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:26:23.267+0000 1694c700 -1 osd.1 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.617452+0000 front 2019-11-29T03:25:30.522639+0000 (oldest deadline 2019-11-29T03:26:16.404463+0000) 2019-11-29T03:26:23.372 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:26:23.366+0000 1694c700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:34.225209+0000 front 2019-11-29T03:25:33.600261+0000 (oldest deadline 2019-11-29T03:26:18.868663+0000) 2019-11-29T03:26:23.804 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:26:23.799+0000 1694c700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.687904+0000 front 2019-11-29T03:25:34.225846+0000 (oldest deadline 2019-11-29T03:26:19.522883+0000) 2019-11-29T03:26:23.830 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:26:23.827+0000 1694c700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.766541+0000 front 2019-11-29T03:25:33.750734+0000 (oldest deadline 2019-11-29T03:26:17.814226+0000) 2019-11-29T03:26:23.861 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:26:23.855+0000 1694c700 -1 osd.5 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.939959+0000 front 2019-11-29T03:25:30.948154+0000 (oldest deadline 2019-11-29T03:26:15.307180+0000) 2019-11-29T03:26:24.143 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:26:24.139+0000 1694c700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.689841+0000 front 2019-11-29T03:25:33.328471+0000 (oldest deadline 2019-11-29T03:26:19.202228+0000) 2019-11-29T03:26:24.199 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:26:24.193+0000 1694c700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.688160+0000 front 2019-11-29T03:25:33.503540+0000 (oldest deadline 2019-11-29T03:26:16.172591+0000) 2019-11-29T03:26:24.287 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:26:24.283+0000 1694c700 -1 osd.1 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.617452+0000 front 2019-11-29T03:25:30.522639+0000 (oldest deadline 2019-11-29T03:26:16.404463+0000) 2019-11-29T03:26:24.419 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:26:24.413+0000 1694c700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:34.225209+0000 front 2019-11-29T03:25:33.600261+0000 (oldest deadline 2019-11-29T03:26:18.868663+0000) 2019-11-29T03:26:24.810 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:26:24.804+0000 1694c700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.687904+0000 front 2019-11-29T03:25:34.225846+0000 (oldest deadline 2019-11-29T03:26:19.522883+0000) 2019-11-29T03:26:24.825 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:26:24.820+0000 1694c700 -1 osd.5 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.939959+0000 front 2019-11-29T03:25:30.948154+0000 (oldest deadline 2019-11-29T03:26:15.307180+0000) 2019-11-29T03:26:24.853 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:26:24.849+0000 1694c700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.766541+0000 front 2019-11-29T03:25:33.750734+0000 (oldest deadline 2019-11-29T03:26:17.814226+0000) 2019-11-29T03:26:25.127 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:26:25.123+0000 1694c700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.689841+0000 front 2019-11-29T03:25:33.328471+0000 (oldest deadline 2019-11-29T03:26:19.202228+0000) 2019-11-29T03:26:25.213 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:26:25.207+0000 1694c700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.688160+0000 front 2019-11-29T03:25:33.503540+0000 (oldest deadline 2019-11-29T03:26:16.172591+0000) 2019-11-29T03:26:25.256 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:26:25.252+0000 1694c700 -1 osd.1 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.617452+0000 front 2019-11-29T03:25:30.522639+0000 (oldest deadline 2019-11-29T03:26:16.404463+0000) 2019-11-29T03:26:25.440 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:26:25.435+0000 1694c700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:34.225209+0000 front 2019-11-29T03:25:33.600261+0000 (oldest deadline 2019-11-29T03:26:18.868663+0000) 2019-11-29T03:26:25.820 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:26:25.814+0000 1694c700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.687904+0000 front 2019-11-29T03:25:34.225846+0000 (oldest deadline 2019-11-29T03:26:19.522883+0000) 2019-11-29T03:26:25.853 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:26:25.847+0000 1694c700 -1 osd.5 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.939959+0000 front 2019-11-29T03:25:30.948154+0000 (oldest deadline 2019-11-29T03:26:15.307180+0000) 2019-11-29T03:26:25.904 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:26:25.900+0000 1694c700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.766541+0000 front 2019-11-29T03:25:33.750734+0000 (oldest deadline 2019-11-29T03:26:17.814226+0000) 2019-11-29T03:26:26.142 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:26:26.139+0000 1694c700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.689841+0000 front 2019-11-29T03:25:33.328471+0000 (oldest deadline 2019-11-29T03:26:19.202228+0000) 2019-11-29T03:26:26.242 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:26:26.236+0000 1694c700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.688160+0000 front 2019-11-29T03:25:33.503540+0000 (oldest deadline 2019-11-29T03:26:16.172591+0000) 2019-11-29T03:26:26.276 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:26:26.271+0000 1694c700 -1 osd.1 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.617452+0000 front 2019-11-29T03:25:30.522639+0000 (oldest deadline 2019-11-29T03:26:16.404463+0000) 2019-11-29T03:26:26.474 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:26:26.469+0000 1694c700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:34.225209+0000 front 2019-11-29T03:25:33.600261+0000 (oldest deadline 2019-11-29T03:26:18.868663+0000) 2019-11-29T03:26:26.784 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:26:26.778+0000 1694c700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.687904+0000 front 2019-11-29T03:25:34.225846+0000 (oldest deadline 2019-11-29T03:26:19.522883+0000) 2019-11-29T03:26:26.879 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:26:26.873+0000 1694c700 -1 osd.5 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.939959+0000 front 2019-11-29T03:25:30.948154+0000 (oldest deadline 2019-11-29T03:26:15.307180+0000) 2019-11-29T03:26:26.928 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:26:26.924+0000 1694c700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.766541+0000 front 2019-11-29T03:25:33.750734+0000 (oldest deadline 2019-11-29T03:26:17.814226+0000) 2019-11-29T03:26:27.099 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:26:27.095+0000 1694c700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.689841+0000 front 2019-11-29T03:25:33.328471+0000 (oldest deadline 2019-11-29T03:26:19.202228+0000) 2019-11-29T03:26:27.257 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:26:27.253+0000 1694c700 -1 osd.1 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.617452+0000 front 2019-11-29T03:25:30.522639+0000 (oldest deadline 2019-11-29T03:26:16.404463+0000) 2019-11-29T03:26:27.277 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:26:27.272+0000 1694c700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.688160+0000 front 2019-11-29T03:25:33.503540+0000 (oldest deadline 2019-11-29T03:26:16.172591+0000) 2019-11-29T03:26:27.489 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:26:27.484+0000 1694c700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:34.225209+0000 front 2019-11-29T03:25:33.600261+0000 (oldest deadline 2019-11-29T03:26:18.868663+0000) 2019-11-29T03:26:27.787 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:26:27.781+0000 1694c700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.687904+0000 front 2019-11-29T03:25:34.225846+0000 (oldest deadline 2019-11-29T03:26:19.522883+0000) 2019-11-29T03:26:27.894 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:26:27.890+0000 1694c700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.766541+0000 front 2019-11-29T03:25:33.750734+0000 (oldest deadline 2019-11-29T03:26:17.814226+0000) 2019-11-29T03:26:27.923 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:26:27.918+0000 1694c700 -1 osd.5 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.939959+0000 front 2019-11-29T03:25:30.948154+0000 (oldest deadline 2019-11-29T03:26:15.307180+0000) 2019-11-29T03:26:28.145 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:26:28.140+0000 1694c700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.689841+0000 front 2019-11-29T03:25:33.328471+0000 (oldest deadline 2019-11-29T03:26:19.202228+0000) 2019-11-29T03:26:28.265 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:26:28.261+0000 1694c700 -1 osd.1 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.617452+0000 front 2019-11-29T03:25:30.522639+0000 (oldest deadline 2019-11-29T03:26:16.404463+0000) 2019-11-29T03:26:28.294 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:26:28.288+0000 1694c700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.688160+0000 front 2019-11-29T03:25:33.503540+0000 (oldest deadline 2019-11-29T03:26:16.172591+0000) 2019-11-29T03:26:28.506 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:26:28.500+0000 1694c700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:34.225209+0000 front 2019-11-29T03:25:33.600261+0000 (oldest deadline 2019-11-29T03:26:18.868663+0000) 2019-11-29T03:26:28.797 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:26:28.792+0000 1694c700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.687904+0000 front 2019-11-29T03:25:34.225846+0000 (oldest deadline 2019-11-29T03:26:19.522883+0000) 2019-11-29T03:26:28.857 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:26:28.853+0000 1694c700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.766541+0000 front 2019-11-29T03:25:33.750734+0000 (oldest deadline 2019-11-29T03:26:17.814226+0000) 2019-11-29T03:26:28.964 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:26:28.959+0000 1694c700 -1 osd.5 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.939959+0000 front 2019-11-29T03:25:30.948154+0000 (oldest deadline 2019-11-29T03:26:15.307180+0000) 2019-11-29T03:26:29.098 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:26:29.095+0000 1694c700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.689841+0000 front 2019-11-29T03:25:33.328471+0000 (oldest deadline 2019-11-29T03:26:19.202228+0000) 2019-11-29T03:26:29.261 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:26:29.258+0000 1694c700 -1 osd.1 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.617452+0000 front 2019-11-29T03:25:30.522639+0000 (oldest deadline 2019-11-29T03:26:16.404463+0000) 2019-11-29T03:26:29.281 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:26:29.275+0000 1694c700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.688160+0000 front 2019-11-29T03:25:33.503540+0000 (oldest deadline 2019-11-29T03:26:16.172591+0000) 2019-11-29T03:26:29.474 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:26:29.469+0000 1694c700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:34.225209+0000 front 2019-11-29T03:25:33.600261+0000 (oldest deadline 2019-11-29T03:26:18.868663+0000) 2019-11-29T03:26:29.846 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:26:29.840+0000 1694c700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.687904+0000 front 2019-11-29T03:25:34.225846+0000 (oldest deadline 2019-11-29T03:26:19.522883+0000) 2019-11-29T03:26:29.857 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:26:29.852+0000 1694c700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.766541+0000 front 2019-11-29T03:25:33.750734+0000 (oldest deadline 2019-11-29T03:26:17.814226+0000) 2019-11-29T03:26:29.952 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:26:29.944+0000 1694c700 -1 osd.5 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.939959+0000 front 2019-11-29T03:25:30.948154+0000 (oldest deadline 2019-11-29T03:26:15.307180+0000) 2019-11-29T03:26:30.151 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:26:30.148+0000 1694c700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.689841+0000 front 2019-11-29T03:25:33.328471+0000 (oldest deadline 2019-11-29T03:26:19.202228+0000) 2019-11-29T03:26:30.270 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:26:30.267+0000 1694c700 -1 osd.1 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.617452+0000 front 2019-11-29T03:25:30.522639+0000 (oldest deadline 2019-11-29T03:26:16.404463+0000) 2019-11-29T03:26:30.282 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:26:30.277+0000 1694c700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.688160+0000 front 2019-11-29T03:25:33.503540+0000 (oldest deadline 2019-11-29T03:26:16.172591+0000) 2019-11-29T03:26:30.490 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:26:30.485+0000 1694c700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:34.225209+0000 front 2019-11-29T03:25:33.600261+0000 (oldest deadline 2019-11-29T03:26:18.868663+0000) 2019-11-29T03:26:30.857 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:26:30.851+0000 1694c700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.687904+0000 front 2019-11-29T03:25:34.225846+0000 (oldest deadline 2019-11-29T03:26:19.522883+0000) 2019-11-29T03:26:30.905 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:26:30.901+0000 1694c700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.766541+0000 front 2019-11-29T03:25:33.750734+0000 (oldest deadline 2019-11-29T03:26:17.814226+0000) 2019-11-29T03:26:30.966 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:26:30.960+0000 1694c700 -1 osd.5 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.939959+0000 front 2019-11-29T03:25:30.948154+0000 (oldest deadline 2019-11-29T03:26:15.307180+0000) 2019-11-29T03:26:31.157 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:26:31.152+0000 1694c700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.689841+0000 front 2019-11-29T03:25:33.328471+0000 (oldest deadline 2019-11-29T03:26:19.202228+0000) 2019-11-29T03:26:31.295 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:26:31.290+0000 1694c700 -1 osd.1 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.617452+0000 front 2019-11-29T03:25:30.522639+0000 (oldest deadline 2019-11-29T03:26:16.404463+0000) 2019-11-29T03:26:31.352 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:26:31.324+0000 1694c700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.688160+0000 front 2019-11-29T03:25:33.503540+0000 (oldest deadline 2019-11-29T03:26:16.172591+0000) 2019-11-29T03:26:31.525 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:26:31.519+0000 1694c700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:34.225209+0000 front 2019-11-29T03:25:33.600261+0000 (oldest deadline 2019-11-29T03:26:18.868663+0000) 2019-11-29T03:26:31.866 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:26:31.862+0000 1694c700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.766541+0000 front 2019-11-29T03:25:33.750734+0000 (oldest deadline 2019-11-29T03:26:17.814226+0000) 2019-11-29T03:26:31.877 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:26:31.872+0000 1694c700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.687904+0000 front 2019-11-29T03:25:34.225846+0000 (oldest deadline 2019-11-29T03:26:19.522883+0000) 2019-11-29T03:26:31.952 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:26:31.947+0000 1694c700 -1 osd.5 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.939959+0000 front 2019-11-29T03:25:30.948154+0000 (oldest deadline 2019-11-29T03:26:15.307180+0000) 2019-11-29T03:26:32.165 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:26:32.160+0000 1694c700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.689841+0000 front 2019-11-29T03:25:33.328471+0000 (oldest deadline 2019-11-29T03:26:19.202228+0000) 2019-11-29T03:26:32.270 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:26:32.267+0000 1694c700 -1 osd.1 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.617452+0000 front 2019-11-29T03:25:30.522639+0000 (oldest deadline 2019-11-29T03:26:16.404463+0000) 2019-11-29T03:26:32.360 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:26:32.354+0000 1694c700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.688160+0000 front 2019-11-29T03:25:33.503540+0000 (oldest deadline 2019-11-29T03:26:16.172591+0000) 2019-11-29T03:26:32.561 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:26:32.555+0000 1694c700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:34.225209+0000 front 2019-11-29T03:25:33.600261+0000 (oldest deadline 2019-11-29T03:26:18.868663+0000) 2019-11-29T03:26:32.888 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:26:32.882+0000 1694c700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.687904+0000 front 2019-11-29T03:25:34.225846+0000 (oldest deadline 2019-11-29T03:26:19.522883+0000) 2019-11-29T03:26:32.895 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:26:32.890+0000 1694c700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.766541+0000 front 2019-11-29T03:25:33.750734+0000 (oldest deadline 2019-11-29T03:26:17.814226+0000) 2019-11-29T03:26:32.986 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:26:32.980+0000 1694c700 -1 osd.5 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.939959+0000 front 2019-11-29T03:25:30.948154+0000 (oldest deadline 2019-11-29T03:26:15.307180+0000) 2019-11-29T03:26:33.173 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:26:33.168+0000 1694c700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.689841+0000 front 2019-11-29T03:25:33.328471+0000 (oldest deadline 2019-11-29T03:26:19.202228+0000) 2019-11-29T03:26:33.256 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:26:33.252+0000 1694c700 -1 osd.1 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.617452+0000 front 2019-11-29T03:25:30.522639+0000 (oldest deadline 2019-11-29T03:26:16.404463+0000) 2019-11-29T03:26:33.387 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:26:33.379+0000 1694c700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.688160+0000 front 2019-11-29T03:25:33.503540+0000 (oldest deadline 2019-11-29T03:26:16.172591+0000) 2019-11-29T03:26:33.594 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:26:33.586+0000 1694c700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:34.225209+0000 front 2019-11-29T03:25:33.600261+0000 (oldest deadline 2019-11-29T03:26:18.868663+0000) 2019-11-29T03:26:33.861 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:26:33.857+0000 1694c700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.766541+0000 front 2019-11-29T03:25:33.750734+0000 (oldest deadline 2019-11-29T03:26:17.814226+0000) 2019-11-29T03:26:33.892 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:26:33.885+0000 1694c700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.687904+0000 front 2019-11-29T03:25:34.225846+0000 (oldest deadline 2019-11-29T03:26:19.522883+0000) 2019-11-29T03:26:33.972 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:26:33.966+0000 1694c700 -1 osd.5 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.939959+0000 front 2019-11-29T03:25:30.948154+0000 (oldest deadline 2019-11-29T03:26:15.307180+0000) 2019-11-29T03:26:34.163 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:26:34.159+0000 1694c700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.689841+0000 front 2019-11-29T03:25:33.328471+0000 (oldest deadline 2019-11-29T03:26:19.202228+0000) 2019-11-29T03:26:34.220 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:26:34.217+0000 1694c700 -1 osd.1 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.617452+0000 front 2019-11-29T03:25:30.522639+0000 (oldest deadline 2019-11-29T03:26:16.404463+0000) 2019-11-29T03:26:34.388 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:26:34.381+0000 1694c700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.688160+0000 front 2019-11-29T03:25:33.503540+0000 (oldest deadline 2019-11-29T03:26:16.172591+0000) 2019-11-29T03:26:34.610 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:26:34.604+0000 1694c700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:34.225209+0000 front 2019-11-29T03:25:33.600261+0000 (oldest deadline 2019-11-29T03:26:18.868663+0000) 2019-11-29T03:26:34.848 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:26:34.840+0000 1694c700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.687904+0000 front 2019-11-29T03:25:34.225846+0000 (oldest deadline 2019-11-29T03:26:19.522883+0000) 2019-11-29T03:26:34.855 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:26:34.852+0000 1694c700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.766541+0000 front 2019-11-29T03:25:33.750734+0000 (oldest deadline 2019-11-29T03:26:17.814226+0000) 2019-11-29T03:26:34.953 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:26:34.939+0000 1694c700 -1 osd.5 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.939959+0000 front 2019-11-29T03:25:30.948154+0000 (oldest deadline 2019-11-29T03:26:15.307180+0000) 2019-11-29T03:26:35.147 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:26:35.138+0000 1694c700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.689841+0000 front 2019-11-29T03:25:33.328471+0000 (oldest deadline 2019-11-29T03:26:19.202228+0000) 2019-11-29T03:26:35.204 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:26:35.200+0000 1694c700 -1 osd.1 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.617452+0000 front 2019-11-29T03:25:30.522639+0000 (oldest deadline 2019-11-29T03:26:16.404463+0000) 2019-11-29T03:26:35.408 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:26:35.400+0000 1694c700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.688160+0000 front 2019-11-29T03:25:33.503540+0000 (oldest deadline 2019-11-29T03:26:16.172591+0000) 2019-11-29T03:26:35.595 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:26:35.589+0000 1694c700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:34.225209+0000 front 2019-11-29T03:25:33.600261+0000 (oldest deadline 2019-11-29T03:26:18.868663+0000) 2019-11-29T03:26:35.869 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:26:35.866+0000 1694c700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.766541+0000 front 2019-11-29T03:25:33.750734+0000 (oldest deadline 2019-11-29T03:26:17.814226+0000) 2019-11-29T03:26:35.887 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:26:35.881+0000 1694c700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.687904+0000 front 2019-11-29T03:25:34.225846+0000 (oldest deadline 2019-11-29T03:26:19.522883+0000) 2019-11-29T03:26:35.962 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:26:35.955+0000 1694c700 -1 osd.5 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.939959+0000 front 2019-11-29T03:25:30.948154+0000 (oldest deadline 2019-11-29T03:26:15.307180+0000) 2019-11-29T03:26:36.156 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:26:36.152+0000 1694c700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.689841+0000 front 2019-11-29T03:25:33.328471+0000 (oldest deadline 2019-11-29T03:26:19.202228+0000) 2019-11-29T03:26:36.186 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:26:36.183+0000 1694c700 -1 osd.1 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.617452+0000 front 2019-11-29T03:25:30.522639+0000 (oldest deadline 2019-11-29T03:26:16.404463+0000) 2019-11-29T03:26:36.375 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:26:36.370+0000 1694c700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.688160+0000 front 2019-11-29T03:25:33.503540+0000 (oldest deadline 2019-11-29T03:26:16.172591+0000) 2019-11-29T03:26:36.646 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:26:36.641+0000 1694c700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:34.225209+0000 front 2019-11-29T03:25:33.600261+0000 (oldest deadline 2019-11-29T03:26:18.868663+0000) 2019-11-29T03:26:36.854 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:26:36.842+0000 1694c700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.687904+0000 front 2019-11-29T03:25:34.225846+0000 (oldest deadline 2019-11-29T03:26:19.522883+0000) 2019-11-29T03:26:36.919 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:26:36.915+0000 1694c700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.766541+0000 front 2019-11-29T03:25:33.750734+0000 (oldest deadline 2019-11-29T03:26:17.814226+0000) 2019-11-29T03:26:36.968 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:26:36.962+0000 1694c700 -1 osd.5 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.939959+0000 front 2019-11-29T03:25:30.948154+0000 (oldest deadline 2019-11-29T03:26:15.307180+0000) 2019-11-29T03:26:37.151 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:26:37.148+0000 1694c700 -1 osd.1 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.617452+0000 front 2019-11-29T03:25:30.522639+0000 (oldest deadline 2019-11-29T03:26:16.404463+0000) 2019-11-29T03:26:37.186 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:26:37.183+0000 1694c700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.689841+0000 front 2019-11-29T03:25:33.328471+0000 (oldest deadline 2019-11-29T03:26:19.202228+0000) 2019-11-29T03:26:37.378 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:26:37.372+0000 1694c700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.688160+0000 front 2019-11-29T03:25:33.503540+0000 (oldest deadline 2019-11-29T03:26:16.172591+0000) 2019-11-29T03:26:37.612 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:26:37.607+0000 1694c700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:34.225209+0000 front 2019-11-29T03:25:33.600261+0000 (oldest deadline 2019-11-29T03:26:18.868663+0000) 2019-11-29T03:26:37.891 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:26:37.886+0000 1694c700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.687904+0000 front 2019-11-29T03:25:34.225846+0000 (oldest deadline 2019-11-29T03:26:19.522883+0000) 2019-11-29T03:26:37.948 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:26:37.944+0000 1694c700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.766541+0000 front 2019-11-29T03:25:33.750734+0000 (oldest deadline 2019-11-29T03:26:17.814226+0000) 2019-11-29T03:26:37.969 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:26:37.964+0000 1694c700 -1 osd.5 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.939959+0000 front 2019-11-29T03:25:30.948154+0000 (oldest deadline 2019-11-29T03:26:15.307180+0000) 2019-11-29T03:26:38.148 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:26:38.143+0000 1694c700 -1 osd.1 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.617452+0000 front 2019-11-29T03:25:30.522639+0000 (oldest deadline 2019-11-29T03:26:16.404463+0000) 2019-11-29T03:26:38.160 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:26:38.155+0000 1694c700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.689841+0000 front 2019-11-29T03:25:33.328471+0000 (oldest deadline 2019-11-29T03:26:19.202228+0000) 2019-11-29T03:26:38.379 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:26:38.374+0000 1694c700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.688160+0000 front 2019-11-29T03:25:33.503540+0000 (oldest deadline 2019-11-29T03:26:16.172591+0000) 2019-11-29T03:26:38.619 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:26:38.613+0000 1694c700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:34.225209+0000 front 2019-11-29T03:25:33.600261+0000 (oldest deadline 2019-11-29T03:26:18.868663+0000) 2019-11-29T03:26:38.863 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:26:38.858+0000 1694c700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.687904+0000 front 2019-11-29T03:25:34.225846+0000 (oldest deadline 2019-11-29T03:26:19.522883+0000) 2019-11-29T03:26:38.940 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:26:38.936+0000 1694c700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.766541+0000 front 2019-11-29T03:25:33.750734+0000 (oldest deadline 2019-11-29T03:26:17.814226+0000) 2019-11-29T03:26:38.973 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:26:38.968+0000 1694c700 -1 osd.5 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.939959+0000 front 2019-11-29T03:25:30.948154+0000 (oldest deadline 2019-11-29T03:26:15.307180+0000) 2019-11-29T03:26:39.139 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:26:39.135+0000 1694c700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.689841+0000 front 2019-11-29T03:25:33.328471+0000 (oldest deadline 2019-11-29T03:26:19.202228+0000) 2019-11-29T03:26:39.142 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:26:39.138+0000 1694c700 -1 osd.1 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.617452+0000 front 2019-11-29T03:25:30.522639+0000 (oldest deadline 2019-11-29T03:26:16.404463+0000) 2019-11-29T03:26:39.381 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:26:39.375+0000 1694c700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.688160+0000 front 2019-11-29T03:25:33.503540+0000 (oldest deadline 2019-11-29T03:26:16.172591+0000) 2019-11-29T03:26:39.613 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:26:39.608+0000 1694c700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:34.225209+0000 front 2019-11-29T03:25:33.600261+0000 (oldest deadline 2019-11-29T03:26:18.868663+0000) 2019-11-29T03:26:39.866 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:26:39.860+0000 1694c700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.687904+0000 front 2019-11-29T03:25:34.225846+0000 (oldest deadline 2019-11-29T03:26:19.522883+0000) 2019-11-29T03:26:39.978 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:26:39.974+0000 1694c700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.766541+0000 front 2019-11-29T03:25:33.750734+0000 (oldest deadline 2019-11-29T03:26:17.814226+0000) 2019-11-29T03:26:39.999 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:26:39.993+0000 1694c700 -1 osd.5 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.939959+0000 front 2019-11-29T03:25:30.948154+0000 (oldest deadline 2019-11-29T03:26:15.307180+0000) 2019-11-29T03:26:40.127 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:26:40.124+0000 1694c700 -1 osd.1 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.617452+0000 front 2019-11-29T03:25:30.522639+0000 (oldest deadline 2019-11-29T03:26:16.404463+0000) 2019-11-29T03:26:40.147 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:26:40.144+0000 1694c700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.689841+0000 front 2019-11-29T03:25:33.328471+0000 (oldest deadline 2019-11-29T03:26:19.202228+0000) 2019-11-29T03:26:40.390 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:26:40.385+0000 1694c700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.688160+0000 front 2019-11-29T03:25:33.503540+0000 (oldest deadline 2019-11-29T03:26:16.172591+0000) 2019-11-29T03:26:40.586 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:26:40.580+0000 1694c700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:34.225209+0000 front 2019-11-29T03:25:33.600261+0000 (oldest deadline 2019-11-29T03:26:18.868663+0000) 2019-11-29T03:26:40.899 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:26:40.894+0000 1694c700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.687904+0000 front 2019-11-29T03:25:34.225846+0000 (oldest deadline 2019-11-29T03:26:19.522883+0000) 2019-11-29T03:26:40.951 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:26:40.947+0000 1694c700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.766541+0000 front 2019-11-29T03:25:33.750734+0000 (oldest deadline 2019-11-29T03:26:17.814226+0000) 2019-11-29T03:26:40.954 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:26:40.949+0000 1694c700 -1 osd.5 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.939959+0000 front 2019-11-29T03:25:30.948154+0000 (oldest deadline 2019-11-29T03:26:15.307180+0000) 2019-11-29T03:26:41.137 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:26:41.134+0000 1694c700 -1 osd.1 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.617452+0000 front 2019-11-29T03:25:30.522639+0000 (oldest deadline 2019-11-29T03:26:16.404463+0000) 2019-11-29T03:26:41.147 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:26:41.143+0000 1694c700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.689841+0000 front 2019-11-29T03:25:33.328471+0000 (oldest deadline 2019-11-29T03:26:19.202228+0000) 2019-11-29T03:26:41.390 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:26:41.384+0000 1694c700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.688160+0000 front 2019-11-29T03:25:33.503540+0000 (oldest deadline 2019-11-29T03:26:16.172591+0000) 2019-11-29T03:26:41.617 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:26:41.610+0000 1694c700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:34.225209+0000 front 2019-11-29T03:25:33.600261+0000 (oldest deadline 2019-11-29T03:26:18.868663+0000) 2019-11-29T03:26:41.920 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:26:41.916+0000 1694c700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.766541+0000 front 2019-11-29T03:25:33.750734+0000 (oldest deadline 2019-11-29T03:26:17.814226+0000) 2019-11-29T03:26:41.923 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:26:41.918+0000 1694c700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.687904+0000 front 2019-11-29T03:25:34.225846+0000 (oldest deadline 2019-11-29T03:26:19.522883+0000) 2019-11-29T03:26:41.951 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:26:41.945+0000 1694c700 -1 osd.5 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.939959+0000 front 2019-11-29T03:25:30.948154+0000 (oldest deadline 2019-11-29T03:26:15.307180+0000) 2019-11-29T03:26:42.125 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:26:42.121+0000 1694c700 -1 osd.1 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.617452+0000 front 2019-11-29T03:25:30.522639+0000 (oldest deadline 2019-11-29T03:26:16.404463+0000) 2019-11-29T03:26:42.183 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:26:42.179+0000 1694c700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.689841+0000 front 2019-11-29T03:25:33.328471+0000 (oldest deadline 2019-11-29T03:26:19.202228+0000) 2019-11-29T03:26:42.401 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:26:42.395+0000 1694c700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.688160+0000 front 2019-11-29T03:25:33.503540+0000 (oldest deadline 2019-11-29T03:26:16.172591+0000) 2019-11-29T03:26:42.616 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:26:42.610+0000 1694c700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:34.225209+0000 front 2019-11-29T03:25:33.600261+0000 (oldest deadline 2019-11-29T03:26:18.868663+0000) 2019-11-29T03:26:42.928 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:26:42.924+0000 1694c700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.766541+0000 front 2019-11-29T03:25:33.750734+0000 (oldest deadline 2019-11-29T03:26:17.814226+0000) 2019-11-29T03:26:42.943 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:26:42.937+0000 1694c700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.687904+0000 front 2019-11-29T03:25:34.225846+0000 (oldest deadline 2019-11-29T03:26:19.522883+0000) 2019-11-29T03:26:42.950 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:26:42.944+0000 1694c700 -1 osd.5 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.939959+0000 front 2019-11-29T03:25:30.948154+0000 (oldest deadline 2019-11-29T03:26:15.307180+0000) 2019-11-29T03:26:43.139 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:26:43.136+0000 1694c700 -1 osd.1 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.617452+0000 front 2019-11-29T03:25:30.522639+0000 (oldest deadline 2019-11-29T03:26:16.404463+0000) 2019-11-29T03:26:43.234 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:26:43.230+0000 1694c700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.689841+0000 front 2019-11-29T03:25:33.328471+0000 (oldest deadline 2019-11-29T03:26:19.202228+0000) 2019-11-29T03:26:43.437 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:26:43.431+0000 1694c700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.688160+0000 front 2019-11-29T03:25:33.503540+0000 (oldest deadline 2019-11-29T03:26:16.172591+0000) 2019-11-29T03:26:43.616 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:26:43.610+0000 1694c700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:34.225209+0000 front 2019-11-29T03:25:33.600261+0000 (oldest deadline 2019-11-29T03:26:18.868663+0000) 2019-11-29T03:26:43.905 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:26:43.899+0000 1694c700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.687904+0000 front 2019-11-29T03:25:34.225846+0000 (oldest deadline 2019-11-29T03:26:19.522883+0000) 2019-11-29T03:26:43.906 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:26:43.901+0000 1694c700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.766541+0000 front 2019-11-29T03:25:33.750734+0000 (oldest deadline 2019-11-29T03:26:17.814226+0000) 2019-11-29T03:26:43.985 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:26:43.979+0000 1694c700 -1 osd.5 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.939959+0000 front 2019-11-29T03:25:30.948154+0000 (oldest deadline 2019-11-29T03:26:15.307180+0000) 2019-11-29T03:26:44.134 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:26:44.131+0000 1694c700 -1 osd.1 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.617452+0000 front 2019-11-29T03:25:30.522639+0000 (oldest deadline 2019-11-29T03:26:16.404463+0000) 2019-11-29T03:26:44.264 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:26:44.259+0000 1694c700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.689841+0000 front 2019-11-29T03:25:33.328471+0000 (oldest deadline 2019-11-29T03:26:19.202228+0000) 2019-11-29T03:26:44.394 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:26:44.389+0000 1694c700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.688160+0000 front 2019-11-29T03:25:33.503540+0000 (oldest deadline 2019-11-29T03:26:16.172591+0000) 2019-11-29T03:26:44.576 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:26:44.570+0000 1694c700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:34.225209+0000 front 2019-11-29T03:25:33.600261+0000 (oldest deadline 2019-11-29T03:26:18.868663+0000) 2019-11-29T03:26:44.866 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:26:44.861+0000 1694c700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.687904+0000 front 2019-11-29T03:25:34.225846+0000 (oldest deadline 2019-11-29T03:26:19.522883+0000) 2019-11-29T03:26:44.910 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:26:44.906+0000 1694c700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.766541+0000 front 2019-11-29T03:25:33.750734+0000 (oldest deadline 2019-11-29T03:26:17.814226+0000) 2019-11-29T03:26:45.018 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:26:45.013+0000 1694c700 -1 osd.5 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.939959+0000 front 2019-11-29T03:25:30.948154+0000 (oldest deadline 2019-11-29T03:26:15.307180+0000) 2019-11-29T03:26:45.167 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:26:45.163+0000 1694c700 -1 osd.1 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.617452+0000 front 2019-11-29T03:25:30.522639+0000 (oldest deadline 2019-11-29T03:26:16.404463+0000) 2019-11-29T03:26:45.319 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:26:45.314+0000 1694c700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.689841+0000 front 2019-11-29T03:25:33.328471+0000 (oldest deadline 2019-11-29T03:26:19.202228+0000) 2019-11-29T03:26:45.380 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:26:45.374+0000 1694c700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.688160+0000 front 2019-11-29T03:25:33.503540+0000 (oldest deadline 2019-11-29T03:26:16.172591+0000) 2019-11-29T03:26:45.553 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:26:45.547+0000 1694c700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:34.225209+0000 front 2019-11-29T03:25:33.600261+0000 (oldest deadline 2019-11-29T03:26:18.868663+0000) 2019-11-29T03:26:45.884 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:26:45.880+0000 1694c700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.766541+0000 front 2019-11-29T03:25:33.750734+0000 (oldest deadline 2019-11-29T03:26:17.814226+0000) 2019-11-29T03:26:45.903 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:26:45.897+0000 1694c700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.687904+0000 front 2019-11-29T03:25:34.225846+0000 (oldest deadline 2019-11-29T03:26:19.522883+0000) 2019-11-29T03:26:46.023 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:26:46.011+0000 1694c700 -1 osd.5 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.939959+0000 front 2019-11-29T03:25:30.948154+0000 (oldest deadline 2019-11-29T03:26:15.307180+0000) 2019-11-29T03:26:46.138 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:26:46.134+0000 1694c700 -1 osd.1 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.617452+0000 front 2019-11-29T03:25:30.522639+0000 (oldest deadline 2019-11-29T03:26:16.404463+0000) 2019-11-29T03:26:46.315 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:26:46.312+0000 1694c700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.689841+0000 front 2019-11-29T03:25:33.328471+0000 (oldest deadline 2019-11-29T03:26:19.202228+0000) 2019-11-29T03:26:46.392 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:26:46.386+0000 1694c700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.688160+0000 front 2019-11-29T03:25:33.503540+0000 (oldest deadline 2019-11-29T03:26:16.172591+0000) 2019-11-29T03:26:46.538 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:26:46.533+0000 1694c700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:34.225209+0000 front 2019-11-29T03:25:33.600261+0000 (oldest deadline 2019-11-29T03:26:18.868663+0000) 2019-11-29T03:26:46.920 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:26:46.915+0000 1694c700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.766541+0000 front 2019-11-29T03:25:33.750734+0000 (oldest deadline 2019-11-29T03:26:17.814226+0000) 2019-11-29T03:26:46.923 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:26:46.917+0000 1694c700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.687904+0000 front 2019-11-29T03:25:34.225846+0000 (oldest deadline 2019-11-29T03:26:19.522883+0000) 2019-11-29T03:26:47.049 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:26:47.044+0000 1694c700 -1 osd.5 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.939959+0000 front 2019-11-29T03:25:30.948154+0000 (oldest deadline 2019-11-29T03:26:15.307180+0000) 2019-11-29T03:26:47.138 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:26:47.135+0000 1694c700 -1 osd.1 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.617452+0000 front 2019-11-29T03:25:30.522639+0000 (oldest deadline 2019-11-29T03:26:16.404463+0000) 2019-11-29T03:26:47.278 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:26:47.273+0000 1694c700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.689841+0000 front 2019-11-29T03:25:33.328471+0000 (oldest deadline 2019-11-29T03:26:19.202228+0000) 2019-11-29T03:26:47.347 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:26:47.341+0000 1694c700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.688160+0000 front 2019-11-29T03:25:33.503540+0000 (oldest deadline 2019-11-29T03:26:16.172591+0000) 2019-11-29T03:26:47.514 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:26:47.508+0000 1694c700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:34.225209+0000 front 2019-11-29T03:25:33.600261+0000 (oldest deadline 2019-11-29T03:26:18.868663+0000) 2019-11-29T03:26:47.963 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:26:47.959+0000 1694c700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.766541+0000 front 2019-11-29T03:25:33.750734+0000 (oldest deadline 2019-11-29T03:26:17.814226+0000) 2019-11-29T03:26:47.969 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:26:47.964+0000 1694c700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.687904+0000 front 2019-11-29T03:25:34.225846+0000 (oldest deadline 2019-11-29T03:26:19.522883+0000) 2019-11-29T03:26:48.007 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:26:48.001+0000 1694c700 -1 osd.5 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.939959+0000 front 2019-11-29T03:25:30.948154+0000 (oldest deadline 2019-11-29T03:26:15.307180+0000) 2019-11-29T03:26:48.143 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:26:48.139+0000 1694c700 -1 osd.1 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.617452+0000 front 2019-11-29T03:25:30.522639+0000 (oldest deadline 2019-11-29T03:26:16.404463+0000) 2019-11-29T03:26:48.281 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:26:48.278+0000 1694c700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.689841+0000 front 2019-11-29T03:25:33.328471+0000 (oldest deadline 2019-11-29T03:26:19.202228+0000) 2019-11-29T03:26:48.342 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:26:48.334+0000 1694c700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.688160+0000 front 2019-11-29T03:25:33.503540+0000 (oldest deadline 2019-11-29T03:26:16.172591+0000) 2019-11-29T03:26:48.534 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:26:48.528+0000 1694c700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:34.225209+0000 front 2019-11-29T03:25:33.600261+0000 (oldest deadline 2019-11-29T03:26:18.868663+0000) 2019-11-29T03:26:48.924 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:26:48.921+0000 1694c700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.766541+0000 front 2019-11-29T03:25:33.750734+0000 (oldest deadline 2019-11-29T03:26:17.814226+0000) 2019-11-29T03:26:48.958 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:26:48.951+0000 1694c700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.687904+0000 front 2019-11-29T03:25:34.225846+0000 (oldest deadline 2019-11-29T03:26:19.522883+0000) 2019-11-29T03:26:48.988 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:26:48.983+0000 1694c700 -1 osd.5 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.939959+0000 front 2019-11-29T03:25:30.948154+0000 (oldest deadline 2019-11-29T03:26:15.307180+0000) 2019-11-29T03:26:49.097 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:26:49.093+0000 1694c700 -1 osd.1 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.617452+0000 front 2019-11-29T03:25:30.522639+0000 (oldest deadline 2019-11-29T03:26:16.404463+0000) 2019-11-29T03:26:49.273 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:26:49.269+0000 1694c700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.689841+0000 front 2019-11-29T03:25:33.328471+0000 (oldest deadline 2019-11-29T03:26:19.202228+0000) 2019-11-29T03:26:49.358 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:26:49.352+0000 1694c700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.688160+0000 front 2019-11-29T03:25:33.503540+0000 (oldest deadline 2019-11-29T03:26:16.172591+0000) 2019-11-29T03:26:49.551 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:26:49.545+0000 1694c700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:34.225209+0000 front 2019-11-29T03:25:33.600261+0000 (oldest deadline 2019-11-29T03:26:18.868663+0000) 2019-11-29T03:26:49.926 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:26:49.922+0000 1694c700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.766541+0000 front 2019-11-29T03:25:33.750734+0000 (oldest deadline 2019-11-29T03:26:17.814226+0000) 2019-11-29T03:26:49.956 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:26:49.947+0000 1694c700 -1 osd.5 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.939959+0000 front 2019-11-29T03:25:30.948154+0000 (oldest deadline 2019-11-29T03:26:15.307180+0000) 2019-11-29T03:26:49.960 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:26:49.955+0000 1694c700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.687904+0000 front 2019-11-29T03:25:34.225846+0000 (oldest deadline 2019-11-29T03:26:19.522883+0000) 2019-11-29T03:26:50.127 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:26:50.123+0000 1694c700 -1 osd.1 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.617452+0000 front 2019-11-29T03:25:30.522639+0000 (oldest deadline 2019-11-29T03:26:16.404463+0000) 2019-11-29T03:26:50.285 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:26:50.281+0000 1694c700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.689841+0000 front 2019-11-29T03:25:33.328471+0000 (oldest deadline 2019-11-29T03:26:19.202228+0000) 2019-11-29T03:26:50.352 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:26:50.346+0000 1694c700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.688160+0000 front 2019-11-29T03:25:33.503540+0000 (oldest deadline 2019-11-29T03:26:16.172591+0000) 2019-11-29T03:26:50.564 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:26:50.557+0000 1694c700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:34.225209+0000 front 2019-11-29T03:25:33.600261+0000 (oldest deadline 2019-11-29T03:26:18.868663+0000) 2019-11-29T03:26:50.923 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:26:50.916+0000 1694c700 -1 osd.5 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.939959+0000 front 2019-11-29T03:25:30.948154+0000 (oldest deadline 2019-11-29T03:26:15.307180+0000) 2019-11-29T03:26:50.947 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:26:50.944+0000 1694c700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.766541+0000 front 2019-11-29T03:25:33.750734+0000 (oldest deadline 2019-11-29T03:26:17.814226+0000) 2019-11-29T03:26:50.990 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:26:50.986+0000 1694c700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.687904+0000 front 2019-11-29T03:25:34.225846+0000 (oldest deadline 2019-11-29T03:26:19.522883+0000) 2019-11-29T03:26:51.126 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:26:51.123+0000 1694c700 -1 osd.1 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.617452+0000 front 2019-11-29T03:25:30.522639+0000 (oldest deadline 2019-11-29T03:26:16.404463+0000) 2019-11-29T03:26:51.321 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:26:51.316+0000 1694c700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.689841+0000 front 2019-11-29T03:25:33.328471+0000 (oldest deadline 2019-11-29T03:26:19.202228+0000) 2019-11-29T03:26:51.400 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:26:51.394+0000 1694c700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.688160+0000 front 2019-11-29T03:25:33.503540+0000 (oldest deadline 2019-11-29T03:26:16.172591+0000) 2019-11-29T03:26:51.577 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:26:51.571+0000 1694c700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:34.225209+0000 front 2019-11-29T03:25:33.600261+0000 (oldest deadline 2019-11-29T03:26:18.868663+0000) 2019-11-29T03:26:51.881 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:26:51.876+0000 1694c700 -1 osd.5 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:30.939959+0000 front 2019-11-29T03:25:30.948154+0000 (oldest deadline 2019-11-29T03:26:15.307180+0000) 2019-11-29T03:26:51.974 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:26:51.971+0000 1694c700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.766541+0000 front 2019-11-29T03:25:33.750734+0000 (oldest deadline 2019-11-29T03:26:17.814226+0000) 2019-11-29T03:26:51.979 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:26:51.973+0000 1694c700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:25:33.687904+0000 front 2019-11-29T03:25:34.225846+0000 (oldest deadline 2019-11-29T03:26:19.522883+0000) 2019-11-29T03:26:52.032 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:26:52.026+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.74:6802/10096,v1:172.21.15.74:6803/10096] for 44sec e253 v253) 2019-11-29T03:27:17.873 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:27:17.688+0000 2184f700 -1 reset not still connected to 0x100b0300 2019-11-29T03:27:24.374 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:27:24.354+0000 35f8c700 -1 osd.3 258 build_incremental_map_msg missing incremental map 258 2019-11-29T03:27:24.589 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:27:24.563+0000 3678d700 -1 osd.3 258 build_incremental_map_msg missing incremental map 258 2019-11-29T03:27:24.621 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:27:24.587+0000 31f84700 -1 osd.3 258 build_incremental_map_msg missing incremental map 258 2019-11-29T03:27:24.642 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:27:24.619+0000 32785700 -1 osd.3 258 build_incremental_map_msg missing incremental map 258 2019-11-29T03:27:25.712 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:27:25.687+0000 37f90700 -1 osd.3 259 build_incremental_map_msg missing incremental map 258 2019-11-29T03:27:35.454 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:41:17.672 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:27:35.459 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:41:17.677 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:27:35.469 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:41:17.689 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:27:35.472 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:41:17.701 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:27:35.475 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:41:17.695 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:27:35.479 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:41:17.707 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:27:35.693 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:41:17.912 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:27:35.703 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:41:17.932 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:27:35.808 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:41:18.026 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:27:48.653 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:27:48.648+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:27:49.621 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:27:49.615+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:27:49.902 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:27:49.897+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:27:50.273 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:27:50.271+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:27:50.409 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:27:50.405+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:27:50.628 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:27:50.623+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:27:50.945 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:27:50.939+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:27:51.046 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:27:51.044+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:27:51.227 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:27:51.225+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:27:51.403 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:27:51.400+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:27:51.586 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:27:51.581+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:27:51.923 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:27:51.917+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:27:52.073 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:27:52.071+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:27:52.270 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:27:52.267+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:27:52.419 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:27:52.417+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:27:52.594 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:27:52.588+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:27:52.941 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:27:52.936+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:27:53.050 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:27:53.045+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:27:53.100 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:27:53.096+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:27:53.229 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:27:53.226+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:27:53.467 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:27:53.465+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:27:53.562 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:27:53.557+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:27:53.936 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:27:53.930+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:27:54.066 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:27:54.060+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:27:54.117 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:27:54.113+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:27:54.202 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:27:54.199+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:27:54.439 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:27:54.436+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:27:54.538 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:27:54.533+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:27:54.972 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:27:54.966+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:27:55.045 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:27:55.039+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:27:55.142 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:27:55.140+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:27:55.211 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:27:55.207+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:27:55.403 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:27:55.400+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:27:55.538 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:27:55.531+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:27:55.699 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:27:55.696+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:27:55.929 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:27:55.925+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:27:56.023 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:27:56.018+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:27:56.156 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:27:56.151+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:27:56.263 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:27:56.258+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:27:56.427 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:27:56.422+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:27:56.505 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:27:56.499+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:27:56.672 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:27:56.668+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:27:56.966 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:27:56.962+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:27:57.031 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:27:57.027+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:27:57.179 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:27:57.174+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:27:57.304 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:27:57.300+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:27:57.406 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:27:57.403+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:27:57.530 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:27:57.525+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:27:57.714 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:27:57.711+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:27:57.997 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:27:57.992+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:27:58.018 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:27:58.014+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:27:58.170 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:27:58.165+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:27:58.308 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:27:58.304+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:27:58.376 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:27:58.372+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:27:58.560 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:27:58.555+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:27:58.753 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:27:58.750+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:27:58.985 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:27:58.979+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:27:59.059 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:27:59.054+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:27:59.166 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:27:59.163+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:27:59.326 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:27:59.322+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:27:59.421 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:27:59.417+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:27:59.566 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:27:59.560+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:27:59.707 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:27:59.703+0000 1694c700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:27:18.944443+0000 (oldest deadline 2019-11-29T03:27:58.944443+0000) 2019-11-29T03:27:59.708 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:27:59.704+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:27:59.985 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:27:59.978+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:28:00.042 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:28:00.037+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:28:00.186 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:28:00.182+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:28:00.376 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:28:00.373+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:28:00.425 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:28:00.421+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:28:00.568 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:28:00.563+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:28:00.712 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:00.707+0000 1694c700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:27:18.944443+0000 (oldest deadline 2019-11-29T03:27:58.944443+0000) 2019-11-29T03:28:00.713 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:00.709+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:28:01.011 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:28:01.006+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:28:01.017 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:28:01.012+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:28:01.218 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:28:01.214+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:28:01.409 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:28:01.405+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:28:01.460 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:28:01.456+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:28:01.545 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:28:01.540+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:28:01.675 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:01.670+0000 1694c700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:27:18.944443+0000 (oldest deadline 2019-11-29T03:27:58.944443+0000) 2019-11-29T03:28:01.676 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:01.673+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:28:01.977 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:28:01.973+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:28:02.008 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:28:02.003+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:28:02.179 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:28:02.175+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:28:02.402 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:28:02.398+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:28:02.443 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:28:02.438+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:28:02.584 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:28:02.576+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:28:02.729 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:02.724+0000 1694c700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:27:18.944443+0000 (oldest deadline 2019-11-29T03:27:58.944443+0000) 2019-11-29T03:28:02.730 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:02.727+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:28:02.983 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:28:02.977+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:28:03.054 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:28:03.048+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:28:03.134 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:28:03.131+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:28:03.368 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:28:03.364+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:28:03.452 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:28:03.449+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:28:03.589 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:28:03.585+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:28:03.687 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:03.682+0000 1694c700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:27:18.944443+0000 (oldest deadline 2019-11-29T03:27:58.944443+0000) 2019-11-29T03:28:03.688 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:03.684+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:28:03.980 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:28:03.975+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:28:04.034 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:28:04.029+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:28:04.135 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:28:04.131+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:28:04.329 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:28:04.325+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:28:04.446 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:28:04.443+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:28:04.627 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:28:04.621+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:28:04.709 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:04.705+0000 1694c700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:27:18.944443+0000 (oldest deadline 2019-11-29T03:27:58.944443+0000) 2019-11-29T03:28:04.713 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:04.710+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:28:05.015 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:28:05.010+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:28:05.020 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:28:05.015+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:28:05.095 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:28:05.091+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:28:05.376 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:28:05.372+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:28:05.469 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:28:05.466+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:28:05.660 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:28:05.653+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:28:05.751 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:05.747+0000 1694c700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:27:18.944443+0000 (oldest deadline 2019-11-29T03:27:58.944443+0000) 2019-11-29T03:28:05.752 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:05.748+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:28:05.988 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:28:05.983+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:28:06.013 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:28:06.008+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:28:06.114 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:28:06.110+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:28:06.394 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:28:06.389+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:28:06.454 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:28:06.450+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:28:06.633 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:28:06.627+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:28:06.714 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:06.709+0000 1694c700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:27:18.944443+0000 (oldest deadline 2019-11-29T03:27:58.944443+0000) 2019-11-29T03:28:06.715 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:06.711+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:28:06.968 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:28:06.962+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:28:06.979 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:28:06.972+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:28:07.125 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:28:07.123+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:28:07.396 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:28:07.388+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:28:07.410 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:28:07.407+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:28:07.671 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:28:07.665+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:28:07.765 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:07.762+0000 1694c700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:27:18.944443+0000 (oldest deadline 2019-11-29T03:27:58.944443+0000) 2019-11-29T03:28:07.768 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:07.765+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:28:07.973 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:28:07.967+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:28:07.988 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:28:07.982+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:28:08.170 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:28:08.166+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:28:08.372 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:28:08.368+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:28:08.445 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:28:08.441+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:28:08.644 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:28:08.638+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:28:08.759 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:08.754+0000 1694c700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:27:18.944443+0000 (oldest deadline 2019-11-29T03:27:58.944443+0000) 2019-11-29T03:28:08.760 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:08.756+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:28:09.010 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:28:08.992+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:28:09.038 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:28:09.032+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:28:09.158 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:28:09.150+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:28:09.366 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:28:09.360+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:28:09.413 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:28:09.409+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:28:09.638 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:28:09.631+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:28:09.770 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:09.765+0000 1694c700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:27:18.944443+0000 (oldest deadline 2019-11-29T03:27:58.944443+0000) 2019-11-29T03:28:09.770 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:09.767+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:28:09.999 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:28:09.992+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:28:10.019 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:28:10.014+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:28:10.118 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:28:10.114+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:28:10.392 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:28:10.388+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:28:10.462 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:28:10.458+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:28:10.688 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:28:10.682+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:28:10.731 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:10.727+0000 1694c700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:27:18.944443+0000 (oldest deadline 2019-11-29T03:27:58.944443+0000) 2019-11-29T03:28:10.732 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:10.728+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:28:10.978 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:28:10.973+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:28:11.047 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:28:11.042+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:28:11.134 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:28:11.132+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:28:11.435 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:28:11.432+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:28:11.489 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:28:11.485+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:28:11.736 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:28:11.731+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:28:11.780 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:11.776+0000 1694c700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:27:18.944443+0000 (oldest deadline 2019-11-29T03:27:58.944443+0000) 2019-11-29T03:28:11.780 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:11.777+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:28:11.971 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:28:11.966+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:28:12.036 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:28:12.031+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:28:12.152 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:28:12.148+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:28:12.464 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:28:12.461+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:28:12.498 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:28:12.495+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:28:12.713 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:28:12.709+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:28:12.745 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:12.740+0000 1694c700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:27:18.944443+0000 (oldest deadline 2019-11-29T03:27:58.944443+0000) 2019-11-29T03:28:12.745 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:12.742+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:28:12.966 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:28:12.959+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:28:13.073 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:28:13.068+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:28:13.105 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:28:13.102+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:28:13.510 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:28:13.507+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:28:13.518 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:28:13.515+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:28:13.724 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:13.720+0000 1694c700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:27:18.944443+0000 (oldest deadline 2019-11-29T03:27:58.944443+0000) 2019-11-29T03:28:13.725 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:13.721+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:28:13.760 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:28:13.755+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:28:13.964 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:28:13.959+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:28:14.065 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:28:14.060+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:28:14.140 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:28:14.136+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:28:14.493 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:28:14.488+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:28:14.524 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:28:14.520+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:28:14.690 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:14.685+0000 1694c700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:27:18.944443+0000 (oldest deadline 2019-11-29T03:27:58.944443+0000) 2019-11-29T03:28:14.691 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:14.688+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:28:14.761 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:28:14.752+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:28:14.979 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:28:14.975+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:28:15.074 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:28:15.069+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:28:15.174 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:28:15.170+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:28:15.507 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:28:15.504+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:28:15.512 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:28:15.509+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:28:15.737 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:15.733+0000 1694c700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:27:18.944443+0000 (oldest deadline 2019-11-29T03:27:58.944443+0000) 2019-11-29T03:28:15.737 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:15.734+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:28:15.762 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:28:15.757+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:28:16.022 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:28:16.017+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:28:16.085 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:28:16.079+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:28:16.136 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:28:16.132+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:28:16.488 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:28:16.484+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:28:16.557 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:28:16.553+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:28:16.788 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:16.784+0000 1694c700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:27:18.944443+0000 (oldest deadline 2019-11-29T03:27:58.944443+0000) 2019-11-29T03:28:16.789 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:16.785+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:28:16.796 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:28:16.793+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:28:17.031 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:28:17.027+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:28:17.048 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:28:17.044+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:28:17.138 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:28:17.134+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:28:17.512 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:28:17.508+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:28:17.602 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:28:17.598+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:28:17.796 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:28:17.791+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:28:17.821 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:17.817+0000 1694c700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:27:18.944443+0000 (oldest deadline 2019-11-29T03:27:58.944443+0000) 2019-11-29T03:28:17.824 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:17.821+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:28:18.001 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:28:17.995+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:28:18.057 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:28:18.052+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:28:18.118 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:28:18.114+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:28:18.492 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:28:18.488+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:28:18.643 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:28:18.639+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:28:18.755 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:28:18.751+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:28:18.821 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:18.817+0000 1694c700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:27:18.944443+0000 (oldest deadline 2019-11-29T03:27:58.944443+0000) 2019-11-29T03:28:18.821 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:18.818+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:28:19.019 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:28:19.014+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:28:19.074 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:28:19.070+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:28:19.123 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:28:19.120+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:28:19.483 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:28:19.478+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:28:19.632 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:28:19.628+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:28:19.748 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:28:19.741+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:28:19.860 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:19.855+0000 1694c700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:27:18.944443+0000 (oldest deadline 2019-11-29T03:27:58.944443+0000) 2019-11-29T03:28:19.861 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:19.857+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:28:20.062 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:28:20.057+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:28:20.076 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:28:20.071+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:28:20.172 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:28:20.167+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:28:20.520 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:28:20.517+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:28:20.594 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:28:20.590+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:28:20.759 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:28:20.754+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:28:20.844 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:20.839+0000 1694c700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:27:18.944443+0000 (oldest deadline 2019-11-29T03:27:58.944443+0000) 2019-11-29T03:28:20.845 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:20.841+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:28:21.103 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:28:21.098+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:28:21.108 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:28:21.103+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:28:21.199 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:28:21.196+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:28:21.569 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:28:21.565+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:28:21.599 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:28:21.595+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:28:21.755 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:28:21.750+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:28:21.799 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:21.795+0000 1694c700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:27:18.944443+0000 (oldest deadline 2019-11-29T03:27:58.944443+0000) 2019-11-29T03:28:21.800 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:21.797+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:28:22.069 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:28:22.063+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:28:22.107 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:28:22.103+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:28:22.203 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:28:22.199+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:28:22.372 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:28:22.365+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 40sec e259 v259) 2019-11-29T03:28:22.576 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:28:22.573+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:28:22.634 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:28:22.630+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:28:22.752 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:22.749+0000 1694c700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:27:18.944443+0000 (oldest deadline 2019-11-29T03:27:58.944443+0000) 2019-11-29T03:28:22.754 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:22.751+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:28:22.786 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:28:22.780+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:28:23.061 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:28:23.056+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:28:23.072 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:28:23.067+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:28:23.215 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:28:23.211+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:28:23.578 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:28:23.573+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:28:23.647 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:28:23.644+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:28:23.730 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:23.725+0000 1694c700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:27:18.944443+0000 (oldest deadline 2019-11-29T03:27:58.944443+0000) 2019-11-29T03:28:23.731 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:23.727+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:28:23.839 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:28:23.833+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:28:24.026 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:28:24.020+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:28:24.057 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:28:24.052+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:28:24.186 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:28:24.181+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:28:24.539 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:28:24.535+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:28:24.700 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:28:24.695+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:28:24.762 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:24.757+0000 1694c700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:27:18.944443+0000 (oldest deadline 2019-11-29T03:27:58.944443+0000) 2019-11-29T03:28:24.763 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:24.759+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:28:24.867 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:28:24.862+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:28:25.019 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:28:25.014+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:28:25.024 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:28:25.019+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:28:25.162 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:28:25.158+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:28:25.577 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:28:25.572+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:28:25.674 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:28:25.671+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:28:25.756 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:25.753+0000 1694c700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:27:18.944443+0000 (oldest deadline 2019-11-29T03:27:58.944443+0000) 2019-11-29T03:28:25.761 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:25.756+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:28:25.887 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:28:25.882+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:28:25.997 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:28:25.992+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:28:26.042 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:28:26.036+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:28:26.167 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:28:26.163+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:28:26.577 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:28:26.574+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:28:26.727 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:28:26.723+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:28:26.736 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:26.733+0000 1694c700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:27:18.944443+0000 (oldest deadline 2019-11-29T03:27:58.944443+0000) 2019-11-29T03:28:26.737 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:26.735+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:28:26.853 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:28:26.847+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:28:27.011 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:28:27.005+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:28:27.060 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:28:27.055+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:28:27.154 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:28:27.151+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:28:27.386 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:28:27.383+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 40sec e259 v259) 2019-11-29T03:28:27.625 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:28:27.623+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:28:27.693 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:27.691+0000 1694c700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:27:18.944443+0000 (oldest deadline 2019-11-29T03:27:58.944443+0000) 2019-11-29T03:28:27.693 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:27.692+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:28:27.711 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:28:27.709+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:28:27.871 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:28:27.867+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:28:28.007 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:28:28.003+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:28:28.038 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:28:28.032+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:28:28.204 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:28:28.202+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:28:28.592 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:28:28.588+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:28:28.694 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:28:28.692+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:28:28.741 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:28.739+0000 1694c700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:27:18.944443+0000 (oldest deadline 2019-11-29T03:27:58.944443+0000) 2019-11-29T03:28:28.745 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:28.742+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:28:28.925 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:28:28.921+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:28:29.027 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:28:29.022+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:28:29.064 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:28:29.059+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:28:29.186 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:28:29.184+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:28:29.631 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:28:29.629+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:28:29.678 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:28:29.646+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:28:29.742 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:29.734+0000 1694c700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:27:18.944443+0000 (oldest deadline 2019-11-29T03:27:58.944443+0000) 2019-11-29T03:28:29.743 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:29.740+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:28:29.881 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:28:29.875+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:28:29.983 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:28:29.978+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:28:30.107 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:28:30.101+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:28:30.192 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:28:30.188+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:28:30.621 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:28:30.618+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:28:30.670 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:28:30.667+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:28:30.739 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:30.737+0000 1694c700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:27:18.944443+0000 (oldest deadline 2019-11-29T03:27:58.944443+0000) 2019-11-29T03:28:30.741 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:30.739+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:28:30.846 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:28:30.841+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:28:31.035 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:28:31.030+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:28:31.147 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:28:31.142+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:28:31.212 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:28:31.209+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:28:31.652 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:28:31.650+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:28:31.708 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:28:31.706+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:28:31.777 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:31.773+0000 1694c700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:27:18.944443+0000 (oldest deadline 2019-11-29T03:27:58.944443+0000) 2019-11-29T03:28:31.778 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:31.775+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:28:31.833 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:28:31.828+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:28:32.043 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:28:32.038+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:28:32.159 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:28:32.154+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:28:32.225 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:28:32.222+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:28:32.403 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:28:32.399+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 40sec e259 v259) 2019-11-29T03:28:32.672 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:28:32.668+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:28:32.735 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:28:32.731+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:28:32.756 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:32.751+0000 1694c700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:27:18.944443+0000 (oldest deadline 2019-11-29T03:27:58.944443+0000) 2019-11-29T03:28:32.757 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:32.754+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:28:32.845 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:28:32.840+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:28:33.096 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:28:33.090+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:28:33.139 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:28:33.134+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:28:33.183 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:28:33.181+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:28:33.647 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:28:33.644+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:28:33.776 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:33.773+0000 1694c700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:27:18.944443+0000 (oldest deadline 2019-11-29T03:27:58.944443+0000) 2019-11-29T03:28:33.778 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:33.776+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:28:33.790 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:28:33.785+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:28:33.835 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:28:33.830+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:28:34.077 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:28:34.071+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:28:34.147 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:28:34.143+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:28:34.157 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:28:34.155+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:28:34.648 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:28:34.645+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:28:34.736 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:34.733+0000 1694c700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:27:18.944443+0000 (oldest deadline 2019-11-29T03:27:58.944443+0000) 2019-11-29T03:28:34.736 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:34.734+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:28:34.807 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:28:34.804+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:28:34.870 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:28:34.857+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:28:35.103 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:28:35.087+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:28:35.188 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:28:35.180+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:28:35.213 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:28:35.204+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:28:35.672 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:28:35.669+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:28:35.703 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:35.700+0000 1694c700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:27:18.944443+0000 (oldest deadline 2019-11-29T03:27:58.944443+0000) 2019-11-29T03:28:35.706 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:35.704+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:28:35.811 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:28:35.807+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:28:35.857 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:28:35.851+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:28:36.059 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:28:36.054+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:28:36.192 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:28:36.189+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:28:36.239 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:28:36.233+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:28:36.701 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:36.692+0000 1694c700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:27:18.944443+0000 (oldest deadline 2019-11-29T03:27:58.944443+0000) 2019-11-29T03:28:36.701 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:36.694+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:28:36.701 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:28:36.696+0000 1694c700 -1 osd.2 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.009264+0000 front 2019-11-29T03:27:08.752967+0000 (oldest deadline 2019-11-29T03:27:50.038588+0000) 2019-11-29T03:28:36.828 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:28:36.826+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:28:36.845 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:28:36.840+0000 1694c700 -1 osd.4 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.754230+0000 front 2019-11-29T03:27:08.751476+0000 (oldest deadline 2019-11-29T03:27:48.051652+0000) 2019-11-29T03:28:37.055 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:28:37.051+0000 1694c700 -1 osd.6 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.689825+0000 front 2019-11-29T03:27:08.486397+0000 (oldest deadline 2019-11-29T03:27:52.505831+0000) 2019-11-29T03:28:37.220 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:28:37.215+0000 1694c700 -1 osd.7 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:07.572664+0000 front 2019-11-29T03:27:07.694830+0000 (oldest deadline 2019-11-29T03:27:49.156466+0000) 2019-11-29T03:28:37.222 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:28:37.220+0000 1694c700 -1 osd.0 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:08.753661+0000 front 2019-11-29T03:27:08.743031+0000 (oldest deadline 2019-11-29T03:27:50.900358+0000) 2019-11-29T03:28:37.467 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:28:37.461+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 40sec e259 v259) 2019-11-29T03:28:37.656 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:37.653+0000 1694c700 -1 osd.3 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:27:18.944443+0000 (oldest deadline 2019-11-29T03:27:58.944443+0000) 2019-11-29T03:28:37.656 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:28:37.654+0000 1694c700 -1 osd.3 259 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107583 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e257) 2019-11-29T03:28:37.846 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:28:37.826+0000 1694c700 -1 osd.1 259 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:27:06.884404+0000 front 2019-11-29T03:27:03.837034+0000 (oldest deadline 2019-11-29T03:27:49.628415+0000) 2019-11-29T03:29:07.207 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:29:07.193+0000 30f82700 -1 osd.5 264 build_incremental_map_msg missing incremental map 264 2019-11-29T03:29:07.380 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:29:07.361+0000 35f8c700 -1 osd.5 264 build_incremental_map_msg missing incremental map 264 2019-11-29T03:29:07.457 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:29:07.393+0000 33787700 -1 osd.5 264 build_incremental_map_msg missing incremental map 264 2019-11-29T03:29:07.764 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:29:07.582+0000 3578b700 -1 osd.5 264 build_incremental_map_msg missing incremental map 264 2019-11-29T03:29:12.860 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:42:55.077 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:29:12.872 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:42:55.090 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:29:12.955 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:42:55.174 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:29:12.958 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:42:55.177 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:29:12.965 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:42:55.193 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:29:12.968 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:42:55.197 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:29:13.070 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:42:55.288 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:29:13.127 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:42:55.347 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:29:13.134 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:42:55.363 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:30:03.171 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:43:45.389 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:30:03.174 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:43:45.392 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:30:03.213 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:43:45.430 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:30:03.213 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:43:45.432 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:30:03.214 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:43:45.442 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:30:03.220 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:43:45.448 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:30:03.239 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:43:45.457 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:30:03.260 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:43:45.477 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:30:03.276 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:43:45.504 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:30:07.099 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:30:07.094+0000 1694c700 -1 osd.5 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:20.768263+0000 front 2019-11-29T03:29:20.780049+0000 (oldest deadline 2019-11-29T03:30:06.625130+0000) 2019-11-29T03:30:08.117 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:30:08.099+0000 1694c700 -1 osd.5 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:20.768263+0000 front 2019-11-29T03:29:20.780049+0000 (oldest deadline 2019-11-29T03:30:06.625130+0000) 2019-11-29T03:30:08.696 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:30:08.691+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.734613+0000 front 2019-11-29T03:29:25.711253+0000 (oldest deadline 2019-11-29T03:30:07.980363+0000) 2019-11-29T03:30:09.101 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:30:09.095+0000 1694c700 -1 osd.5 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:20.768263+0000 front 2019-11-29T03:29:20.780049+0000 (oldest deadline 2019-11-29T03:30:06.625130+0000) 2019-11-29T03:30:09.449 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:30:09.446+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.939133+0000 front 2019-11-29T03:29:26.163044+0000 (oldest deadline 2019-11-29T03:30:08.768381+0000) 2019-11-29T03:30:09.505 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:30:09.502+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.183744+0000 front 2019-11-29T03:29:24.283466+0000 (oldest deadline 2019-11-29T03:30:08.830263+0000) 2019-11-29T03:30:09.729 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:30:09.723+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.734613+0000 front 2019-11-29T03:29:25.711253+0000 (oldest deadline 2019-11-29T03:30:07.980363+0000) 2019-11-29T03:30:10.060 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:30:10.054+0000 1694c700 -1 osd.5 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:20.768263+0000 front 2019-11-29T03:29:20.780049+0000 (oldest deadline 2019-11-29T03:30:06.625130+0000) 2019-11-29T03:30:10.416 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:30:10.413+0000 1694c700 -1 osd.2 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.654365+0000 front 2019-11-29T03:29:25.653556+0000 (oldest deadline 2019-11-29T03:30:10.314583+0000) 2019-11-29T03:30:10.487 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:30:10.484+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.939133+0000 front 2019-11-29T03:29:26.163044+0000 (oldest deadline 2019-11-29T03:30:08.768381+0000) 2019-11-29T03:30:10.527 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:30:10.524+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.183744+0000 front 2019-11-29T03:29:24.283466+0000 (oldest deadline 2019-11-29T03:30:08.830263+0000) 2019-11-29T03:30:10.724 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:30:10.718+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.734613+0000 front 2019-11-29T03:29:25.711253+0000 (oldest deadline 2019-11-29T03:30:07.980363+0000) 2019-11-29T03:30:10.754 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:30:10.748+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.476164+0000 front 2019-11-29T03:29:24.283175+0000 (oldest deadline 2019-11-29T03:30:10.144927+0000) 2019-11-29T03:30:11.052 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:30:11.046+0000 1694c700 -1 osd.5 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:20.768263+0000 front 2019-11-29T03:29:20.780049+0000 (oldest deadline 2019-11-29T03:30:06.625130+0000) 2019-11-29T03:30:11.415 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:30:11.411+0000 1694c700 -1 osd.2 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.654365+0000 front 2019-11-29T03:29:25.653556+0000 (oldest deadline 2019-11-29T03:30:10.314583+0000) 2019-11-29T03:30:11.427 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:30:11.422+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.974270+0000 front 2019-11-29T03:29:24.960738+0000 (oldest deadline 2019-11-29T03:30:10.832921+0000) 2019-11-29T03:30:11.487 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:30:11.483+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.183744+0000 front 2019-11-29T03:29:24.283466+0000 (oldest deadline 2019-11-29T03:30:08.830263+0000) 2019-11-29T03:30:11.495 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:30:11.491+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.939133+0000 front 2019-11-29T03:29:26.163044+0000 (oldest deadline 2019-11-29T03:30:08.768381+0000) 2019-11-29T03:30:11.720 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:30:11.713+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.476164+0000 front 2019-11-29T03:29:24.283175+0000 (oldest deadline 2019-11-29T03:30:10.144927+0000) 2019-11-29T03:30:11.738 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:30:11.733+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.734613+0000 front 2019-11-29T03:29:25.711253+0000 (oldest deadline 2019-11-29T03:30:07.980363+0000) 2019-11-29T03:30:12.086 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:30:12.080+0000 1694c700 -1 osd.5 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:20.768263+0000 front 2019-11-29T03:29:20.780049+0000 (oldest deadline 2019-11-29T03:30:06.625130+0000) 2019-11-29T03:30:12.376 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:30:12.372+0000 1694c700 -1 osd.2 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.654365+0000 front 2019-11-29T03:29:25.653556+0000 (oldest deadline 2019-11-29T03:30:10.314583+0000) 2019-11-29T03:30:12.448 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:30:12.445+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.183744+0000 front 2019-11-29T03:29:24.283466+0000 (oldest deadline 2019-11-29T03:30:08.830263+0000) 2019-11-29T03:30:12.473 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:30:12.466+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.974270+0000 front 2019-11-29T03:29:24.960738+0000 (oldest deadline 2019-11-29T03:30:10.832921+0000) 2019-11-29T03:30:12.480 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:30:12.473+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.939133+0000 front 2019-11-29T03:29:26.163044+0000 (oldest deadline 2019-11-29T03:30:08.768381+0000) 2019-11-29T03:30:12.741 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:30:12.736+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.476164+0000 front 2019-11-29T03:29:24.283175+0000 (oldest deadline 2019-11-29T03:30:10.144927+0000) 2019-11-29T03:30:12.775 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:30:12.769+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.734613+0000 front 2019-11-29T03:29:25.711253+0000 (oldest deadline 2019-11-29T03:30:07.980363+0000) 2019-11-29T03:30:13.055 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:30:13.049+0000 1694c700 -1 osd.5 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:20.768263+0000 front 2019-11-29T03:29:20.780049+0000 (oldest deadline 2019-11-29T03:30:06.625130+0000) 2019-11-29T03:30:13.399 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:30:13.396+0000 1694c700 -1 osd.2 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.654365+0000 front 2019-11-29T03:29:25.653556+0000 (oldest deadline 2019-11-29T03:30:10.314583+0000) 2019-11-29T03:30:13.405 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:30:13.400+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.183744+0000 front 2019-11-29T03:29:24.283466+0000 (oldest deadline 2019-11-29T03:30:08.830263+0000) 2019-11-29T03:30:13.441 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:30:13.435+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.974270+0000 front 2019-11-29T03:29:24.960738+0000 (oldest deadline 2019-11-29T03:30:10.832921+0000) 2019-11-29T03:30:13.523 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:30:13.517+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.939133+0000 front 2019-11-29T03:29:26.163044+0000 (oldest deadline 2019-11-29T03:30:08.768381+0000) 2019-11-29T03:30:13.779 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:30:13.773+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.734613+0000 front 2019-11-29T03:29:25.711253+0000 (oldest deadline 2019-11-29T03:30:07.980363+0000) 2019-11-29T03:30:13.796 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:30:13.790+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.476164+0000 front 2019-11-29T03:29:24.283175+0000 (oldest deadline 2019-11-29T03:30:10.144927+0000) 2019-11-29T03:30:14.053 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:30:14.047+0000 1694c700 -1 osd.5 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:20.768263+0000 front 2019-11-29T03:29:20.780049+0000 (oldest deadline 2019-11-29T03:30:06.625130+0000) 2019-11-29T03:30:14.437 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:30:14.434+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.183744+0000 front 2019-11-29T03:29:24.283466+0000 (oldest deadline 2019-11-29T03:30:08.830263+0000) 2019-11-29T03:30:14.449 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:30:14.446+0000 1694c700 -1 osd.2 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.654365+0000 front 2019-11-29T03:29:25.653556+0000 (oldest deadline 2019-11-29T03:30:10.314583+0000) 2019-11-29T03:30:14.459 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:30:14.454+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.974270+0000 front 2019-11-29T03:29:24.960738+0000 (oldest deadline 2019-11-29T03:30:10.832921+0000) 2019-11-29T03:30:14.499 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:30:14.494+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.939133+0000 front 2019-11-29T03:29:26.163044+0000 (oldest deadline 2019-11-29T03:30:08.768381+0000) 2019-11-29T03:30:14.751 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:30:14.745+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.734613+0000 front 2019-11-29T03:29:25.711253+0000 (oldest deadline 2019-11-29T03:30:07.980363+0000) 2019-11-29T03:30:14.797 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:30:14.791+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.476164+0000 front 2019-11-29T03:29:24.283175+0000 (oldest deadline 2019-11-29T03:30:10.144927+0000) 2019-11-29T03:30:15.020 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:30:15.013+0000 1694c700 -1 osd.5 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:20.768263+0000 front 2019-11-29T03:29:20.780049+0000 (oldest deadline 2019-11-29T03:30:06.625130+0000) 2019-11-29T03:30:15.429 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:30:15.426+0000 1694c700 -1 osd.2 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.654365+0000 front 2019-11-29T03:29:25.653556+0000 (oldest deadline 2019-11-29T03:30:10.314583+0000) 2019-11-29T03:30:15.436 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:30:15.433+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.183744+0000 front 2019-11-29T03:29:24.283466+0000 (oldest deadline 2019-11-29T03:30:08.830263+0000) 2019-11-29T03:30:15.445 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:30:15.440+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.974270+0000 front 2019-11-29T03:29:24.960738+0000 (oldest deadline 2019-11-29T03:30:10.832921+0000) 2019-11-29T03:30:15.478 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:30:15.475+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.939133+0000 front 2019-11-29T03:29:26.163044+0000 (oldest deadline 2019-11-29T03:30:08.768381+0000) 2019-11-29T03:30:15.730 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:30:15.725+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.734613+0000 front 2019-11-29T03:29:25.711253+0000 (oldest deadline 2019-11-29T03:30:07.980363+0000) 2019-11-29T03:30:15.821 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:30:15.815+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.476164+0000 front 2019-11-29T03:29:24.283175+0000 (oldest deadline 2019-11-29T03:30:10.144927+0000) 2019-11-29T03:30:16.066 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:30:16.060+0000 1694c700 -1 osd.5 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:20.768263+0000 front 2019-11-29T03:29:20.780049+0000 (oldest deadline 2019-11-29T03:30:06.625130+0000) 2019-11-29T03:30:16.446 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:30:16.443+0000 1694c700 -1 osd.2 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.654365+0000 front 2019-11-29T03:29:25.653556+0000 (oldest deadline 2019-11-29T03:30:10.314583+0000) 2019-11-29T03:30:16.478 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:30:16.473+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.974270+0000 front 2019-11-29T03:29:24.960738+0000 (oldest deadline 2019-11-29T03:30:10.832921+0000) 2019-11-29T03:30:16.485 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:30:16.481+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.183744+0000 front 2019-11-29T03:29:24.283466+0000 (oldest deadline 2019-11-29T03:30:08.830263+0000) 2019-11-29T03:30:16.528 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:30:16.525+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.939133+0000 front 2019-11-29T03:29:26.163044+0000 (oldest deadline 2019-11-29T03:30:08.768381+0000) 2019-11-29T03:30:16.761 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:30:16.756+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.734613+0000 front 2019-11-29T03:29:25.711253+0000 (oldest deadline 2019-11-29T03:30:07.980363+0000) 2019-11-29T03:30:16.832 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:30:16.825+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.476164+0000 front 2019-11-29T03:29:24.283175+0000 (oldest deadline 2019-11-29T03:30:10.144927+0000) 2019-11-29T03:30:17.064 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:30:17.058+0000 1694c700 -1 osd.5 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:20.768263+0000 front 2019-11-29T03:29:20.780049+0000 (oldest deadline 2019-11-29T03:30:06.625130+0000) 2019-11-29T03:30:17.468 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:30:17.463+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.183744+0000 front 2019-11-29T03:29:24.283466+0000 (oldest deadline 2019-11-29T03:30:08.830263+0000) 2019-11-29T03:30:17.474 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:30:17.469+0000 1694c700 -1 osd.2 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.654365+0000 front 2019-11-29T03:29:25.653556+0000 (oldest deadline 2019-11-29T03:30:10.314583+0000) 2019-11-29T03:30:17.509 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:30:17.503+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.974270+0000 front 2019-11-29T03:29:24.960738+0000 (oldest deadline 2019-11-29T03:30:10.832921+0000) 2019-11-29T03:30:17.569 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:30:17.565+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.939133+0000 front 2019-11-29T03:29:26.163044+0000 (oldest deadline 2019-11-29T03:30:08.768381+0000) 2019-11-29T03:30:17.763 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:30:17.757+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.734613+0000 front 2019-11-29T03:29:25.711253+0000 (oldest deadline 2019-11-29T03:30:07.980363+0000) 2019-11-29T03:30:17.804 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:30:17.798+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.476164+0000 front 2019-11-29T03:29:24.283175+0000 (oldest deadline 2019-11-29T03:30:10.144927+0000) 2019-11-29T03:30:18.057 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:30:18.052+0000 1694c700 -1 osd.5 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:20.768263+0000 front 2019-11-29T03:29:20.780049+0000 (oldest deadline 2019-11-29T03:30:06.625130+0000) 2019-11-29T03:30:18.490 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:30:18.483+0000 1694c700 -1 osd.2 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.654365+0000 front 2019-11-29T03:29:25.653556+0000 (oldest deadline 2019-11-29T03:30:10.314583+0000) 2019-11-29T03:30:18.520 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:30:18.516+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.183744+0000 front 2019-11-29T03:29:24.283466+0000 (oldest deadline 2019-11-29T03:30:08.830263+0000) 2019-11-29T03:30:18.536 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:30:18.531+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.974270+0000 front 2019-11-29T03:29:24.960738+0000 (oldest deadline 2019-11-29T03:30:10.832921+0000) 2019-11-29T03:30:18.568 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:30:18.564+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.939133+0000 front 2019-11-29T03:29:26.163044+0000 (oldest deadline 2019-11-29T03:30:08.768381+0000) 2019-11-29T03:30:18.786 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:30:18.780+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.734613+0000 front 2019-11-29T03:29:25.711253+0000 (oldest deadline 2019-11-29T03:30:07.980363+0000) 2019-11-29T03:30:18.828 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:30:18.822+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.476164+0000 front 2019-11-29T03:29:24.283175+0000 (oldest deadline 2019-11-29T03:30:10.144927+0000) 2019-11-29T03:30:19.029 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:30:19.023+0000 1694c700 -1 osd.5 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:20.768263+0000 front 2019-11-29T03:29:20.780049+0000 (oldest deadline 2019-11-29T03:30:06.625130+0000) 2019-11-29T03:30:19.508 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:30:19.504+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.183744+0000 front 2019-11-29T03:29:24.283466+0000 (oldest deadline 2019-11-29T03:30:08.830263+0000) 2019-11-29T03:30:19.516 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:30:19.511+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.974270+0000 front 2019-11-29T03:29:24.960738+0000 (oldest deadline 2019-11-29T03:30:10.832921+0000) 2019-11-29T03:30:19.517 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:30:19.513+0000 1694c700 -1 osd.2 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.654365+0000 front 2019-11-29T03:29:25.653556+0000 (oldest deadline 2019-11-29T03:30:10.314583+0000) 2019-11-29T03:30:19.581 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:30:19.577+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.939133+0000 front 2019-11-29T03:29:26.163044+0000 (oldest deadline 2019-11-29T03:30:08.768381+0000) 2019-11-29T03:30:19.761 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:30:19.755+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.734613+0000 front 2019-11-29T03:29:25.711253+0000 (oldest deadline 2019-11-29T03:30:07.980363+0000) 2019-11-29T03:30:19.876 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:30:19.869+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.476164+0000 front 2019-11-29T03:29:24.283175+0000 (oldest deadline 2019-11-29T03:30:10.144927+0000) 2019-11-29T03:30:20.074 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:30:20.068+0000 1694c700 -1 osd.5 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:20.768263+0000 front 2019-11-29T03:29:20.780049+0000 (oldest deadline 2019-11-29T03:30:06.625130+0000) 2019-11-29T03:30:20.532 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:30:20.529+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.183744+0000 front 2019-11-29T03:29:24.283466+0000 (oldest deadline 2019-11-29T03:30:08.830263+0000) 2019-11-29T03:30:20.533 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:30:20.527+0000 1694c700 -1 osd.2 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.654365+0000 front 2019-11-29T03:29:25.653556+0000 (oldest deadline 2019-11-29T03:30:10.314583+0000) 2019-11-29T03:30:20.540 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:30:20.534+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.939133+0000 front 2019-11-29T03:29:26.163044+0000 (oldest deadline 2019-11-29T03:30:08.768381+0000) 2019-11-29T03:30:20.562 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:30:20.555+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.974270+0000 front 2019-11-29T03:29:24.960738+0000 (oldest deadline 2019-11-29T03:30:10.832921+0000) 2019-11-29T03:30:20.809 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:30:20.803+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.734613+0000 front 2019-11-29T03:29:25.711253+0000 (oldest deadline 2019-11-29T03:30:07.980363+0000) 2019-11-29T03:30:20.893 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:30:20.887+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.476164+0000 front 2019-11-29T03:29:24.283175+0000 (oldest deadline 2019-11-29T03:30:10.144927+0000) 2019-11-29T03:30:21.093 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:30:21.088+0000 1694c700 -1 osd.5 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:20.768263+0000 front 2019-11-29T03:29:20.780049+0000 (oldest deadline 2019-11-29T03:30:06.625130+0000) 2019-11-29T03:30:21.544 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:30:21.540+0000 1694c700 -1 osd.2 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.654365+0000 front 2019-11-29T03:29:25.653556+0000 (oldest deadline 2019-11-29T03:30:10.314583+0000) 2019-11-29T03:30:21.547 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:30:21.543+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.183744+0000 front 2019-11-29T03:29:24.283466+0000 (oldest deadline 2019-11-29T03:30:08.830263+0000) 2019-11-29T03:30:21.588 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:30:21.585+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.939133+0000 front 2019-11-29T03:29:26.163044+0000 (oldest deadline 2019-11-29T03:30:08.768381+0000) 2019-11-29T03:30:21.611 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:30:21.605+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.974270+0000 front 2019-11-29T03:29:24.960738+0000 (oldest deadline 2019-11-29T03:30:10.832921+0000) 2019-11-29T03:30:21.795 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:30:21.790+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.734613+0000 front 2019-11-29T03:29:25.711253+0000 (oldest deadline 2019-11-29T03:30:07.980363+0000) 2019-11-29T03:30:21.933 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:30:21.927+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.476164+0000 front 2019-11-29T03:29:24.283175+0000 (oldest deadline 2019-11-29T03:30:10.144927+0000) 2019-11-29T03:30:22.068 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:30:22.063+0000 1694c700 -1 osd.5 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:20.768263+0000 front 2019-11-29T03:29:20.780049+0000 (oldest deadline 2019-11-29T03:30:06.625130+0000) 2019-11-29T03:30:22.519 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:30:22.516+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.183744+0000 front 2019-11-29T03:29:24.283466+0000 (oldest deadline 2019-11-29T03:30:08.830263+0000) 2019-11-29T03:30:22.533 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:30:22.530+0000 1694c700 -1 osd.2 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.654365+0000 front 2019-11-29T03:29:25.653556+0000 (oldest deadline 2019-11-29T03:30:10.314583+0000) 2019-11-29T03:30:22.548 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:30:22.545+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.939133+0000 front 2019-11-29T03:29:26.163044+0000 (oldest deadline 2019-11-29T03:30:08.768381+0000) 2019-11-29T03:30:22.616 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:30:22.610+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.974270+0000 front 2019-11-29T03:29:24.960738+0000 (oldest deadline 2019-11-29T03:30:10.832921+0000) 2019-11-29T03:30:22.763 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:30:22.758+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.734613+0000 front 2019-11-29T03:29:25.711253+0000 (oldest deadline 2019-11-29T03:30:07.980363+0000) 2019-11-29T03:30:22.896 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:30:22.890+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.476164+0000 front 2019-11-29T03:29:24.283175+0000 (oldest deadline 2019-11-29T03:30:10.144927+0000) 2019-11-29T03:30:23.086 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:30:23.079+0000 1694c700 -1 osd.5 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:20.768263+0000 front 2019-11-29T03:29:20.780049+0000 (oldest deadline 2019-11-29T03:30:06.625130+0000) 2019-11-29T03:30:23.509 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:30:23.505+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.183744+0000 front 2019-11-29T03:29:24.283466+0000 (oldest deadline 2019-11-29T03:30:08.830263+0000) 2019-11-29T03:30:23.558 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:30:23.555+0000 1694c700 -1 osd.2 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.654365+0000 front 2019-11-29T03:29:25.653556+0000 (oldest deadline 2019-11-29T03:30:10.314583+0000) 2019-11-29T03:30:23.590 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:30:23.584+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.974270+0000 front 2019-11-29T03:29:24.960738+0000 (oldest deadline 2019-11-29T03:30:10.832921+0000) 2019-11-29T03:30:23.600 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:30:23.596+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.939133+0000 front 2019-11-29T03:29:26.163044+0000 (oldest deadline 2019-11-29T03:30:08.768381+0000) 2019-11-29T03:30:23.764 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:30:23.758+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.734613+0000 front 2019-11-29T03:29:25.711253+0000 (oldest deadline 2019-11-29T03:30:07.980363+0000) 2019-11-29T03:30:23.930 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:30:23.925+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.476164+0000 front 2019-11-29T03:29:24.283175+0000 (oldest deadline 2019-11-29T03:30:10.144927+0000) 2019-11-29T03:30:24.135 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:30:24.129+0000 1694c700 -1 osd.5 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:20.768263+0000 front 2019-11-29T03:29:20.780049+0000 (oldest deadline 2019-11-29T03:30:06.625130+0000) 2019-11-29T03:30:24.532 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:30:24.528+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.183744+0000 front 2019-11-29T03:29:24.283466+0000 (oldest deadline 2019-11-29T03:30:08.830263+0000) 2019-11-29T03:30:24.535 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:30:24.532+0000 1694c700 -1 osd.2 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.654365+0000 front 2019-11-29T03:29:25.653556+0000 (oldest deadline 2019-11-29T03:30:10.314583+0000) 2019-11-29T03:30:24.556 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:30:24.551+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.974270+0000 front 2019-11-29T03:29:24.960738+0000 (oldest deadline 2019-11-29T03:30:10.832921+0000) 2019-11-29T03:30:24.631 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:30:24.624+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.939133+0000 front 2019-11-29T03:29:26.163044+0000 (oldest deadline 2019-11-29T03:30:08.768381+0000) 2019-11-29T03:30:24.764 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:30:24.758+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.734613+0000 front 2019-11-29T03:29:25.711253+0000 (oldest deadline 2019-11-29T03:30:07.980363+0000) 2019-11-29T03:30:24.891 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:30:24.885+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.476164+0000 front 2019-11-29T03:29:24.283175+0000 (oldest deadline 2019-11-29T03:30:10.144927+0000) 2019-11-29T03:30:25.111 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:30:25.106+0000 1694c700 -1 osd.5 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:20.768263+0000 front 2019-11-29T03:29:20.780049+0000 (oldest deadline 2019-11-29T03:30:06.625130+0000) 2019-11-29T03:30:25.527 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:30:25.523+0000 1694c700 -1 osd.2 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.654365+0000 front 2019-11-29T03:29:25.653556+0000 (oldest deadline 2019-11-29T03:30:10.314583+0000) 2019-11-29T03:30:25.568 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:30:25.565+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.183744+0000 front 2019-11-29T03:29:24.283466+0000 (oldest deadline 2019-11-29T03:30:08.830263+0000) 2019-11-29T03:30:25.604 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:30:25.598+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.974270+0000 front 2019-11-29T03:29:24.960738+0000 (oldest deadline 2019-11-29T03:30:10.832921+0000) 2019-11-29T03:30:25.657 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:30:25.653+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.939133+0000 front 2019-11-29T03:29:26.163044+0000 (oldest deadline 2019-11-29T03:30:08.768381+0000) 2019-11-29T03:30:25.769 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:30:25.763+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.734613+0000 front 2019-11-29T03:29:25.711253+0000 (oldest deadline 2019-11-29T03:30:07.980363+0000) 2019-11-29T03:30:25.863 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:30:25.857+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.476164+0000 front 2019-11-29T03:29:24.283175+0000 (oldest deadline 2019-11-29T03:30:10.144927+0000) 2019-11-29T03:30:26.103 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:30:26.097+0000 1694c700 -1 osd.5 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:20.768263+0000 front 2019-11-29T03:29:20.780049+0000 (oldest deadline 2019-11-29T03:30:06.625130+0000) 2019-11-29T03:30:26.551 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:30:26.548+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.183744+0000 front 2019-11-29T03:29:24.283466+0000 (oldest deadline 2019-11-29T03:30:08.830263+0000) 2019-11-29T03:30:26.553 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:30:26.549+0000 1694c700 -1 osd.2 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.654365+0000 front 2019-11-29T03:29:25.653556+0000 (oldest deadline 2019-11-29T03:30:10.314583+0000) 2019-11-29T03:30:26.565 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:30:26.556+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.974270+0000 front 2019-11-29T03:29:24.960738+0000 (oldest deadline 2019-11-29T03:30:10.832921+0000) 2019-11-29T03:30:26.620 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:30:26.617+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.939133+0000 front 2019-11-29T03:29:26.163044+0000 (oldest deadline 2019-11-29T03:30:08.768381+0000) 2019-11-29T03:30:26.739 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:30:26.733+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.734613+0000 front 2019-11-29T03:29:25.711253+0000 (oldest deadline 2019-11-29T03:30:07.980363+0000) 2019-11-29T03:30:26.890 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:30:26.885+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.476164+0000 front 2019-11-29T03:29:24.283175+0000 (oldest deadline 2019-11-29T03:30:10.144927+0000) 2019-11-29T03:30:27.109 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:30:27.103+0000 1694c700 -1 osd.5 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:20.768263+0000 front 2019-11-29T03:29:20.780049+0000 (oldest deadline 2019-11-29T03:30:06.625130+0000) 2019-11-29T03:30:27.538 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:30:27.533+0000 1694c700 -1 osd.2 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.654365+0000 front 2019-11-29T03:29:25.653556+0000 (oldest deadline 2019-11-29T03:30:10.314583+0000) 2019-11-29T03:30:27.576 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:30:27.572+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.939133+0000 front 2019-11-29T03:29:26.163044+0000 (oldest deadline 2019-11-29T03:30:08.768381+0000) 2019-11-29T03:30:27.587 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:30:27.581+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.974270+0000 front 2019-11-29T03:29:24.960738+0000 (oldest deadline 2019-11-29T03:30:10.832921+0000) 2019-11-29T03:30:27.590 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:30:27.585+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.183744+0000 front 2019-11-29T03:29:24.283466+0000 (oldest deadline 2019-11-29T03:30:08.830263+0000) 2019-11-29T03:30:27.711 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:30:27.705+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.734613+0000 front 2019-11-29T03:29:25.711253+0000 (oldest deadline 2019-11-29T03:30:07.980363+0000) 2019-11-29T03:30:27.868 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:30:27.862+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.476164+0000 front 2019-11-29T03:29:24.283175+0000 (oldest deadline 2019-11-29T03:30:10.144927+0000) 2019-11-29T03:30:28.073 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:30:28.067+0000 1694c700 -1 osd.5 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:20.768263+0000 front 2019-11-29T03:29:20.780049+0000 (oldest deadline 2019-11-29T03:30:06.625130+0000) 2019-11-29T03:30:28.547 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:30:28.542+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.939133+0000 front 2019-11-29T03:29:26.163044+0000 (oldest deadline 2019-11-29T03:30:08.768381+0000) 2019-11-29T03:30:28.588 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:30:28.584+0000 1694c700 -1 osd.2 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.654365+0000 front 2019-11-29T03:29:25.653556+0000 (oldest deadline 2019-11-29T03:30:10.314583+0000) 2019-11-29T03:30:28.596 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:30:28.588+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.974270+0000 front 2019-11-29T03:29:24.960738+0000 (oldest deadline 2019-11-29T03:30:10.832921+0000) 2019-11-29T03:30:28.623 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:30:28.619+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.183744+0000 front 2019-11-29T03:29:24.283466+0000 (oldest deadline 2019-11-29T03:30:08.830263+0000) 2019-11-29T03:30:28.669 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:30:28.662+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.734613+0000 front 2019-11-29T03:29:25.711253+0000 (oldest deadline 2019-11-29T03:30:07.980363+0000) 2019-11-29T03:30:28.918 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:30:28.911+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.476164+0000 front 2019-11-29T03:29:24.283175+0000 (oldest deadline 2019-11-29T03:30:10.144927+0000) 2019-11-29T03:30:29.099 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:30:29.093+0000 1694c700 -1 osd.5 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:20.768263+0000 front 2019-11-29T03:29:20.780049+0000 (oldest deadline 2019-11-29T03:30:06.625130+0000) 2019-11-29T03:30:29.531 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:30:29.527+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.939133+0000 front 2019-11-29T03:29:26.163044+0000 (oldest deadline 2019-11-29T03:30:08.768381+0000) 2019-11-29T03:30:29.550 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:30:29.544+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.974270+0000 front 2019-11-29T03:29:24.960738+0000 (oldest deadline 2019-11-29T03:30:10.832921+0000) 2019-11-29T03:30:29.606 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:30:29.602+0000 1694c700 -1 osd.2 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.654365+0000 front 2019-11-29T03:29:25.653556+0000 (oldest deadline 2019-11-29T03:30:10.314583+0000) 2019-11-29T03:30:29.619 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:30:29.615+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.183744+0000 front 2019-11-29T03:29:24.283466+0000 (oldest deadline 2019-11-29T03:30:08.830263+0000) 2019-11-29T03:30:29.635 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:30:29.628+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.734613+0000 front 2019-11-29T03:29:25.711253+0000 (oldest deadline 2019-11-29T03:30:07.980363+0000) 2019-11-29T03:30:29.907 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:30:29.900+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.476164+0000 front 2019-11-29T03:29:24.283175+0000 (oldest deadline 2019-11-29T03:30:10.144927+0000) 2019-11-29T03:30:30.123 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:30:30.116+0000 1694c700 -1 osd.5 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:20.768263+0000 front 2019-11-29T03:29:20.780049+0000 (oldest deadline 2019-11-29T03:30:06.625130+0000) 2019-11-29T03:30:30.581 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:30:30.577+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.183744+0000 front 2019-11-29T03:29:24.283466+0000 (oldest deadline 2019-11-29T03:30:08.830263+0000) 2019-11-29T03:30:30.582 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:30:30.577+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.939133+0000 front 2019-11-29T03:29:26.163044+0000 (oldest deadline 2019-11-29T03:30:08.768381+0000) 2019-11-29T03:30:30.594 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:30:30.588+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.974270+0000 front 2019-11-29T03:29:24.960738+0000 (oldest deadline 2019-11-29T03:30:10.832921+0000) 2019-11-29T03:30:30.627 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:30:30.623+0000 1694c700 -1 osd.2 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.654365+0000 front 2019-11-29T03:29:25.653556+0000 (oldest deadline 2019-11-29T03:30:10.314583+0000) 2019-11-29T03:30:30.630 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:30:30.622+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.734613+0000 front 2019-11-29T03:29:25.711253+0000 (oldest deadline 2019-11-29T03:30:07.980363+0000) 2019-11-29T03:30:30.922 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:30:30.916+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.476164+0000 front 2019-11-29T03:29:24.283175+0000 (oldest deadline 2019-11-29T03:30:10.144927+0000) 2019-11-29T03:30:31.171 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:30:31.164+0000 1694c700 -1 osd.5 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:20.768263+0000 front 2019-11-29T03:29:20.780049+0000 (oldest deadline 2019-11-29T03:30:06.625130+0000) 2019-11-29T03:30:31.553 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:30:31.549+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.183744+0000 front 2019-11-29T03:29:24.283466+0000 (oldest deadline 2019-11-29T03:30:08.830263+0000) 2019-11-29T03:30:31.559 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:30:31.554+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.974270+0000 front 2019-11-29T03:29:24.960738+0000 (oldest deadline 2019-11-29T03:30:10.832921+0000) 2019-11-29T03:30:31.617 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:30:31.613+0000 1694c700 -1 osd.2 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.654365+0000 front 2019-11-29T03:29:25.653556+0000 (oldest deadline 2019-11-29T03:30:10.314583+0000) 2019-11-29T03:30:31.622 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:30:31.618+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.939133+0000 front 2019-11-29T03:29:26.163044+0000 (oldest deadline 2019-11-29T03:30:08.768381+0000) 2019-11-29T03:30:31.623 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:30:31.617+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.734613+0000 front 2019-11-29T03:29:25.711253+0000 (oldest deadline 2019-11-29T03:30:07.980363+0000) 2019-11-29T03:30:31.963 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:30:31.957+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.476164+0000 front 2019-11-29T03:29:24.283175+0000 (oldest deadline 2019-11-29T03:30:10.144927+0000) 2019-11-29T03:30:32.201 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:30:32.195+0000 1694c700 -1 osd.5 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:20.768263+0000 front 2019-11-29T03:29:20.780049+0000 (oldest deadline 2019-11-29T03:30:06.625130+0000) 2019-11-29T03:30:32.518 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:30:32.514+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.183744+0000 front 2019-11-29T03:29:24.283466+0000 (oldest deadline 2019-11-29T03:30:08.830263+0000) 2019-11-29T03:30:32.589 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:30:32.585+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.939133+0000 front 2019-11-29T03:29:26.163044+0000 (oldest deadline 2019-11-29T03:30:08.768381+0000) 2019-11-29T03:30:32.610 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:30:32.604+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.974270+0000 front 2019-11-29T03:29:24.960738+0000 (oldest deadline 2019-11-29T03:30:10.832921+0000) 2019-11-29T03:30:32.638 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:30:32.632+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.734613+0000 front 2019-11-29T03:29:25.711253+0000 (oldest deadline 2019-11-29T03:30:07.980363+0000) 2019-11-29T03:30:32.665 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:30:32.659+0000 1694c700 -1 osd.2 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.654365+0000 front 2019-11-29T03:29:25.653556+0000 (oldest deadline 2019-11-29T03:30:10.314583+0000) 2019-11-29T03:30:32.926 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:30:32.920+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.476164+0000 front 2019-11-29T03:29:24.283175+0000 (oldest deadline 2019-11-29T03:30:10.144927+0000) 2019-11-29T03:30:33.202 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:30:33.197+0000 1694c700 -1 osd.5 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:20.768263+0000 front 2019-11-29T03:29:20.780049+0000 (oldest deadline 2019-11-29T03:30:06.625130+0000) 2019-11-29T03:30:33.517 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:30:33.512+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.183744+0000 front 2019-11-29T03:29:24.283466+0000 (oldest deadline 2019-11-29T03:30:08.830263+0000) 2019-11-29T03:30:33.615 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:30:33.611+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.939133+0000 front 2019-11-29T03:29:26.163044+0000 (oldest deadline 2019-11-29T03:30:08.768381+0000) 2019-11-29T03:30:33.617 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:30:33.613+0000 1694c700 -1 osd.2 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.654365+0000 front 2019-11-29T03:29:25.653556+0000 (oldest deadline 2019-11-29T03:30:10.314583+0000) 2019-11-29T03:30:33.629 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:30:33.623+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.974270+0000 front 2019-11-29T03:29:24.960738+0000 (oldest deadline 2019-11-29T03:30:10.832921+0000) 2019-11-29T03:30:33.662 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:30:33.656+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.734613+0000 front 2019-11-29T03:29:25.711253+0000 (oldest deadline 2019-11-29T03:30:07.980363+0000) 2019-11-29T03:30:33.973 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:30:33.968+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.476164+0000 front 2019-11-29T03:29:24.283175+0000 (oldest deadline 2019-11-29T03:30:10.144927+0000) 2019-11-29T03:30:34.198 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:30:34.192+0000 1694c700 -1 osd.5 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:20.768263+0000 front 2019-11-29T03:29:20.780049+0000 (oldest deadline 2019-11-29T03:30:06.625130+0000) 2019-11-29T03:30:34.568 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:30:34.563+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.183744+0000 front 2019-11-29T03:29:24.283466+0000 (oldest deadline 2019-11-29T03:30:08.830263+0000) 2019-11-29T03:30:34.598 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:30:34.593+0000 1694c700 -1 osd.2 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.654365+0000 front 2019-11-29T03:29:25.653556+0000 (oldest deadline 2019-11-29T03:30:10.314583+0000) 2019-11-29T03:30:34.608 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:30:34.601+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.974270+0000 front 2019-11-29T03:29:24.960738+0000 (oldest deadline 2019-11-29T03:30:10.832921+0000) 2019-11-29T03:30:34.661 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:30:34.658+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.939133+0000 front 2019-11-29T03:29:26.163044+0000 (oldest deadline 2019-11-29T03:30:08.768381+0000) 2019-11-29T03:30:34.701 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:30:34.695+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.734613+0000 front 2019-11-29T03:29:25.711253+0000 (oldest deadline 2019-11-29T03:30:07.980363+0000) 2019-11-29T03:30:34.931 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:30:34.926+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.476164+0000 front 2019-11-29T03:29:24.283175+0000 (oldest deadline 2019-11-29T03:30:10.144927+0000) 2019-11-29T03:30:35.199 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:30:35.191+0000 1694c700 -1 osd.5 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:20.768263+0000 front 2019-11-29T03:29:20.780049+0000 (oldest deadline 2019-11-29T03:30:06.625130+0000) 2019-11-29T03:30:35.580 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:30:35.577+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.183744+0000 front 2019-11-29T03:29:24.283466+0000 (oldest deadline 2019-11-29T03:30:08.830263+0000) 2019-11-29T03:30:35.586 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:30:35.583+0000 1694c700 -1 osd.2 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.654365+0000 front 2019-11-29T03:29:25.653556+0000 (oldest deadline 2019-11-29T03:30:10.314583+0000) 2019-11-29T03:30:35.610 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:30:35.604+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.974270+0000 front 2019-11-29T03:29:24.960738+0000 (oldest deadline 2019-11-29T03:30:10.832921+0000) 2019-11-29T03:30:35.678 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:30:35.674+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.939133+0000 front 2019-11-29T03:29:26.163044+0000 (oldest deadline 2019-11-29T03:30:08.768381+0000) 2019-11-29T03:30:35.710 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:30:35.702+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.734613+0000 front 2019-11-29T03:29:25.711253+0000 (oldest deadline 2019-11-29T03:30:07.980363+0000) 2019-11-29T03:30:35.956 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:30:35.951+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.476164+0000 front 2019-11-29T03:29:24.283175+0000 (oldest deadline 2019-11-29T03:30:10.144927+0000) 2019-11-29T03:30:36.164 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:30:36.158+0000 1694c700 -1 osd.5 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:20.768263+0000 front 2019-11-29T03:29:20.780049+0000 (oldest deadline 2019-11-29T03:30:06.625130+0000) 2019-11-29T03:30:36.580 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:30:36.576+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.183744+0000 front 2019-11-29T03:29:24.283466+0000 (oldest deadline 2019-11-29T03:30:08.830263+0000) 2019-11-29T03:30:36.603 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:30:36.599+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.974270+0000 front 2019-11-29T03:29:24.960738+0000 (oldest deadline 2019-11-29T03:30:10.832921+0000) 2019-11-29T03:30:36.611 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:30:36.606+0000 1694c700 -1 osd.2 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.654365+0000 front 2019-11-29T03:29:25.653556+0000 (oldest deadline 2019-11-29T03:30:10.314583+0000) 2019-11-29T03:30:36.691 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:30:36.687+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.939133+0000 front 2019-11-29T03:29:26.163044+0000 (oldest deadline 2019-11-29T03:30:08.768381+0000) 2019-11-29T03:30:36.715 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:30:36.709+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.734613+0000 front 2019-11-29T03:29:25.711253+0000 (oldest deadline 2019-11-29T03:30:07.980363+0000) 2019-11-29T03:30:36.916 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:30:36.911+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.476164+0000 front 2019-11-29T03:29:24.283175+0000 (oldest deadline 2019-11-29T03:30:10.144927+0000) 2019-11-29T03:30:37.216 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:30:37.210+0000 1694c700 -1 osd.5 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:20.768263+0000 front 2019-11-29T03:29:20.780049+0000 (oldest deadline 2019-11-29T03:30:06.625130+0000) 2019-11-29T03:30:37.574 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:30:37.569+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.183744+0000 front 2019-11-29T03:29:24.283466+0000 (oldest deadline 2019-11-29T03:30:08.830263+0000) 2019-11-29T03:30:37.584 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:30:37.580+0000 1694c700 -1 osd.2 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.654365+0000 front 2019-11-29T03:29:25.653556+0000 (oldest deadline 2019-11-29T03:30:10.314583+0000) 2019-11-29T03:30:37.633 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:30:37.625+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.974270+0000 front 2019-11-29T03:29:24.960738+0000 (oldest deadline 2019-11-29T03:30:10.832921+0000) 2019-11-29T03:30:37.663 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:30:37.659+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.939133+0000 front 2019-11-29T03:29:26.163044+0000 (oldest deadline 2019-11-29T03:30:08.768381+0000) 2019-11-29T03:30:37.726 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:30:37.722+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.734613+0000 front 2019-11-29T03:29:25.711253+0000 (oldest deadline 2019-11-29T03:30:07.980363+0000) 2019-11-29T03:30:37.875 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:30:37.869+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.476164+0000 front 2019-11-29T03:29:24.283175+0000 (oldest deadline 2019-11-29T03:30:10.144927+0000) 2019-11-29T03:30:38.160 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:30:38.156+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.74:6802/10096,v1:172.21.15.74:6803/10096] for 47sec e264 v264) 2019-11-29T03:30:38.266 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:30:38.261+0000 1694c700 -1 osd.5 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:20.768263+0000 front 2019-11-29T03:29:20.780049+0000 (oldest deadline 2019-11-29T03:30:06.625130+0000) 2019-11-29T03:30:38.566 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:30:38.561+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.183744+0000 front 2019-11-29T03:29:24.283466+0000 (oldest deadline 2019-11-29T03:30:08.830263+0000) 2019-11-29T03:30:38.611 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:30:38.607+0000 1694c700 -1 osd.2 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.654365+0000 front 2019-11-29T03:29:25.653556+0000 (oldest deadline 2019-11-29T03:30:10.314583+0000) 2019-11-29T03:30:38.633 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:30:38.627+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.974270+0000 front 2019-11-29T03:29:24.960738+0000 (oldest deadline 2019-11-29T03:30:10.832921+0000) 2019-11-29T03:30:38.657 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:30:38.654+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.939133+0000 front 2019-11-29T03:29:26.163044+0000 (oldest deadline 2019-11-29T03:30:08.768381+0000) 2019-11-29T03:30:38.732 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:30:38.726+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.734613+0000 front 2019-11-29T03:29:25.711253+0000 (oldest deadline 2019-11-29T03:30:07.980363+0000) 2019-11-29T03:30:38.865 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:30:38.859+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.476164+0000 front 2019-11-29T03:29:24.283175+0000 (oldest deadline 2019-11-29T03:30:10.144927+0000) 2019-11-29T03:30:39.261 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:30:39.255+0000 1694c700 -1 osd.5 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:20.768263+0000 front 2019-11-29T03:29:20.780049+0000 (oldest deadline 2019-11-29T03:30:06.625130+0000) 2019-11-29T03:30:39.559 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:30:39.555+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.183744+0000 front 2019-11-29T03:29:24.283466+0000 (oldest deadline 2019-11-29T03:30:08.830263+0000) 2019-11-29T03:30:39.568 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:30:39.565+0000 1694c700 -1 osd.2 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.654365+0000 front 2019-11-29T03:29:25.653556+0000 (oldest deadline 2019-11-29T03:30:10.314583+0000) 2019-11-29T03:30:39.615 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:30:39.612+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.939133+0000 front 2019-11-29T03:29:26.163044+0000 (oldest deadline 2019-11-29T03:30:08.768381+0000) 2019-11-29T03:30:39.616 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:30:39.608+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.974270+0000 front 2019-11-29T03:29:24.960738+0000 (oldest deadline 2019-11-29T03:30:10.832921+0000) 2019-11-29T03:30:39.705 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:30:39.699+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.734613+0000 front 2019-11-29T03:29:25.711253+0000 (oldest deadline 2019-11-29T03:30:07.980363+0000) 2019-11-29T03:30:39.827 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:30:39.822+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.476164+0000 front 2019-11-29T03:29:24.283175+0000 (oldest deadline 2019-11-29T03:30:10.144927+0000) 2019-11-29T03:30:40.222 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:30:40.216+0000 1694c700 -1 osd.5 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:20.768263+0000 front 2019-11-29T03:29:20.780049+0000 (oldest deadline 2019-11-29T03:30:06.625130+0000) 2019-11-29T03:30:40.570 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:30:40.566+0000 1694c700 -1 osd.2 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.654365+0000 front 2019-11-29T03:29:25.653556+0000 (oldest deadline 2019-11-29T03:30:10.314583+0000) 2019-11-29T03:30:40.612 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:30:40.608+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.939133+0000 front 2019-11-29T03:29:26.163044+0000 (oldest deadline 2019-11-29T03:30:08.768381+0000) 2019-11-29T03:30:40.617 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:30:40.607+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.183744+0000 front 2019-11-29T03:29:24.283466+0000 (oldest deadline 2019-11-29T03:30:08.830263+0000) 2019-11-29T03:30:40.654 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:30:40.649+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.974270+0000 front 2019-11-29T03:29:24.960738+0000 (oldest deadline 2019-11-29T03:30:10.832921+0000) 2019-11-29T03:30:40.756 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:30:40.751+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.734613+0000 front 2019-11-29T03:29:25.711253+0000 (oldest deadline 2019-11-29T03:30:07.980363+0000) 2019-11-29T03:30:40.877 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:30:40.872+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.476164+0000 front 2019-11-29T03:29:24.283175+0000 (oldest deadline 2019-11-29T03:30:10.144927+0000) 2019-11-29T03:30:41.273 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:30:41.267+0000 1694c700 -1 osd.5 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:20.768263+0000 front 2019-11-29T03:29:20.780049+0000 (oldest deadline 2019-11-29T03:30:06.625130+0000) 2019-11-29T03:30:41.560 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:30:41.556+0000 1694c700 -1 osd.2 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.654365+0000 front 2019-11-29T03:29:25.653556+0000 (oldest deadline 2019-11-29T03:30:10.314583+0000) 2019-11-29T03:30:41.623 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:30:41.620+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.183744+0000 front 2019-11-29T03:29:24.283466+0000 (oldest deadline 2019-11-29T03:30:08.830263+0000) 2019-11-29T03:30:41.653 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:30:41.647+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.974270+0000 front 2019-11-29T03:29:24.960738+0000 (oldest deadline 2019-11-29T03:30:10.832921+0000) 2019-11-29T03:30:41.659 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:30:41.656+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.939133+0000 front 2019-11-29T03:29:26.163044+0000 (oldest deadline 2019-11-29T03:30:08.768381+0000) 2019-11-29T03:30:41.787 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:30:41.781+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.734613+0000 front 2019-11-29T03:29:25.711253+0000 (oldest deadline 2019-11-29T03:30:07.980363+0000) 2019-11-29T03:30:41.863 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:30:41.858+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.476164+0000 front 2019-11-29T03:29:24.283175+0000 (oldest deadline 2019-11-29T03:30:10.144927+0000) 2019-11-29T03:30:42.310 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:30:42.305+0000 1694c700 -1 osd.5 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:20.768263+0000 front 2019-11-29T03:29:20.780049+0000 (oldest deadline 2019-11-29T03:30:06.625130+0000) 2019-11-29T03:30:42.568 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:30:42.566+0000 1694c700 -1 osd.2 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.654365+0000 front 2019-11-29T03:29:25.653556+0000 (oldest deadline 2019-11-29T03:30:10.314583+0000) 2019-11-29T03:30:42.619 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:30:42.611+0000 1694c700 -1 osd.4 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.974270+0000 front 2019-11-29T03:29:24.960738+0000 (oldest deadline 2019-11-29T03:30:10.832921+0000) 2019-11-29T03:30:42.630 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:30:42.627+0000 1694c700 -1 osd.0 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.183744+0000 front 2019-11-29T03:29:24.283466+0000 (oldest deadline 2019-11-29T03:30:08.830263+0000) 2019-11-29T03:30:42.657 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:30:42.654+0000 1694c700 -1 osd.1 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.939133+0000 front 2019-11-29T03:29:26.163044+0000 (oldest deadline 2019-11-29T03:30:08.768381+0000) 2019-11-29T03:30:42.824 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:30:42.818+0000 1694c700 -1 osd.6 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.734613+0000 front 2019-11-29T03:29:25.711253+0000 (oldest deadline 2019-11-29T03:30:07.980363+0000) 2019-11-29T03:30:42.848 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:30:42.842+0000 1694c700 -1 osd.7 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:24.476164+0000 front 2019-11-29T03:29:24.283175+0000 (oldest deadline 2019-11-29T03:30:10.144927+0000) 2019-11-29T03:30:43.206 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:30:43.197+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.74:6802/10096,v1:172.21.15.74:6803/10096] for 47sec e264 v264) 2019-11-29T03:30:43.283 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:30:43.278+0000 1694c700 -1 osd.5 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:20.768263+0000 front 2019-11-29T03:29:20.780049+0000 (oldest deadline 2019-11-29T03:30:06.625130+0000) 2019-11-29T03:30:43.542 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:30:43.540+0000 1694c700 -1 osd.2 264 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:29:25.654365+0000 front 2019-11-29T03:29:25.653556+0000 (oldest deadline 2019-11-29T03:30:10.314583+0000) 2019-11-29T03:31:37.248 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:45:19.466 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:31:37.256 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:45:19.474 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:31:37.267 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:45:19.496 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:31:37.268 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:45:19.487 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:31:37.272 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:45:19.492 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:31:37.274 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:45:19.503 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:31:37.357 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:45:19.575 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:31:37.396 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:45:19.616 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:31:37.397 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:45:19.625 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:31:40.790 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:31:40.785+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:31:41.827 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:31:41.821+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:31:42.340 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:31:42.335+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:31:42.371 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:31:42.368+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:31:42.801 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:31:42.796+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:31:42.927 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:31:42.923+0000 1694c700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.012090+0000 front 2019-11-29T03:30:58.290737+0000 (oldest deadline 2019-11-29T03:31:42.903853+0000) 2019-11-29T03:31:43.314 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:31:43.310+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:31:43.336 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:31:43.332+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:31:43.360 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:31:43.351+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:31:43.670 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:31:43.665+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:31:43.779 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:31:43.774+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:31:43.882 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:31:43.878+0000 1694c700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.012090+0000 front 2019-11-29T03:30:58.290737+0000 (oldest deadline 2019-11-29T03:31:42.903853+0000) 2019-11-29T03:31:43.997 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:31:43.994+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:31:44.288 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:31:44.285+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:31:44.327 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:31:44.323+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:31:44.373 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:31:44.366+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:31:44.701 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:31:44.694+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:31:44.818 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:31:44.812+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:31:44.859 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:31:44.856+0000 1694c700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.012090+0000 front 2019-11-29T03:30:58.290737+0000 (oldest deadline 2019-11-29T03:31:42.903853+0000) 2019-11-29T03:31:44.998 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:31:44.995+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:31:45.306 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:31:45.302+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:31:45.337 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:31:45.332+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:31:45.360 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:31:45.354+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:31:45.725 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:31:45.712+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:31:45.799 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:31:45.787+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:31:45.897 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:31:45.885+0000 1694c700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.012090+0000 front 2019-11-29T03:30:58.290737+0000 (oldest deadline 2019-11-29T03:31:42.903853+0000) 2019-11-29T03:31:46.050 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:31:46.045+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:31:46.318 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:31:46.313+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:31:46.367 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:31:46.363+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:31:46.376 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:31:46.371+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:31:46.746 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:31:46.742+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:31:46.760 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:31:46.755+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:31:46.845 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:31:46.842+0000 1694c700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.012090+0000 front 2019-11-29T03:30:58.290737+0000 (oldest deadline 2019-11-29T03:31:42.903853+0000) 2019-11-29T03:31:47.059 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:31:47.056+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:31:47.310 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:31:47.307+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:31:47.376 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:31:47.371+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:31:47.381 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:31:47.378+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:31:47.750 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:31:47.744+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:31:47.778 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:31:47.772+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:31:47.812 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:31:47.808+0000 1694c700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.012090+0000 front 2019-11-29T03:30:58.290737+0000 (oldest deadline 2019-11-29T03:31:42.903853+0000) 2019-11-29T03:31:48.084 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:31:48.081+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:31:48.323 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:31:48.320+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:31:48.396 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:31:48.392+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:31:48.433 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:31:48.430+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:31:48.707 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:31:48.702+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:31:48.769 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:31:48.765+0000 1694c700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.012090+0000 front 2019-11-29T03:30:58.290737+0000 (oldest deadline 2019-11-29T03:31:42.903853+0000) 2019-11-29T03:31:48.796 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:31:48.792+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:31:49.060 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:31:49.056+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:31:49.319 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:31:49.315+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:31:49.388 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:31:49.384+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:31:49.432 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:31:49.429+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:31:49.665 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:31:49.660+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:31:49.770 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:31:49.765+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:31:49.776 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:31:49.762+0000 1694c700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.012090+0000 front 2019-11-29T03:30:58.290737+0000 (oldest deadline 2019-11-29T03:31:42.903853+0000) 2019-11-29T03:31:50.035 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:31:50.032+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:31:50.368 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:31:50.364+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:31:50.376 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:31:50.372+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:31:50.446 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:31:50.442+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:31:50.636 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:31:50.631+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:31:50.735 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:31:50.731+0000 1694c700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.012090+0000 front 2019-11-29T03:30:58.290737+0000 (oldest deadline 2019-11-29T03:31:42.903853+0000) 2019-11-29T03:31:50.788 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:31:50.783+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:31:51.030 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:31:51.024+0000 1694c700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:31:10.299411+0000 (oldest deadline 2019-11-29T03:31:50.299411+0000) 2019-11-29T03:31:51.030 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:31:51.027+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:31:51.374 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:31:51.370+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:31:51.426 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:31:51.420+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:31:51.480 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:31:51.476+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:31:51.629 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:31:51.624+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:31:51.727 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:31:51.723+0000 1694c700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.012090+0000 front 2019-11-29T03:30:58.290737+0000 (oldest deadline 2019-11-29T03:31:42.903853+0000) 2019-11-29T03:31:51.747 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:31:51.741+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:31:52.081 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:31:52.074+0000 1694c700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:31:10.299411+0000 (oldest deadline 2019-11-29T03:31:50.299411+0000) 2019-11-29T03:31:52.082 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:31:52.079+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:31:52.389 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:31:52.385+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:31:52.451 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:31:52.446+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:31:52.480 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:31:52.477+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:31:52.647 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:31:52.643+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:31:52.705 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:31:52.700+0000 1694c700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.012090+0000 front 2019-11-29T03:30:58.290737+0000 (oldest deadline 2019-11-29T03:31:42.903853+0000) 2019-11-29T03:31:52.762 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:31:52.756+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:31:53.065 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:31:53.060+0000 1694c700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:31:10.299411+0000 (oldest deadline 2019-11-29T03:31:50.299411+0000) 2019-11-29T03:31:53.066 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:31:53.062+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:31:53.432 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:31:53.428+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:31:53.454 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:31:53.449+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:31:53.531 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:31:53.528+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:31:53.659 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:31:53.654+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:31:53.667 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:31:53.662+0000 1694c700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.012090+0000 front 2019-11-29T03:30:58.290737+0000 (oldest deadline 2019-11-29T03:31:42.903853+0000) 2019-11-29T03:31:53.753 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:31:53.746+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:31:54.070 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:31:54.065+0000 1694c700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:31:10.299411+0000 (oldest deadline 2019-11-29T03:31:50.299411+0000) 2019-11-29T03:31:54.071 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:31:54.067+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:31:54.408 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:31:54.405+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:31:54.449 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:31:54.444+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:31:54.495 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:31:54.492+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:31:54.691 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:31:54.686+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:31:54.713 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:31:54.710+0000 1694c700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.012090+0000 front 2019-11-29T03:30:58.290737+0000 (oldest deadline 2019-11-29T03:31:42.903853+0000) 2019-11-29T03:31:54.788 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:31:54.782+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:31:55.089 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:31:55.085+0000 1694c700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:31:10.299411+0000 (oldest deadline 2019-11-29T03:31:50.299411+0000) 2019-11-29T03:31:55.091 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:31:55.089+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:31:55.405 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:31:55.401+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:31:55.487 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:31:55.481+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:31:55.496 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:31:55.492+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:31:55.670 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:31:55.664+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:31:55.671 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:31:55.666+0000 1694c700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.012090+0000 front 2019-11-29T03:30:58.290737+0000 (oldest deadline 2019-11-29T03:31:42.903853+0000) 2019-11-29T03:31:55.777 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:31:55.772+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:31:56.097 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:31:56.093+0000 1694c700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:31:10.299411+0000 (oldest deadline 2019-11-29T03:31:50.299411+0000) 2019-11-29T03:31:56.098 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:31:56.094+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:31:56.371 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:31:56.367+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:31:56.512 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:31:56.508+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:31:56.533 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:31:56.527+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:31:56.629 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:31:56.624+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:31:56.661 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:31:56.654+0000 1694c700 -1 osd.2 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.012090+0000 front 2019-11-29T03:30:58.290737+0000 (oldest deadline 2019-11-29T03:31:42.903853+0000) 2019-11-29T03:31:56.803 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:31:56.798+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:31:57.128 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:31:57.125+0000 1694c700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:31:10.299411+0000 (oldest deadline 2019-11-29T03:31:50.299411+0000) 2019-11-29T03:31:57.130 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:31:57.127+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:31:57.381 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:31:57.376+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:31:57.487 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:31:57.482+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:31:57.506 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:31:57.503+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:31:57.655 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:31:57.650+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:31:57.796 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:31:57.791+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:31:58.142 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:31:58.138+0000 1694c700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:31:10.299411+0000 (oldest deadline 2019-11-29T03:31:50.299411+0000) 2019-11-29T03:31:58.145 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:31:58.142+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:31:58.395 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:31:58.392+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:31:58.473 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:31:58.469+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:31:58.487 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:31:58.482+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:31:58.627 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:31:58.621+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:31:58.824 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:31:58.814+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:31:59.173 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:31:59.168+0000 1694c700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:31:10.299411+0000 (oldest deadline 2019-11-29T03:31:50.299411+0000) 2019-11-29T03:31:59.174 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:31:59.170+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:31:59.435 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:31:59.432+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:31:59.492 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:31:59.484+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:31:59.521 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:31:59.516+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:31:59.639 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:31:59.634+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:31:59.853 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:31:59.847+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:32:00.140 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:00.136+0000 1694c700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:31:10.299411+0000 (oldest deadline 2019-11-29T03:31:50.299411+0000) 2019-11-29T03:32:00.141 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:00.137+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:32:00.432 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:32:00.428+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:32:00.451 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:32:00.447+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:32:00.522 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:32:00.514+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:32:00.669 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:32:00.663+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:32:00.866 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:32:00.861+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:32:01.147 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:01.144+0000 1694c700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:31:10.299411+0000 (oldest deadline 2019-11-29T03:31:50.299411+0000) 2019-11-29T03:32:01.147 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:01.145+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:32:01.390 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:32:01.383+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:32:01.465 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:32:01.462+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:32:01.513 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:32:01.507+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:32:01.680 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:32:01.673+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:32:01.857 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:32:01.852+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:32:02.141 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:02.137+0000 1694c700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:31:10.299411+0000 (oldest deadline 2019-11-29T03:31:50.299411+0000) 2019-11-29T03:32:02.142 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:02.138+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:32:02.440 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:32:02.437+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:32:02.461 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:32:02.457+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:32:02.524 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:32:02.515+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:32:02.697 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:32:02.691+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:32:02.831 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:32:02.826+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:32:03.187 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:03.181+0000 1694c700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:31:10.299411+0000 (oldest deadline 2019-11-29T03:31:50.299411+0000) 2019-11-29T03:32:03.187 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:03.184+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:32:03.443 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:32:03.439+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:32:03.476 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:32:03.470+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:32:03.542 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:32:03.536+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:32:03.707 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:32:03.701+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:32:03.879 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:32:03.873+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:32:04.165 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:04.161+0000 1694c700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:31:10.299411+0000 (oldest deadline 2019-11-29T03:31:50.299411+0000) 2019-11-29T03:32:04.166 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:04.163+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:32:04.414 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:32:04.404+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:32:04.427 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:32:04.424+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:32:04.571 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:32:04.566+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:32:04.682 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:32:04.674+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:32:04.890 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:32:04.885+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:32:05.177 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:05.172+0000 1694c700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:31:10.299411+0000 (oldest deadline 2019-11-29T03:31:50.299411+0000) 2019-11-29T03:32:05.177 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:05.174+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:32:05.404 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:32:05.400+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:32:05.419 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:32:05.416+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:32:05.560 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:32:05.549+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:32:05.675 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:32:05.669+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:32:05.857 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:32:05.851+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:32:06.154 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:06.146+0000 1694c700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:31:10.299411+0000 (oldest deadline 2019-11-29T03:31:50.299411+0000) 2019-11-29T03:32:06.168 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:06.150+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:32:06.374 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:32:06.369+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:32:06.469 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:32:06.465+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:32:06.513 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:32:06.508+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:32:06.728 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:32:06.722+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:32:06.894 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:32:06.888+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:32:07.158 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:07.153+0000 1694c700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:31:10.299411+0000 (oldest deadline 2019-11-29T03:31:50.299411+0000) 2019-11-29T03:32:07.158 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:07.155+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:32:07.348 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:32:07.344+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:32:07.478 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:32:07.474+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:32:07.562 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:32:07.556+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:32:07.765 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:32:07.758+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:32:07.899 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:32:07.888+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:32:08.138 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:08.135+0000 1694c700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:31:10.299411+0000 (oldest deadline 2019-11-29T03:31:50.299411+0000) 2019-11-29T03:32:08.139 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:08.136+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:32:08.352 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:32:08.338+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:32:08.523 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:32:08.519+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:32:08.572 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:32:08.566+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:32:08.786 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:32:08.780+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:32:08.915 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:32:08.909+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:32:09.133 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:09.125+0000 1694c700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:31:10.299411+0000 (oldest deadline 2019-11-29T03:31:50.299411+0000) 2019-11-29T03:32:09.133 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:09.129+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:32:09.314 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:32:09.310+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:32:09.569 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:32:09.566+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:32:09.607 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:32:09.602+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:32:09.809 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:32:09.803+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:32:09.939 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:32:09.934+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:32:10.155 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:10.147+0000 1694c700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:31:10.299411+0000 (oldest deadline 2019-11-29T03:31:50.299411+0000) 2019-11-29T03:32:10.156 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:10.150+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:32:10.354 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:32:10.351+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:32:10.607 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:32:10.603+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:32:10.637 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:32:10.632+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:32:10.770 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:32:10.759+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:32:10.899 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:32:10.894+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:32:11.152 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:11.149+0000 1694c700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:31:10.299411+0000 (oldest deadline 2019-11-29T03:31:50.299411+0000) 2019-11-29T03:32:11.154 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:11.151+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:32:11.387 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:32:11.382+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:32:11.607 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:32:11.604+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:32:11.689 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:32:11.683+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:32:11.799 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:32:11.794+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:32:11.876 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:32:11.871+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:32:12.187 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:12.183+0000 1694c700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:31:10.299411+0000 (oldest deadline 2019-11-29T03:31:50.299411+0000) 2019-11-29T03:32:12.189 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:12.187+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:32:12.345 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:32:12.340+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:32:12.657 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:32:12.654+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:32:12.729 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:32:12.724+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:32:12.772 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:32:12.768+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:32:12.911 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:32:12.906+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:32:13.160 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:13.157+0000 1694c700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:31:10.299411+0000 (oldest deadline 2019-11-29T03:31:50.299411+0000) 2019-11-29T03:32:13.161 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:13.159+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:32:13.378 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:32:13.375+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:32:13.441 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:32:13.439+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 46sec e270 v270) 2019-11-29T03:32:13.629 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:32:13.626+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:32:13.764 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:32:13.758+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:32:13.788 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:32:13.780+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:32:13.944 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:32:13.939+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:32:14.209 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:14.206+0000 1694c700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:31:10.299411+0000 (oldest deadline 2019-11-29T03:31:50.299411+0000) 2019-11-29T03:32:14.209 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:14.207+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:32:14.356 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:32:14.350+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:32:14.652 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:32:14.650+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:32:14.733 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:32:14.728+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:32:14.788 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:32:14.778+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:32:14.941 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:32:14.935+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:32:15.196 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:15.194+0000 1694c700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:31:10.299411+0000 (oldest deadline 2019-11-29T03:31:50.299411+0000) 2019-11-29T03:32:15.199 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:15.198+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:32:15.357 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:32:15.353+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:32:15.633 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:32:15.631+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:32:15.732 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:32:15.727+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:32:15.768 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:32:15.758+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:32:15.914 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:32:15.906+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:32:16.215 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:16.211+0000 1694c700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:31:10.299411+0000 (oldest deadline 2019-11-29T03:31:50.299411+0000) 2019-11-29T03:32:16.216 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:16.213+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:32:16.364 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:32:16.361+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:32:16.617 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:32:16.615+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:32:16.753 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:32:16.748+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:32:16.782 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:32:16.776+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:32:16.963 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:32:16.958+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:32:17.200 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:17.197+0000 1694c700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:31:10.299411+0000 (oldest deadline 2019-11-29T03:31:50.299411+0000) 2019-11-29T03:32:17.200 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:17.198+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:32:17.384 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:32:17.381+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:32:17.638 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:32:17.636+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:32:17.785 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:32:17.780+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:32:17.788 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:32:17.783+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:32:17.981 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:32:17.976+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:32:18.163 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:18.159+0000 1694c700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:31:10.299411+0000 (oldest deadline 2019-11-29T03:31:50.299411+0000) 2019-11-29T03:32:18.163 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:18.161+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:32:18.352 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:32:18.349+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:32:18.459 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:32:18.453+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 46sec e270 v270) 2019-11-29T03:32:18.652 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:32:18.650+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:32:18.753 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:32:18.749+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:32:18.797 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:32:18.792+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:32:18.941 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:32:18.936+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:32:19.157 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:19.153+0000 1694c700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:31:10.299411+0000 (oldest deadline 2019-11-29T03:31:50.299411+0000) 2019-11-29T03:32:19.158 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:19.155+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:32:19.348 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:32:19.341+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:32:19.668 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:32:19.666+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:32:19.768 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:32:19.763+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:32:19.792 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:32:19.788+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:32:19.976 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:32:19.971+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:32:20.148 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:20.145+0000 1694c700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:31:10.299411+0000 (oldest deadline 2019-11-29T03:31:50.299411+0000) 2019-11-29T03:32:20.152 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:20.150+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:32:20.392 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:32:20.389+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:32:20.705 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:32:20.702+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:32:20.787 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:32:20.783+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:32:20.825 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:32:20.820+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:32:20.934 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:32:20.928+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:32:21.198 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:21.193+0000 1694c700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:31:10.299411+0000 (oldest deadline 2019-11-29T03:31:50.299411+0000) 2019-11-29T03:32:21.198 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:21.196+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:32:21.429 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:32:21.427+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:32:21.667 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:32:21.664+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:32:21.804 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:32:21.798+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:32:21.814 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:32:21.809+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:32:21.895 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:32:21.890+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:32:22.189 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:22.185+0000 1694c700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:31:10.299411+0000 (oldest deadline 2019-11-29T03:31:50.299411+0000) 2019-11-29T03:32:22.193 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:22.186+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:32:22.394 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:32:22.390+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:32:22.642 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:32:22.640+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:32:22.772 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:32:22.767+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:32:22.785 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:32:22.781+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:32:22.934 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:32:22.929+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:32:23.194 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:23.189+0000 1694c700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:31:10.299411+0000 (oldest deadline 2019-11-29T03:31:50.299411+0000) 2019-11-29T03:32:23.197 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:23.193+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:32:23.443 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:32:23.439+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:32:23.469 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:32:23.467+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 46sec e270 v270) 2019-11-29T03:32:23.607 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:32:23.604+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:32:23.734 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:32:23.728+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:32:23.791 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:32:23.786+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:32:23.976 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:32:23.971+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:32:24.187 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:24.184+0000 1694c700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:31:10.299411+0000 (oldest deadline 2019-11-29T03:31:50.299411+0000) 2019-11-29T03:32:24.189 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:24.187+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:32:24.415 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:32:24.414+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:32:24.573 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:32:24.570+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:32:24.732 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:32:24.727+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:32:24.773 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:32:24.764+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:32:24.998 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:32:24.992+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:32:25.201 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:25.197+0000 1694c700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:31:10.299411+0000 (oldest deadline 2019-11-29T03:31:50.299411+0000) 2019-11-29T03:32:25.202 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:25.200+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:32:25.439 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:32:25.437+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:32:25.553 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:32:25.551+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:32:25.717 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:32:25.713+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:32:25.741 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:32:25.737+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:32:26.017 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:32:26.011+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:32:26.183 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:26.181+0000 1694c700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:31:10.299411+0000 (oldest deadline 2019-11-29T03:31:50.299411+0000) 2019-11-29T03:32:26.186 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:26.184+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:32:26.451 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:32:26.448+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:32:26.533 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:32:26.530+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:32:26.678 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:32:26.673+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:32:26.766 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:32:26.762+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:32:27.039 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:32:27.034+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:32:27.201 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:27.198+0000 1694c700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:31:10.299411+0000 (oldest deadline 2019-11-29T03:31:50.299411+0000) 2019-11-29T03:32:27.203 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:27.200+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:32:27.428 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:32:27.425+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:32:27.555 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:32:27.551+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:32:27.730 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:32:27.724+0000 1694c700 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.006292+0000 front 2019-11-29T03:30:58.004651+0000 (oldest deadline 2019-11-29T03:31:43.021054+0000) 2019-11-29T03:32:27.773 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:32:27.767+0000 1694c700 -1 osd.7 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.295696+0000 front 2019-11-29T03:30:55.099850+0000 (oldest deadline 2019-11-29T03:31:40.731913+0000) 2019-11-29T03:32:28.001 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:32:27.996+0000 1694c700 -1 osd.6 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:31:00.379903+0000 front 2019-11-29T03:30:58.368804+0000 (oldest deadline 2019-11-29T03:31:43.056988+0000) 2019-11-29T03:32:28.198 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:28.194+0000 1694c700 -1 osd.3 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:31:10.299411+0000 (oldest deadline 2019-11-29T03:31:50.299411+0000) 2019-11-29T03:32:28.201 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:32:28.198+0000 1694c700 -1 osd.3 270 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4494.0:107955 7.5 7.fe06d5 (undecoded) ondisk+retry+read+known_if_redirected e268) 2019-11-29T03:32:28.429 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:32:28.423+0000 1694c700 -1 osd.1 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:57.676363+0000 front 2019-11-29T03:30:57.890985+0000 (oldest deadline 2019-11-29T03:31:41.543643+0000) 2019-11-29T03:32:28.532 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:32:28.523+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 46sec e270 v270) 2019-11-29T03:32:28.574 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:32:28.570+0000 1694c700 -1 osd.0 270 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:30:58.004614+0000 front 2019-11-29T03:30:57.999095+0000 (oldest deadline 2019-11-29T03:31:41.452086+0000) 2019-11-29T03:33:58.538 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:33:58.534+0000 1694c700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.338373+0000 front 2019-11-29T03:33:16.355911+0000 (oldest deadline 2019-11-29T03:33:58.024226+0000) 2019-11-29T03:33:58.746 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:33:58.740+0000 1694c700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:18.698359+0000 front 2019-11-29T03:33:17.780293+0000 (oldest deadline 2019-11-29T03:33:58.729633+0000) 2019-11-29T03:33:59.160 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:33:59.151+0000 1694c700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:12.912646+0000 front 2019-11-29T03:33:12.908827+0000 (oldest deadline 2019-11-29T03:33:58.180053+0000) 2019-11-29T03:33:59.501 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:33:59.496+0000 1694c700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.338373+0000 front 2019-11-29T03:33:16.355911+0000 (oldest deadline 2019-11-29T03:33:58.024226+0000) 2019-11-29T03:33:59.717 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:33:59.711+0000 1694c700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:18.698359+0000 front 2019-11-29T03:33:17.780293+0000 (oldest deadline 2019-11-29T03:33:58.729633+0000) 2019-11-29T03:33:59.769 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:33:59.762+0000 1694c700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:17.763898+0000 front 2019-11-29T03:33:17.774494+0000 (oldest deadline 2019-11-29T03:33:59.600601+0000) 2019-11-29T03:34:00.140 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:34:00.135+0000 1694c700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:12.912646+0000 front 2019-11-29T03:33:12.908827+0000 (oldest deadline 2019-11-29T03:33:58.180053+0000) 2019-11-29T03:34:00.174 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:34:00.170+0000 1694c700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:14.409371+0000 front 2019-11-29T03:33:14.351821+0000 (oldest deadline 2019-11-29T03:33:59.611597+0000) 2019-11-29T03:34:00.484 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:34:00.481+0000 1694c700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.338373+0000 front 2019-11-29T03:33:16.355911+0000 (oldest deadline 2019-11-29T03:33:58.024226+0000) 2019-11-29T03:34:00.547 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:34:00.541+0000 1694c700 -1 osd.2 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.690376+0000 front 2019-11-29T03:33:17.121072+0000 (oldest deadline 2019-11-29T03:33:59.562244+0000) 2019-11-29T03:34:00.680 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:34:00.674+0000 1694c700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:18.698359+0000 front 2019-11-29T03:33:17.780293+0000 (oldest deadline 2019-11-29T03:33:58.729633+0000) 2019-11-29T03:34:00.763 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:34:00.758+0000 1694c700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:17.763898+0000 front 2019-11-29T03:33:17.774494+0000 (oldest deadline 2019-11-29T03:33:59.600601+0000) 2019-11-29T03:34:01.125 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:34:01.119+0000 1694c700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:12.912646+0000 front 2019-11-29T03:33:12.908827+0000 (oldest deadline 2019-11-29T03:33:58.180053+0000) 2019-11-29T03:34:01.171 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:34:01.167+0000 1694c700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:14.409371+0000 front 2019-11-29T03:33:14.351821+0000 (oldest deadline 2019-11-29T03:33:59.611597+0000) 2019-11-29T03:34:01.516 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:34:01.510+0000 1694c700 -1 osd.2 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.690376+0000 front 2019-11-29T03:33:17.121072+0000 (oldest deadline 2019-11-29T03:33:59.562244+0000) 2019-11-29T03:34:01.521 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:34:01.514+0000 1694c700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.792426+0000 front 2019-11-29T03:33:16.843086+0000 (oldest deadline 2019-11-29T03:34:00.760480+0000) 2019-11-29T03:34:01.524 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:34:01.522+0000 1694c700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.338373+0000 front 2019-11-29T03:33:16.355911+0000 (oldest deadline 2019-11-29T03:33:58.024226+0000) 2019-11-29T03:34:01.649 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:34:01.644+0000 1694c700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:18.698359+0000 front 2019-11-29T03:33:17.780293+0000 (oldest deadline 2019-11-29T03:33:58.729633+0000) 2019-11-29T03:34:01.809 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:34:01.803+0000 1694c700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:17.763898+0000 front 2019-11-29T03:33:17.774494+0000 (oldest deadline 2019-11-29T03:33:59.600601+0000) 2019-11-29T03:34:02.156 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:34:02.150+0000 1694c700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:12.912646+0000 front 2019-11-29T03:33:12.908827+0000 (oldest deadline 2019-11-29T03:33:58.180053+0000) 2019-11-29T03:34:02.213 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:34:02.208+0000 1694c700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:14.409371+0000 front 2019-11-29T03:33:14.351821+0000 (oldest deadline 2019-11-29T03:33:59.611597+0000) 2019-11-29T03:34:02.508 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:34:02.500+0000 1694c700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.792426+0000 front 2019-11-29T03:33:16.843086+0000 (oldest deadline 2019-11-29T03:34:00.760480+0000) 2019-11-29T03:34:02.512 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:34:02.508+0000 1694c700 -1 osd.2 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.690376+0000 front 2019-11-29T03:33:17.121072+0000 (oldest deadline 2019-11-29T03:33:59.562244+0000) 2019-11-29T03:34:02.574 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:34:02.571+0000 1694c700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.338373+0000 front 2019-11-29T03:33:16.355911+0000 (oldest deadline 2019-11-29T03:33:58.024226+0000) 2019-11-29T03:34:02.660 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:34:02.655+0000 1694c700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:18.698359+0000 front 2019-11-29T03:33:17.780293+0000 (oldest deadline 2019-11-29T03:33:58.729633+0000) 2019-11-29T03:34:02.853 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:34:02.847+0000 1694c700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:17.763898+0000 front 2019-11-29T03:33:17.774494+0000 (oldest deadline 2019-11-29T03:33:59.600601+0000) 2019-11-29T03:34:03.129 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:34:03.124+0000 1694c700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:12.912646+0000 front 2019-11-29T03:33:12.908827+0000 (oldest deadline 2019-11-29T03:33:58.180053+0000) 2019-11-29T03:34:03.241 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:34:03.238+0000 1694c700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:14.409371+0000 front 2019-11-29T03:33:14.351821+0000 (oldest deadline 2019-11-29T03:33:59.611597+0000) 2019-11-29T03:34:03.487 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:34:03.481+0000 1694c700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.792426+0000 front 2019-11-29T03:33:16.843086+0000 (oldest deadline 2019-11-29T03:34:00.760480+0000) 2019-11-29T03:34:03.530 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:34:03.526+0000 1694c700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.338373+0000 front 2019-11-29T03:33:16.355911+0000 (oldest deadline 2019-11-29T03:33:58.024226+0000) 2019-11-29T03:34:03.536 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:34:03.533+0000 1694c700 -1 osd.2 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.690376+0000 front 2019-11-29T03:33:17.121072+0000 (oldest deadline 2019-11-29T03:33:59.562244+0000) 2019-11-29T03:34:03.671 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:34:03.666+0000 1694c700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:18.698359+0000 front 2019-11-29T03:33:17.780293+0000 (oldest deadline 2019-11-29T03:33:58.729633+0000) 2019-11-29T03:34:03.842 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:34:03.837+0000 1694c700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:17.763898+0000 front 2019-11-29T03:33:17.774494+0000 (oldest deadline 2019-11-29T03:33:59.600601+0000) 2019-11-29T03:34:04.132 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:34:04.126+0000 1694c700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:12.912646+0000 front 2019-11-29T03:33:12.908827+0000 (oldest deadline 2019-11-29T03:33:58.180053+0000) 2019-11-29T03:34:04.228 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:34:04.225+0000 1694c700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:14.409371+0000 front 2019-11-29T03:33:14.351821+0000 (oldest deadline 2019-11-29T03:33:59.611597+0000) 2019-11-29T03:34:04.469 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:34:04.460+0000 1694c700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.792426+0000 front 2019-11-29T03:33:16.843086+0000 (oldest deadline 2019-11-29T03:34:00.760480+0000) 2019-11-29T03:34:04.486 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:34:04.482+0000 1694c700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.338373+0000 front 2019-11-29T03:33:16.355911+0000 (oldest deadline 2019-11-29T03:33:58.024226+0000) 2019-11-29T03:34:04.516 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:34:04.512+0000 1694c700 -1 osd.2 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.690376+0000 front 2019-11-29T03:33:17.121072+0000 (oldest deadline 2019-11-29T03:33:59.562244+0000) 2019-11-29T03:34:04.709 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:34:04.703+0000 1694c700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:18.698359+0000 front 2019-11-29T03:33:17.780293+0000 (oldest deadline 2019-11-29T03:33:58.729633+0000) 2019-11-29T03:34:04.804 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:34:04.798+0000 1694c700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:17.763898+0000 front 2019-11-29T03:33:17.774494+0000 (oldest deadline 2019-11-29T03:33:59.600601+0000) 2019-11-29T03:34:05.090 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:34:05.085+0000 1694c700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:12.912646+0000 front 2019-11-29T03:33:12.908827+0000 (oldest deadline 2019-11-29T03:33:58.180053+0000) 2019-11-29T03:34:05.279 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:34:05.275+0000 1694c700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:14.409371+0000 front 2019-11-29T03:33:14.351821+0000 (oldest deadline 2019-11-29T03:33:59.611597+0000) 2019-11-29T03:34:05.430 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:34:05.425+0000 1694c700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.792426+0000 front 2019-11-29T03:33:16.843086+0000 (oldest deadline 2019-11-29T03:34:00.760480+0000) 2019-11-29T03:34:05.481 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:34:05.478+0000 1694c700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.338373+0000 front 2019-11-29T03:33:16.355911+0000 (oldest deadline 2019-11-29T03:33:58.024226+0000) 2019-11-29T03:34:05.484 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:34:05.480+0000 1694c700 -1 osd.2 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.690376+0000 front 2019-11-29T03:33:17.121072+0000 (oldest deadline 2019-11-29T03:33:59.562244+0000) 2019-11-29T03:34:05.733 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:34:05.726+0000 1694c700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:18.698359+0000 front 2019-11-29T03:33:17.780293+0000 (oldest deadline 2019-11-29T03:33:58.729633+0000) 2019-11-29T03:34:05.785 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:34:05.780+0000 1694c700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:17.763898+0000 front 2019-11-29T03:33:17.774494+0000 (oldest deadline 2019-11-29T03:33:59.600601+0000) 2019-11-29T03:34:06.142 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:34:06.137+0000 1694c700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:12.912646+0000 front 2019-11-29T03:33:12.908827+0000 (oldest deadline 2019-11-29T03:33:58.180053+0000) 2019-11-29T03:34:06.327 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:34:06.323+0000 1694c700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:14.409371+0000 front 2019-11-29T03:33:14.351821+0000 (oldest deadline 2019-11-29T03:33:59.611597+0000) 2019-11-29T03:34:06.447 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:34:06.443+0000 1694c700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.338373+0000 front 2019-11-29T03:33:16.355911+0000 (oldest deadline 2019-11-29T03:33:58.024226+0000) 2019-11-29T03:34:06.452 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:34:06.448+0000 1694c700 -1 osd.2 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.690376+0000 front 2019-11-29T03:33:17.121072+0000 (oldest deadline 2019-11-29T03:33:59.562244+0000) 2019-11-29T03:34:06.459 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:34:06.454+0000 1694c700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.792426+0000 front 2019-11-29T03:33:16.843086+0000 (oldest deadline 2019-11-29T03:34:00.760480+0000) 2019-11-29T03:34:06.784 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:34:06.778+0000 1694c700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:18.698359+0000 front 2019-11-29T03:33:17.780293+0000 (oldest deadline 2019-11-29T03:33:58.729633+0000) 2019-11-29T03:34:06.833 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:34:06.822+0000 1694c700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:17.763898+0000 front 2019-11-29T03:33:17.774494+0000 (oldest deadline 2019-11-29T03:33:59.600601+0000) 2019-11-29T03:34:07.167 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:34:07.161+0000 1694c700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:12.912646+0000 front 2019-11-29T03:33:12.908827+0000 (oldest deadline 2019-11-29T03:33:58.180053+0000) 2019-11-29T03:34:07.361 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:34:07.357+0000 1694c700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:14.409371+0000 front 2019-11-29T03:33:14.351821+0000 (oldest deadline 2019-11-29T03:33:59.611597+0000) 2019-11-29T03:34:07.429 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:34:07.425+0000 1694c700 -1 osd.2 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.690376+0000 front 2019-11-29T03:33:17.121072+0000 (oldest deadline 2019-11-29T03:33:59.562244+0000) 2019-11-29T03:34:07.440 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:34:07.435+0000 1694c700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.792426+0000 front 2019-11-29T03:33:16.843086+0000 (oldest deadline 2019-11-29T03:34:00.760480+0000) 2019-11-29T03:34:07.471 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:34:07.468+0000 1694c700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.338373+0000 front 2019-11-29T03:33:16.355911+0000 (oldest deadline 2019-11-29T03:33:58.024226+0000) 2019-11-29T03:34:07.765 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:34:07.760+0000 1694c700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:18.698359+0000 front 2019-11-29T03:33:17.780293+0000 (oldest deadline 2019-11-29T03:33:58.729633+0000) 2019-11-29T03:34:07.871 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:34:07.866+0000 1694c700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:17.763898+0000 front 2019-11-29T03:33:17.774494+0000 (oldest deadline 2019-11-29T03:33:59.600601+0000) 2019-11-29T03:34:08.137 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:34:08.131+0000 1694c700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:12.912646+0000 front 2019-11-29T03:33:12.908827+0000 (oldest deadline 2019-11-29T03:33:58.180053+0000) 2019-11-29T03:34:08.348 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:34:08.344+0000 1694c700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:14.409371+0000 front 2019-11-29T03:33:14.351821+0000 (oldest deadline 2019-11-29T03:33:59.611597+0000) 2019-11-29T03:34:08.408 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:34:08.402+0000 1694c700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.792426+0000 front 2019-11-29T03:33:16.843086+0000 (oldest deadline 2019-11-29T03:34:00.760480+0000) 2019-11-29T03:34:08.427 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:34:08.423+0000 1694c700 -1 osd.2 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.690376+0000 front 2019-11-29T03:33:17.121072+0000 (oldest deadline 2019-11-29T03:33:59.562244+0000) 2019-11-29T03:34:08.460 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:34:08.456+0000 1694c700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.338373+0000 front 2019-11-29T03:33:16.355911+0000 (oldest deadline 2019-11-29T03:33:58.024226+0000) 2019-11-29T03:34:08.803 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:34:08.797+0000 1694c700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:18.698359+0000 front 2019-11-29T03:33:17.780293+0000 (oldest deadline 2019-11-29T03:33:58.729633+0000) 2019-11-29T03:34:08.859 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:34:08.853+0000 1694c700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:17.763898+0000 front 2019-11-29T03:33:17.774494+0000 (oldest deadline 2019-11-29T03:33:59.600601+0000) 2019-11-29T03:34:09.163 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:34:09.155+0000 1694c700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:12.912646+0000 front 2019-11-29T03:33:12.908827+0000 (oldest deadline 2019-11-29T03:33:58.180053+0000) 2019-11-29T03:34:09.314 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:34:09.310+0000 1694c700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:14.409371+0000 front 2019-11-29T03:33:14.351821+0000 (oldest deadline 2019-11-29T03:33:59.611597+0000) 2019-11-29T03:34:09.424 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:34:09.418+0000 1694c700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.792426+0000 front 2019-11-29T03:33:16.843086+0000 (oldest deadline 2019-11-29T03:34:00.760480+0000) 2019-11-29T03:34:09.452 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:34:09.448+0000 1694c700 -1 osd.2 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.690376+0000 front 2019-11-29T03:33:17.121072+0000 (oldest deadline 2019-11-29T03:33:59.562244+0000) 2019-11-29T03:34:09.465 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:34:09.462+0000 1694c700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.338373+0000 front 2019-11-29T03:33:16.355911+0000 (oldest deadline 2019-11-29T03:33:58.024226+0000) 2019-11-29T03:34:09.762 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:34:09.757+0000 1694c700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:18.698359+0000 front 2019-11-29T03:33:17.780293+0000 (oldest deadline 2019-11-29T03:33:58.729633+0000) 2019-11-29T03:34:09.860 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:34:09.855+0000 1694c700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:17.763898+0000 front 2019-11-29T03:33:17.774494+0000 (oldest deadline 2019-11-29T03:33:59.600601+0000) 2019-11-29T03:34:10.183 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:34:10.172+0000 1694c700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:12.912646+0000 front 2019-11-29T03:33:12.908827+0000 (oldest deadline 2019-11-29T03:33:58.180053+0000) 2019-11-29T03:34:10.315 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:34:10.311+0000 1694c700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:14.409371+0000 front 2019-11-29T03:33:14.351821+0000 (oldest deadline 2019-11-29T03:33:59.611597+0000) 2019-11-29T03:34:10.434 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:34:10.428+0000 1694c700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.792426+0000 front 2019-11-29T03:33:16.843086+0000 (oldest deadline 2019-11-29T03:34:00.760480+0000) 2019-11-29T03:34:10.460 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:34:10.456+0000 1694c700 -1 osd.2 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.690376+0000 front 2019-11-29T03:33:17.121072+0000 (oldest deadline 2019-11-29T03:33:59.562244+0000) 2019-11-29T03:34:10.472 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:34:10.468+0000 1694c700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.338373+0000 front 2019-11-29T03:33:16.355911+0000 (oldest deadline 2019-11-29T03:33:58.024226+0000) 2019-11-29T03:34:10.726 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:34:10.721+0000 1694c700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:18.698359+0000 front 2019-11-29T03:33:17.780293+0000 (oldest deadline 2019-11-29T03:33:58.729633+0000) 2019-11-29T03:34:10.877 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:34:10.871+0000 1694c700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:17.763898+0000 front 2019-11-29T03:33:17.774494+0000 (oldest deadline 2019-11-29T03:33:59.600601+0000) 2019-11-29T03:34:11.232 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:34:11.226+0000 1694c700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:12.912646+0000 front 2019-11-29T03:33:12.908827+0000 (oldest deadline 2019-11-29T03:33:58.180053+0000) 2019-11-29T03:34:11.367 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:34:11.363+0000 1694c700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:14.409371+0000 front 2019-11-29T03:33:14.351821+0000 (oldest deadline 2019-11-29T03:33:59.611597+0000) 2019-11-29T03:34:11.437 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:34:11.430+0000 1694c700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.792426+0000 front 2019-11-29T03:33:16.843086+0000 (oldest deadline 2019-11-29T03:34:00.760480+0000) 2019-11-29T03:34:11.448 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:34:11.444+0000 1694c700 -1 osd.2 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.690376+0000 front 2019-11-29T03:33:17.121072+0000 (oldest deadline 2019-11-29T03:33:59.562244+0000) 2019-11-29T03:34:11.501 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:34:11.497+0000 1694c700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.338373+0000 front 2019-11-29T03:33:16.355911+0000 (oldest deadline 2019-11-29T03:33:58.024226+0000) 2019-11-29T03:34:11.683 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:34:11.677+0000 1694c700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:18.698359+0000 front 2019-11-29T03:33:17.780293+0000 (oldest deadline 2019-11-29T03:33:58.729633+0000) 2019-11-29T03:34:11.899 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:34:11.894+0000 1694c700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:17.763898+0000 front 2019-11-29T03:33:17.774494+0000 (oldest deadline 2019-11-29T03:33:59.600601+0000) 2019-11-29T03:34:12.225 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:34:12.218+0000 1694c700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:12.912646+0000 front 2019-11-29T03:33:12.908827+0000 (oldest deadline 2019-11-29T03:33:58.180053+0000) 2019-11-29T03:34:12.410 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:34:12.406+0000 1694c700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:14.409371+0000 front 2019-11-29T03:33:14.351821+0000 (oldest deadline 2019-11-29T03:33:59.611597+0000) 2019-11-29T03:34:12.412 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:34:12.406+0000 1694c700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.792426+0000 front 2019-11-29T03:33:16.843086+0000 (oldest deadline 2019-11-29T03:34:00.760480+0000) 2019-11-29T03:34:12.467 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:34:12.463+0000 1694c700 -1 osd.2 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.690376+0000 front 2019-11-29T03:33:17.121072+0000 (oldest deadline 2019-11-29T03:33:59.562244+0000) 2019-11-29T03:34:12.509 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:34:12.505+0000 1694c700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.338373+0000 front 2019-11-29T03:33:16.355911+0000 (oldest deadline 2019-11-29T03:33:58.024226+0000) 2019-11-29T03:34:12.672 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:34:12.665+0000 1694c700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:18.698359+0000 front 2019-11-29T03:33:17.780293+0000 (oldest deadline 2019-11-29T03:33:58.729633+0000) 2019-11-29T03:34:12.887 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:34:12.882+0000 1694c700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:17.763898+0000 front 2019-11-29T03:33:17.774494+0000 (oldest deadline 2019-11-29T03:33:59.600601+0000) 2019-11-29T03:34:13.195 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:34:13.190+0000 1694c700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:12.912646+0000 front 2019-11-29T03:33:12.908827+0000 (oldest deadline 2019-11-29T03:33:58.180053+0000) 2019-11-29T03:34:13.376 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:34:13.370+0000 1694c700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.792426+0000 front 2019-11-29T03:33:16.843086+0000 (oldest deadline 2019-11-29T03:34:00.760480+0000) 2019-11-29T03:34:13.436 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:34:13.433+0000 1694c700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:14.409371+0000 front 2019-11-29T03:33:14.351821+0000 (oldest deadline 2019-11-29T03:33:59.611597+0000) 2019-11-29T03:34:13.508 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:34:13.503+0000 1694c700 -1 osd.2 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.690376+0000 front 2019-11-29T03:33:17.121072+0000 (oldest deadline 2019-11-29T03:33:59.562244+0000) 2019-11-29T03:34:13.536 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:34:13.532+0000 1694c700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.338373+0000 front 2019-11-29T03:33:16.355911+0000 (oldest deadline 2019-11-29T03:33:58.024226+0000) 2019-11-29T03:34:13.694 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:34:13.689+0000 1694c700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:18.698359+0000 front 2019-11-29T03:33:17.780293+0000 (oldest deadline 2019-11-29T03:33:58.729633+0000) 2019-11-29T03:34:13.852 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:34:13.847+0000 1694c700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:17.763898+0000 front 2019-11-29T03:33:17.774494+0000 (oldest deadline 2019-11-29T03:33:59.600601+0000) 2019-11-29T03:34:14.208 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:34:14.202+0000 1694c700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:12.912646+0000 front 2019-11-29T03:33:12.908827+0000 (oldest deadline 2019-11-29T03:33:58.180053+0000) 2019-11-29T03:34:14.354 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:34:14.349+0000 1694c700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.792426+0000 front 2019-11-29T03:33:16.843086+0000 (oldest deadline 2019-11-29T03:34:00.760480+0000) 2019-11-29T03:34:14.397 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:34:14.393+0000 1694c700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:14.409371+0000 front 2019-11-29T03:33:14.351821+0000 (oldest deadline 2019-11-29T03:33:59.611597+0000) 2019-11-29T03:34:14.478 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:34:14.474+0000 1694c700 -1 osd.2 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.690376+0000 front 2019-11-29T03:33:17.121072+0000 (oldest deadline 2019-11-29T03:33:59.562244+0000) 2019-11-29T03:34:14.568 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:34:14.564+0000 1694c700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.338373+0000 front 2019-11-29T03:33:16.355911+0000 (oldest deadline 2019-11-29T03:33:58.024226+0000) 2019-11-29T03:34:14.723 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:34:14.717+0000 1694c700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:18.698359+0000 front 2019-11-29T03:33:17.780293+0000 (oldest deadline 2019-11-29T03:33:58.729633+0000) 2019-11-29T03:34:14.826 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:34:14.821+0000 1694c700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:17.763898+0000 front 2019-11-29T03:33:17.774494+0000 (oldest deadline 2019-11-29T03:33:59.600601+0000) 2019-11-29T03:34:15.168 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:34:15.162+0000 1694c700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:12.912646+0000 front 2019-11-29T03:33:12.908827+0000 (oldest deadline 2019-11-29T03:33:58.180053+0000) 2019-11-29T03:34:15.354 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:34:15.349+0000 1694c700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.792426+0000 front 2019-11-29T03:33:16.843086+0000 (oldest deadline 2019-11-29T03:34:00.760480+0000) 2019-11-29T03:34:15.384 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:34:15.381+0000 1694c700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:14.409371+0000 front 2019-11-29T03:33:14.351821+0000 (oldest deadline 2019-11-29T03:33:59.611597+0000) 2019-11-29T03:34:15.464 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:34:15.461+0000 1694c700 -1 osd.2 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.690376+0000 front 2019-11-29T03:33:17.121072+0000 (oldest deadline 2019-11-29T03:33:59.562244+0000) 2019-11-29T03:34:15.585 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:34:15.578+0000 1694c700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.338373+0000 front 2019-11-29T03:33:16.355911+0000 (oldest deadline 2019-11-29T03:33:58.024226+0000) 2019-11-29T03:34:15.751 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:34:15.745+0000 1694c700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:18.698359+0000 front 2019-11-29T03:33:17.780293+0000 (oldest deadline 2019-11-29T03:33:58.729633+0000) 2019-11-29T03:34:15.814 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:34:15.809+0000 1694c700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:17.763898+0000 front 2019-11-29T03:33:17.774494+0000 (oldest deadline 2019-11-29T03:33:59.600601+0000) 2019-11-29T03:34:16.147 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:34:16.141+0000 1694c700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:12.912646+0000 front 2019-11-29T03:33:12.908827+0000 (oldest deadline 2019-11-29T03:33:58.180053+0000) 2019-11-29T03:34:16.323 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:34:16.317+0000 1694c700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.792426+0000 front 2019-11-29T03:33:16.843086+0000 (oldest deadline 2019-11-29T03:34:00.760480+0000) 2019-11-29T03:34:16.371 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:34:16.367+0000 1694c700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:14.409371+0000 front 2019-11-29T03:33:14.351821+0000 (oldest deadline 2019-11-29T03:33:59.611597+0000) 2019-11-29T03:34:16.429 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:34:16.425+0000 1694c700 -1 osd.2 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.690376+0000 front 2019-11-29T03:33:17.121072+0000 (oldest deadline 2019-11-29T03:33:59.562244+0000) 2019-11-29T03:34:16.607 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:34:16.604+0000 1694c700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.338373+0000 front 2019-11-29T03:33:16.355911+0000 (oldest deadline 2019-11-29T03:33:58.024226+0000) 2019-11-29T03:34:16.778 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:34:16.772+0000 1694c700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:18.698359+0000 front 2019-11-29T03:33:17.780293+0000 (oldest deadline 2019-11-29T03:33:58.729633+0000) 2019-11-29T03:34:16.819 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:34:16.813+0000 1694c700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:17.763898+0000 front 2019-11-29T03:33:17.774494+0000 (oldest deadline 2019-11-29T03:33:59.600601+0000) 2019-11-29T03:34:17.187 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:34:17.181+0000 1694c700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:12.912646+0000 front 2019-11-29T03:33:12.908827+0000 (oldest deadline 2019-11-29T03:33:58.180053+0000) 2019-11-29T03:34:17.336 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:34:17.330+0000 1694c700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.792426+0000 front 2019-11-29T03:33:16.843086+0000 (oldest deadline 2019-11-29T03:34:00.760480+0000) 2019-11-29T03:34:17.357 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:34:17.354+0000 1694c700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:14.409371+0000 front 2019-11-29T03:33:14.351821+0000 (oldest deadline 2019-11-29T03:33:59.611597+0000) 2019-11-29T03:34:17.404 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:34:17.400+0000 1694c700 -1 osd.2 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.690376+0000 front 2019-11-29T03:33:17.121072+0000 (oldest deadline 2019-11-29T03:33:59.562244+0000) 2019-11-29T03:34:17.637 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:34:17.633+0000 1694c700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.338373+0000 front 2019-11-29T03:33:16.355911+0000 (oldest deadline 2019-11-29T03:33:58.024226+0000) 2019-11-29T03:34:17.795 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:34:17.789+0000 1694c700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:18.698359+0000 front 2019-11-29T03:33:17.780293+0000 (oldest deadline 2019-11-29T03:33:58.729633+0000) 2019-11-29T03:34:17.812 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:34:17.806+0000 1694c700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:17.763898+0000 front 2019-11-29T03:33:17.774494+0000 (oldest deadline 2019-11-29T03:33:59.600601+0000) 2019-11-29T03:34:18.190 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:34:18.184+0000 1694c700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:12.912646+0000 front 2019-11-29T03:33:12.908827+0000 (oldest deadline 2019-11-29T03:33:58.180053+0000) 2019-11-29T03:34:18.382 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:34:18.376+0000 1694c700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.792426+0000 front 2019-11-29T03:33:16.843086+0000 (oldest deadline 2019-11-29T03:34:00.760480+0000) 2019-11-29T03:34:18.386 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:34:18.382+0000 1694c700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:14.409371+0000 front 2019-11-29T03:33:14.351821+0000 (oldest deadline 2019-11-29T03:33:59.611597+0000) 2019-11-29T03:34:18.399 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:34:18.395+0000 1694c700 -1 osd.2 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.690376+0000 front 2019-11-29T03:33:17.121072+0000 (oldest deadline 2019-11-29T03:33:59.562244+0000) 2019-11-29T03:34:18.627 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:34:18.622+0000 1694c700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.338373+0000 front 2019-11-29T03:33:16.355911+0000 (oldest deadline 2019-11-29T03:33:58.024226+0000) 2019-11-29T03:34:18.788 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:34:18.783+0000 1694c700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:18.698359+0000 front 2019-11-29T03:33:17.780293+0000 (oldest deadline 2019-11-29T03:33:58.729633+0000) 2019-11-29T03:34:18.800 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:34:18.795+0000 1694c700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:17.763898+0000 front 2019-11-29T03:33:17.774494+0000 (oldest deadline 2019-11-29T03:33:59.600601+0000) 2019-11-29T03:34:19.207 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:34:19.201+0000 1694c700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:12.912646+0000 front 2019-11-29T03:33:12.908827+0000 (oldest deadline 2019-11-29T03:33:58.180053+0000) 2019-11-29T03:34:19.345 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:34:19.342+0000 1694c700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:14.409371+0000 front 2019-11-29T03:33:14.351821+0000 (oldest deadline 2019-11-29T03:33:59.611597+0000) 2019-11-29T03:34:19.361 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:34:19.356+0000 1694c700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.792426+0000 front 2019-11-29T03:33:16.843086+0000 (oldest deadline 2019-11-29T03:34:00.760480+0000) 2019-11-29T03:34:19.408 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:34:19.404+0000 1694c700 -1 osd.2 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.690376+0000 front 2019-11-29T03:33:17.121072+0000 (oldest deadline 2019-11-29T03:33:59.562244+0000) 2019-11-29T03:34:19.676 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:34:19.673+0000 1694c700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.338373+0000 front 2019-11-29T03:33:16.355911+0000 (oldest deadline 2019-11-29T03:33:58.024226+0000) 2019-11-29T03:34:19.746 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:34:19.741+0000 1694c700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:18.698359+0000 front 2019-11-29T03:33:17.780293+0000 (oldest deadline 2019-11-29T03:33:58.729633+0000) 2019-11-29T03:34:19.794 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:34:19.786+0000 1694c700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:17.763898+0000 front 2019-11-29T03:33:17.774494+0000 (oldest deadline 2019-11-29T03:33:59.600601+0000) 2019-11-29T03:34:20.202 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:34:20.196+0000 1694c700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:12.912646+0000 front 2019-11-29T03:33:12.908827+0000 (oldest deadline 2019-11-29T03:33:58.180053+0000) 2019-11-29T03:34:20.366 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:34:20.362+0000 1694c700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:14.409371+0000 front 2019-11-29T03:33:14.351821+0000 (oldest deadline 2019-11-29T03:33:59.611597+0000) 2019-11-29T03:34:20.376 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:34:20.373+0000 1694c700 -1 osd.2 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.690376+0000 front 2019-11-29T03:33:17.121072+0000 (oldest deadline 2019-11-29T03:33:59.562244+0000) 2019-11-29T03:34:20.396 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:34:20.389+0000 1694c700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.792426+0000 front 2019-11-29T03:33:16.843086+0000 (oldest deadline 2019-11-29T03:34:00.760480+0000) 2019-11-29T03:34:20.724 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:34:20.721+0000 1694c700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.338373+0000 front 2019-11-29T03:33:16.355911+0000 (oldest deadline 2019-11-29T03:33:58.024226+0000) 2019-11-29T03:34:20.757 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:34:20.751+0000 1694c700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:18.698359+0000 front 2019-11-29T03:33:17.780293+0000 (oldest deadline 2019-11-29T03:33:58.729633+0000) 2019-11-29T03:34:20.845 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:34:20.839+0000 1694c700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:17.763898+0000 front 2019-11-29T03:33:17.774494+0000 (oldest deadline 2019-11-29T03:33:59.600601+0000) 2019-11-29T03:34:21.180 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:34:21.175+0000 1694c700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:12.912646+0000 front 2019-11-29T03:33:12.908827+0000 (oldest deadline 2019-11-29T03:33:58.180053+0000) 2019-11-29T03:34:21.352 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:34:21.347+0000 1694c700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.792426+0000 front 2019-11-29T03:33:16.843086+0000 (oldest deadline 2019-11-29T03:34:00.760480+0000) 2019-11-29T03:34:21.355 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:34:21.352+0000 1694c700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:14.409371+0000 front 2019-11-29T03:33:14.351821+0000 (oldest deadline 2019-11-29T03:33:59.611597+0000) 2019-11-29T03:34:21.403 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:34:21.400+0000 1694c700 -1 osd.2 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.690376+0000 front 2019-11-29T03:33:17.121072+0000 (oldest deadline 2019-11-29T03:33:59.562244+0000) 2019-11-29T03:34:21.728 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:34:21.725+0000 1694c700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.338373+0000 front 2019-11-29T03:33:16.355911+0000 (oldest deadline 2019-11-29T03:33:58.024226+0000) 2019-11-29T03:34:21.790 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:34:21.785+0000 1694c700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:18.698359+0000 front 2019-11-29T03:33:17.780293+0000 (oldest deadline 2019-11-29T03:33:58.729633+0000) 2019-11-29T03:34:21.814 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:34:21.807+0000 1694c700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:17.763898+0000 front 2019-11-29T03:33:17.774494+0000 (oldest deadline 2019-11-29T03:33:59.600601+0000) 2019-11-29T03:34:22.143 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:34:22.136+0000 1694c700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:12.912646+0000 front 2019-11-29T03:33:12.908827+0000 (oldest deadline 2019-11-29T03:33:58.180053+0000) 2019-11-29T03:34:22.345 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:34:22.339+0000 1694c700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.792426+0000 front 2019-11-29T03:33:16.843086+0000 (oldest deadline 2019-11-29T03:34:00.760480+0000) 2019-11-29T03:34:22.390 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:34:22.387+0000 1694c700 -1 osd.2 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.690376+0000 front 2019-11-29T03:33:17.121072+0000 (oldest deadline 2019-11-29T03:33:59.562244+0000) 2019-11-29T03:34:22.399 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:34:22.396+0000 1694c700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:14.409371+0000 front 2019-11-29T03:33:14.351821+0000 (oldest deadline 2019-11-29T03:33:59.611597+0000) 2019-11-29T03:34:22.701 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:34:22.696+0000 1694c700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.338373+0000 front 2019-11-29T03:33:16.355911+0000 (oldest deadline 2019-11-29T03:33:58.024226+0000) 2019-11-29T03:34:22.788 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:34:22.782+0000 1694c700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:17.763898+0000 front 2019-11-29T03:33:17.774494+0000 (oldest deadline 2019-11-29T03:33:59.600601+0000) 2019-11-29T03:34:22.844 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:34:22.838+0000 1694c700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:18.698359+0000 front 2019-11-29T03:33:17.780293+0000 (oldest deadline 2019-11-29T03:33:58.729633+0000) 2019-11-29T03:34:23.146 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:34:23.141+0000 1694c700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:12.912646+0000 front 2019-11-29T03:33:12.908827+0000 (oldest deadline 2019-11-29T03:33:58.180053+0000) 2019-11-29T03:34:23.358 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:34:23.352+0000 1694c700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.792426+0000 front 2019-11-29T03:33:16.843086+0000 (oldest deadline 2019-11-29T03:34:00.760480+0000) 2019-11-29T03:34:23.390 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:34:23.386+0000 1694c700 -1 osd.2 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.690376+0000 front 2019-11-29T03:33:17.121072+0000 (oldest deadline 2019-11-29T03:33:59.562244+0000) 2019-11-29T03:34:23.418 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:34:23.415+0000 1694c700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:14.409371+0000 front 2019-11-29T03:33:14.351821+0000 (oldest deadline 2019-11-29T03:33:59.611597+0000) 2019-11-29T03:34:23.755 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:34:23.750+0000 1694c700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.338373+0000 front 2019-11-29T03:33:16.355911+0000 (oldest deadline 2019-11-29T03:33:58.024226+0000) 2019-11-29T03:34:23.770 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:34:23.764+0000 1694c700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:17.763898+0000 front 2019-11-29T03:33:17.774494+0000 (oldest deadline 2019-11-29T03:33:59.600601+0000) 2019-11-29T03:34:23.812 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:34:23.806+0000 1694c700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:18.698359+0000 front 2019-11-29T03:33:17.780293+0000 (oldest deadline 2019-11-29T03:33:58.729633+0000) 2019-11-29T03:34:24.176 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:34:24.170+0000 1694c700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:12.912646+0000 front 2019-11-29T03:33:12.908827+0000 (oldest deadline 2019-11-29T03:33:58.180053+0000) 2019-11-29T03:34:24.406 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:34:24.402+0000 1694c700 -1 osd.2 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.690376+0000 front 2019-11-29T03:33:17.121072+0000 (oldest deadline 2019-11-29T03:33:59.562244+0000) 2019-11-29T03:34:24.412 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:34:24.406+0000 1694c700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.792426+0000 front 2019-11-29T03:33:16.843086+0000 (oldest deadline 2019-11-29T03:34:00.760480+0000) 2019-11-29T03:34:24.455 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:34:24.451+0000 1694c700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:14.409371+0000 front 2019-11-29T03:33:14.351821+0000 (oldest deadline 2019-11-29T03:33:59.611597+0000) 2019-11-29T03:34:24.789 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:34:24.783+0000 1694c700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:17.763898+0000 front 2019-11-29T03:33:17.774494+0000 (oldest deadline 2019-11-29T03:33:59.600601+0000) 2019-11-29T03:34:24.807 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:34:24.804+0000 1694c700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.338373+0000 front 2019-11-29T03:33:16.355911+0000 (oldest deadline 2019-11-29T03:33:58.024226+0000) 2019-11-29T03:34:24.832 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:34:24.827+0000 1694c700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:18.698359+0000 front 2019-11-29T03:33:17.780293+0000 (oldest deadline 2019-11-29T03:33:58.729633+0000) 2019-11-29T03:34:25.143 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:34:25.137+0000 1694c700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:12.912646+0000 front 2019-11-29T03:33:12.908827+0000 (oldest deadline 2019-11-29T03:33:58.180053+0000) 2019-11-29T03:34:25.368 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:34:25.360+0000 1694c700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.792426+0000 front 2019-11-29T03:33:16.843086+0000 (oldest deadline 2019-11-29T03:34:00.760480+0000) 2019-11-29T03:34:25.393 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:34:25.390+0000 1694c700 -1 osd.2 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.690376+0000 front 2019-11-29T03:33:17.121072+0000 (oldest deadline 2019-11-29T03:33:59.562244+0000) 2019-11-29T03:34:25.416 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:34:25.413+0000 1694c700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:14.409371+0000 front 2019-11-29T03:33:14.351821+0000 (oldest deadline 2019-11-29T03:33:59.611597+0000) 2019-11-29T03:34:25.767 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:34:25.760+0000 1694c700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:17.763898+0000 front 2019-11-29T03:33:17.774494+0000 (oldest deadline 2019-11-29T03:33:59.600601+0000) 2019-11-29T03:34:25.786 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:34:25.783+0000 1694c700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.338373+0000 front 2019-11-29T03:33:16.355911+0000 (oldest deadline 2019-11-29T03:33:58.024226+0000) 2019-11-29T03:34:25.885 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:34:25.879+0000 1694c700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:18.698359+0000 front 2019-11-29T03:33:17.780293+0000 (oldest deadline 2019-11-29T03:33:58.729633+0000) 2019-11-29T03:34:26.168 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:34:26.162+0000 1694c700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:12.912646+0000 front 2019-11-29T03:33:12.908827+0000 (oldest deadline 2019-11-29T03:33:58.180053+0000) 2019-11-29T03:34:26.369 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:34:26.366+0000 1694c700 -1 osd.2 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.690376+0000 front 2019-11-29T03:33:17.121072+0000 (oldest deadline 2019-11-29T03:33:59.562244+0000) 2019-11-29T03:34:26.377 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:34:26.371+0000 1694c700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.792426+0000 front 2019-11-29T03:33:16.843086+0000 (oldest deadline 2019-11-29T03:34:00.760480+0000) 2019-11-29T03:34:26.384 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:34:26.381+0000 1694c700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:14.409371+0000 front 2019-11-29T03:33:14.351821+0000 (oldest deadline 2019-11-29T03:33:59.611597+0000) 2019-11-29T03:34:26.778 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:34:26.771+0000 1694c700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:17.763898+0000 front 2019-11-29T03:33:17.774494+0000 (oldest deadline 2019-11-29T03:33:59.600601+0000) 2019-11-29T03:34:26.834 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:34:26.830+0000 1694c700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.338373+0000 front 2019-11-29T03:33:16.355911+0000 (oldest deadline 2019-11-29T03:33:58.024226+0000) 2019-11-29T03:34:26.920 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:34:26.914+0000 1694c700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:18.698359+0000 front 2019-11-29T03:33:17.780293+0000 (oldest deadline 2019-11-29T03:33:58.729633+0000) 2019-11-29T03:34:27.165 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:34:27.158+0000 1694c700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:12.912646+0000 front 2019-11-29T03:33:12.908827+0000 (oldest deadline 2019-11-29T03:33:58.180053+0000) 2019-11-29T03:34:27.377 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:34:27.370+0000 1694c700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.792426+0000 front 2019-11-29T03:33:16.843086+0000 (oldest deadline 2019-11-29T03:34:00.760480+0000) 2019-11-29T03:34:27.412 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:34:27.407+0000 1694c700 -1 osd.2 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.690376+0000 front 2019-11-29T03:33:17.121072+0000 (oldest deadline 2019-11-29T03:33:59.562244+0000) 2019-11-29T03:34:27.429 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:34:27.425+0000 1694c700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:14.409371+0000 front 2019-11-29T03:33:14.351821+0000 (oldest deadline 2019-11-29T03:33:59.611597+0000) 2019-11-29T03:34:27.795 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:34:27.789+0000 1694c700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:17.763898+0000 front 2019-11-29T03:33:17.774494+0000 (oldest deadline 2019-11-29T03:33:59.600601+0000) 2019-11-29T03:34:27.822 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:34:27.818+0000 1694c700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.338373+0000 front 2019-11-29T03:33:16.355911+0000 (oldest deadline 2019-11-29T03:33:58.024226+0000) 2019-11-29T03:34:27.894 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:34:27.887+0000 1694c700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:18.698359+0000 front 2019-11-29T03:33:17.780293+0000 (oldest deadline 2019-11-29T03:33:58.729633+0000) 2019-11-29T03:34:28.138 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:34:28.131+0000 1694c700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:12.912646+0000 front 2019-11-29T03:33:12.908827+0000 (oldest deadline 2019-11-29T03:33:58.180053+0000) 2019-11-29T03:34:28.381 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:34:28.373+0000 1694c700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.792426+0000 front 2019-11-29T03:33:16.843086+0000 (oldest deadline 2019-11-29T03:34:00.760480+0000) 2019-11-29T03:34:28.412 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:34:28.408+0000 1694c700 -1 osd.2 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.690376+0000 front 2019-11-29T03:33:17.121072+0000 (oldest deadline 2019-11-29T03:33:59.562244+0000) 2019-11-29T03:34:28.474 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:34:28.470+0000 1694c700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:14.409371+0000 front 2019-11-29T03:33:14.351821+0000 (oldest deadline 2019-11-29T03:33:59.611597+0000) 2019-11-29T03:34:28.765 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:34:28.759+0000 1694c700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:17.763898+0000 front 2019-11-29T03:33:17.774494+0000 (oldest deadline 2019-11-29T03:33:59.600601+0000) 2019-11-29T03:34:28.821 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:34:28.818+0000 1694c700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.338373+0000 front 2019-11-29T03:33:16.355911+0000 (oldest deadline 2019-11-29T03:33:58.024226+0000) 2019-11-29T03:34:28.916 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:34:28.911+0000 1694c700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:18.698359+0000 front 2019-11-29T03:33:17.780293+0000 (oldest deadline 2019-11-29T03:33:58.729633+0000) 2019-11-29T03:34:29.128 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:34:29.122+0000 1694c700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:12.912646+0000 front 2019-11-29T03:33:12.908827+0000 (oldest deadline 2019-11-29T03:33:58.180053+0000) 2019-11-29T03:34:29.393 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:34:29.391+0000 1694c700 -1 osd.2 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.690376+0000 front 2019-11-29T03:33:17.121072+0000 (oldest deadline 2019-11-29T03:33:59.562244+0000) 2019-11-29T03:34:29.396 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:34:29.391+0000 1694c700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.792426+0000 front 2019-11-29T03:33:16.843086+0000 (oldest deadline 2019-11-29T03:34:00.760480+0000) 2019-11-29T03:34:29.486 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:34:29.484+0000 1694c700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:14.409371+0000 front 2019-11-29T03:33:14.351821+0000 (oldest deadline 2019-11-29T03:33:59.611597+0000) 2019-11-29T03:34:29.783 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:34:29.777+0000 1694c700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:17.763898+0000 front 2019-11-29T03:33:17.774494+0000 (oldest deadline 2019-11-29T03:33:59.600601+0000) 2019-11-29T03:34:29.840 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:34:29.837+0000 1694c700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.338373+0000 front 2019-11-29T03:33:16.355911+0000 (oldest deadline 2019-11-29T03:33:58.024226+0000) 2019-11-29T03:34:29.947 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:34:29.941+0000 1694c700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:18.698359+0000 front 2019-11-29T03:33:17.780293+0000 (oldest deadline 2019-11-29T03:33:58.729633+0000) 2019-11-29T03:34:30.112 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:34:30.106+0000 1694c700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:12.912646+0000 front 2019-11-29T03:33:12.908827+0000 (oldest deadline 2019-11-29T03:33:58.180053+0000) 2019-11-29T03:34:30.399 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:34:30.396+0000 1694c700 -1 osd.2 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.690376+0000 front 2019-11-29T03:33:17.121072+0000 (oldest deadline 2019-11-29T03:33:59.562244+0000) 2019-11-29T03:34:30.445 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:34:30.439+0000 1694c700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.792426+0000 front 2019-11-29T03:33:16.843086+0000 (oldest deadline 2019-11-29T03:34:00.760480+0000) 2019-11-29T03:34:30.482 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:34:30.479+0000 1694c700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:14.409371+0000 front 2019-11-29T03:33:14.351821+0000 (oldest deadline 2019-11-29T03:33:59.611597+0000) 2019-11-29T03:34:30.783 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:34:30.777+0000 1694c700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:17.763898+0000 front 2019-11-29T03:33:17.774494+0000 (oldest deadline 2019-11-29T03:33:59.600601+0000) 2019-11-29T03:34:30.826 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:34:30.824+0000 1694c700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.338373+0000 front 2019-11-29T03:33:16.355911+0000 (oldest deadline 2019-11-29T03:33:58.024226+0000) 2019-11-29T03:34:30.992 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:34:30.986+0000 1694c700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:18.698359+0000 front 2019-11-29T03:33:17.780293+0000 (oldest deadline 2019-11-29T03:33:58.729633+0000) 2019-11-29T03:34:31.069 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:34:31.062+0000 1694c700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:12.912646+0000 front 2019-11-29T03:33:12.908827+0000 (oldest deadline 2019-11-29T03:33:58.180053+0000) 2019-11-29T03:34:31.419 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:34:31.412+0000 1694c700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.792426+0000 front 2019-11-29T03:33:16.843086+0000 (oldest deadline 2019-11-29T03:34:00.760480+0000) 2019-11-29T03:34:31.452 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:34:31.449+0000 1694c700 -1 osd.2 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.690376+0000 front 2019-11-29T03:33:17.121072+0000 (oldest deadline 2019-11-29T03:33:59.562244+0000) 2019-11-29T03:34:31.468 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:34:31.465+0000 1694c700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:14.409371+0000 front 2019-11-29T03:33:14.351821+0000 (oldest deadline 2019-11-29T03:33:59.611597+0000) 2019-11-29T03:34:31.800 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:34:31.795+0000 1694c700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:17.763898+0000 front 2019-11-29T03:33:17.774494+0000 (oldest deadline 2019-11-29T03:33:59.600601+0000) 2019-11-29T03:34:31.851 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:34:31.847+0000 1694c700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.338373+0000 front 2019-11-29T03:33:16.355911+0000 (oldest deadline 2019-11-29T03:33:58.024226+0000) 2019-11-29T03:34:32.003 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:34:31.997+0000 1694c700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:18.698359+0000 front 2019-11-29T03:33:17.780293+0000 (oldest deadline 2019-11-29T03:33:58.729633+0000) 2019-11-29T03:34:32.103 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:34:32.097+0000 1694c700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:12.912646+0000 front 2019-11-29T03:33:12.908827+0000 (oldest deadline 2019-11-29T03:33:58.180053+0000) 2019-11-29T03:34:32.417 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:34:32.414+0000 1694c700 -1 osd.2 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.690376+0000 front 2019-11-29T03:33:17.121072+0000 (oldest deadline 2019-11-29T03:33:59.562244+0000) 2019-11-29T03:34:32.440 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:34:32.437+0000 1694c700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:14.409371+0000 front 2019-11-29T03:33:14.351821+0000 (oldest deadline 2019-11-29T03:33:59.611597+0000) 2019-11-29T03:34:32.467 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:34:32.462+0000 1694c700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.792426+0000 front 2019-11-29T03:33:16.843086+0000 (oldest deadline 2019-11-29T03:34:00.760480+0000) 2019-11-29T03:34:32.826 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:34:32.823+0000 1694c700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.338373+0000 front 2019-11-29T03:33:16.355911+0000 (oldest deadline 2019-11-29T03:33:58.024226+0000) 2019-11-29T03:34:32.846 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:34:32.841+0000 1694c700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:17.763898+0000 front 2019-11-29T03:33:17.774494+0000 (oldest deadline 2019-11-29T03:33:59.600601+0000) 2019-11-29T03:34:32.976 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:34:32.971+0000 1694c700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:18.698359+0000 front 2019-11-29T03:33:17.780293+0000 (oldest deadline 2019-11-29T03:33:58.729633+0000) 2019-11-29T03:34:33.127 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:34:33.121+0000 1694c700 -1 osd.7 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:12.912646+0000 front 2019-11-29T03:33:12.908827+0000 (oldest deadline 2019-11-29T03:33:58.180053+0000) 2019-11-29T03:34:33.418 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:34:33.416+0000 1694c700 -1 osd.2 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.690376+0000 front 2019-11-29T03:33:17.121072+0000 (oldest deadline 2019-11-29T03:33:59.562244+0000) 2019-11-29T03:34:33.442 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:34:33.436+0000 1694c700 -1 osd.5 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.792426+0000 front 2019-11-29T03:33:16.843086+0000 (oldest deadline 2019-11-29T03:34:00.760480+0000) 2019-11-29T03:34:33.460 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:34:33.458+0000 1694c700 -1 osd.0 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:14.409371+0000 front 2019-11-29T03:33:14.351821+0000 (oldest deadline 2019-11-29T03:33:59.611597+0000) 2019-11-29T03:34:33.877 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:34:33.874+0000 1694c700 -1 osd.1 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:16.338373+0000 front 2019-11-29T03:33:16.355911+0000 (oldest deadline 2019-11-29T03:33:58.024226+0000) 2019-11-29T03:34:33.895 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:34:33.889+0000 1694c700 -1 osd.4 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:17.763898+0000 front 2019-11-29T03:33:17.774494+0000 (oldest deadline 2019-11-29T03:33:59.600601+0000) 2019-11-29T03:34:33.898 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:34:33.893+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.74:6802/10096,v1:172.21.15.74:6803/10096] for 46sec e275 v275) 2019-11-29T03:34:33.984 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:34:33.979+0000 1694c700 -1 osd.6 275 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:33:18.698359+0000 front 2019-11-29T03:33:17.780293+0000 (oldest deadline 2019-11-29T03:33:58.729633+0000) 2019-11-29T03:35:07.410 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:35:07.331+0000 36588700 -1 osd.2 279 build_incremental_map_msg missing incremental map 279 2019-11-29T03:35:07.579 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:35:07.512+0000 34584700 -1 osd.2 279 build_incremental_map_msg missing incremental map 279 2019-11-29T03:35:07.632 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:35:07.537+0000 37d8b700 -1 osd.2 279 build_incremental_map_msg missing incremental map 279 2019-11-29T03:35:10.132 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:10.120+0000 31783700 -1 osd.3 281 build_incremental_map_msg missing incremental map 281 2019-11-29T03:35:10.240 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:10.170+0000 31f84700 -1 osd.3 281 build_incremental_map_msg missing incremental map 281 2019-11-29T03:35:10.326 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:10.248+0000 35f8c700 -1 osd.3 281 build_incremental_map_msg missing incremental map 281 2019-11-29T03:35:10.349 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:10.254+0000 33787700 -1 osd.3 281 build_incremental_map_msg missing incremental map 281 2019-11-29T03:35:10.478 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:10.354+0000 33787700 -1 osd.3 281 build_incremental_map_msg missing incremental map 281 2019-11-29T03:35:10.920 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:10.722+0000 38f92700 -1 osd.3 281 build_incremental_map_msg missing incremental map 281 2019-11-29T03:35:10.954 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:10.731+0000 3678d700 -1 osd.3 281 build_incremental_map_msg missing incremental map 281 2019-11-29T03:35:11.100 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:10.902+0000 32f86700 -1 osd.3 281 build_incremental_map_msg missing incremental map 281 2019-11-29T03:35:11.559 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:11.546+0000 34789700 -1 osd.3 281 build_incremental_map_msg missing incremental map 281 2019-11-29T03:35:23.260 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:35:23.257+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:35:24.284 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:35:24.282+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:35:24.373 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:35:24.371+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:35:24.426 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:35:24.424+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:35:25.294 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:35:25.292+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:35:25.421 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:35:25.420+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:35:25.451 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:35:25.449+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:35:26.300 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:35:26.297+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:35:26.426 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:35:26.423+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:35:26.467 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:35:26.464+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:35:27.274 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:35:27.272+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:35:27.395 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:35:27.388+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:35:27.448 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:35:27.441+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:35:27.565 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:35:27.561+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:35:28.246 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:35:28.242+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:35:28.356 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:35:28.353+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:35:28.398 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:35:28.394+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:35:28.585 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:35:28.580+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:35:29.299 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:35:29.296+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:35:29.318 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:35:29.313+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:35:29.382 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:35:29.378+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:35:29.628 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:35:29.623+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:35:30.288 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:35:30.285+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:35:30.304 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:35:30.301+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:35:30.365 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:35:30.361+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:35:30.598 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:35:30.593+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:35:31.288 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:35:31.284+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:35:31.341 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:35:31.337+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:35:31.406 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:35:31.402+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:35:31.599 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:35:31.593+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:35:32.312 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:35:32.308+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:35:32.339 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:35:32.336+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:35:32.398 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:35:32.394+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:35:32.604 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:35:32.599+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:35:33.314 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:35:33.310+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:35:33.327 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:35:33.324+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:35:33.380 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:35:33.376+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:35:33.561 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:35:33.556+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:35:34.313 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:35:34.310+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:35:34.350 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:35:34.347+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:35:34.376 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:35:34.373+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:35:34.420 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:35:34.415+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:35:34.543 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:35:34.538+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:35:34.855 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:35:34.849+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:35:35.355 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:35:35.352+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:35:35.365 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:35:35.362+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:35:35.389 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:35:35.386+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:35:35.409 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:35:35.404+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:35:35.576 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:35:35.571+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:35:35.588 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:49:17.806 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:35:35.595 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:49:17.813 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:35:35.606 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:49:17.825 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:35:35.607 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:49:17.836 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:35:35.611 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:49:17.831 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:35:35.617 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:49:17.846 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:35:35.831 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:35:35.826+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:35:35.868 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:49:18.094 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:35:35.873 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:49:18.090 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:35:35.974 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:49:18.194 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:35:36.339 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:35:36.336+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:35:36.344 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:35:36.341+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:35:36.380 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:35:36.376+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:35:36.412 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:35:36.406+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:35:36.569 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:35:36.564+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:35:36.852 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:35:36.846+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:35:37.330 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:35:37.327+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:35:37.388 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:35:37.385+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:35:37.397 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:35:37.394+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:35:37.440 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:35:37.435+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:35:37.562 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:35:37.557+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:35:37.880 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:35:37.875+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:35:38.356 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:35:38.353+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:35:38.377 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:35:38.373+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:35:38.423 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:35:38.421+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:35:38.484 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:35:38.479+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:35:38.568 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:35:38.563+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:35:38.933 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:35:38.928+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:35:39.376 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:35:39.373+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:35:39.404 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:35:39.401+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:35:39.422 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:35:39.419+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:35:39.489 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:35:39.485+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:35:39.623 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:35:39.616+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:35:39.715 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:39.712+0000 1694c700 -1 osd.3 281 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e279) 2019-11-29T03:35:39.928 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:35:39.924+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:35:40.380 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:35:40.377+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:35:40.412 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:35:40.410+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:35:40.443 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:35:40.440+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:35:40.535 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:35:40.529+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:35:40.595 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:35:40.589+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:35:40.682 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:40.679+0000 1694c700 -1 osd.3 281 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e279) 2019-11-29T03:35:40.951 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:35:40.946+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:35:41.336 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:35:41.332+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:35:41.451 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:35:41.447+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:35:41.452 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:35:41.448+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:35:41.503 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:35:41.499+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:35:41.569 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:35:41.565+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:35:41.667 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:41.663+0000 1694c700 -1 osd.3 281 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e279) 2019-11-29T03:35:41.980 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:35:41.975+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:35:42.319 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:35:42.315+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:35:42.444 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:35:42.441+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:35:42.493 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:35:42.487+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:35:42.493 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:35:42.490+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:35:42.576 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:35:42.570+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:35:42.651 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:42.648+0000 1694c700 -1 osd.3 281 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e279) 2019-11-29T03:35:42.994 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:35:42.988+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:35:43.340 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:35:43.337+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:35:43.458 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:35:43.454+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:35:43.477 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:35:43.474+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:35:43.491 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:35:43.488+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:35:43.584 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:35:43.579+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:35:43.647 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:43.644+0000 1694c700 -1 osd.3 281 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e279) 2019-11-29T03:35:43.946 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:35:43.942+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:35:44.315 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:35:44.312+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:35:44.427 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:35:44.423+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:35:44.468 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:35:44.464+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:35:44.487 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:35:44.483+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:35:44.626 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:35:44.621+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:35:44.664 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:44.661+0000 1694c700 -1 osd.3 281 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e279) 2019-11-29T03:35:44.982 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:35:44.977+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:35:45.311 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:35:45.306+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:35:45.452 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:35:45.447+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:35:45.477 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:35:45.474+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:35:45.499 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:35:45.496+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:35:45.659 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:45.654+0000 1694c700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:35:05.344724+0000 (oldest deadline 2019-11-29T03:35:45.344724+0000) 2019-11-29T03:35:45.660 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:45.656+0000 1694c700 -1 osd.3 281 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e279) 2019-11-29T03:35:45.665 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:35:45.659+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:35:45.999 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:35:45.994+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:35:46.319 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:35:46.316+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:35:46.470 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:35:46.467+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:35:46.489 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:35:46.485+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:35:46.503 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:35:46.500+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:35:46.652 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:46.649+0000 1694c700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:35:05.344724+0000 (oldest deadline 2019-11-29T03:35:45.344724+0000) 2019-11-29T03:35:46.652 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:46.650+0000 1694c700 -1 osd.3 281 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e279) 2019-11-29T03:35:46.711 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:35:46.706+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:35:46.986 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:35:46.981+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:35:47.312 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:35:47.308+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:35:47.501 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:35:47.493+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:35:47.502 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:35:47.498+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:35:47.511 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:35:47.506+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:35:47.676 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:35:47.671+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:35:47.695 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:47.692+0000 1694c700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:35:05.344724+0000 (oldest deadline 2019-11-29T03:35:45.344724+0000) 2019-11-29T03:35:47.699 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:47.696+0000 1694c700 -1 osd.3 281 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e279) 2019-11-29T03:35:47.977 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:35:47.972+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:35:48.286 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:35:48.282+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:35:48.510 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:35:48.506+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:35:48.518 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:35:48.515+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:35:48.534 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:35:48.528+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:35:48.700 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:48.695+0000 1694c700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:35:05.344724+0000 (oldest deadline 2019-11-29T03:35:45.344724+0000) 2019-11-29T03:35:48.701 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:48.697+0000 1694c700 -1 osd.3 281 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e279) 2019-11-29T03:35:48.706 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:35:48.702+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:35:48.951 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:35:48.946+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:35:49.245 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:35:49.241+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:35:49.479 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:35:49.475+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:35:49.547 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:35:49.541+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:35:49.549 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:35:49.546+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:35:49.673 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:35:49.668+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:35:49.745 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:49.741+0000 1694c700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:35:05.344724+0000 (oldest deadline 2019-11-29T03:35:45.344724+0000) 2019-11-29T03:35:49.746 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:49.743+0000 1694c700 -1 osd.3 281 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e279) 2019-11-29T03:35:49.949 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:35:49.945+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:35:50.252 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:35:50.248+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:35:50.526 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:35:50.520+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:35:50.546 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:35:50.540+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:35:50.574 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:35:50.570+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:35:50.670 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:35:50.665+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:35:50.787 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:50.783+0000 1694c700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:35:05.344724+0000 (oldest deadline 2019-11-29T03:35:45.344724+0000) 2019-11-29T03:35:50.788 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:50.785+0000 1694c700 -1 osd.3 281 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e279) 2019-11-29T03:35:50.926 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:35:50.922+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:35:51.269 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:35:51.266+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:35:51.536 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:35:51.532+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:35:51.571 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:35:51.568+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:35:51.591 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:35:51.587+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:35:51.710 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:35:51.705+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:35:51.764 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:51.760+0000 1694c700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:35:05.344724+0000 (oldest deadline 2019-11-29T03:35:45.344724+0000) 2019-11-29T03:35:51.765 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:51.761+0000 1694c700 -1 osd.3 281 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e279) 2019-11-29T03:35:51.938 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:35:51.933+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:35:52.254 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:35:52.250+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:35:52.510 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:35:52.506+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:35:52.570 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:35:52.562+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:35:52.582 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:35:52.577+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:35:52.667 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:35:52.662+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:35:52.770 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:52.765+0000 1694c700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:35:05.344724+0000 (oldest deadline 2019-11-29T03:35:45.344724+0000) 2019-11-29T03:35:52.771 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:52.767+0000 1694c700 -1 osd.3 281 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e279) 2019-11-29T03:35:52.936 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:35:52.931+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:35:53.243 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:35:53.239+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:35:53.550 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:35:53.547+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:35:53.569 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:35:53.564+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:35:53.610 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:35:53.607+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:35:53.650 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:35:53.645+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:35:53.796 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:53.789+0000 1694c700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:35:05.344724+0000 (oldest deadline 2019-11-29T03:35:45.344724+0000) 2019-11-29T03:35:53.796 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:53.793+0000 1694c700 -1 osd.3 281 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e279) 2019-11-29T03:35:53.959 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:35:53.953+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:35:54.246 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:35:54.243+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:35:54.512 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:35:54.509+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:35:54.583 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:35:54.576+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:35:54.584 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:35:54.581+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:35:54.680 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:35:54.675+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:35:54.812 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:54.807+0000 1694c700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:35:05.344724+0000 (oldest deadline 2019-11-29T03:35:45.344724+0000) 2019-11-29T03:35:54.813 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:54.809+0000 1694c700 -1 osd.3 281 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e279) 2019-11-29T03:35:54.985 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:35:54.980+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:35:55.211 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:35:55.207+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:35:55.508 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:35:55.505+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:35:55.573 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:35:55.567+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:35:55.579 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:35:55.576+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:35:55.708 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:35:55.703+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:35:55.803 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:55.799+0000 1694c700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:35:05.344724+0000 (oldest deadline 2019-11-29T03:35:45.344724+0000) 2019-11-29T03:35:55.804 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:55.801+0000 1694c700 -1 osd.3 281 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e279) 2019-11-29T03:35:56.005 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:35:56.001+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:35:56.181 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:35:56.177+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:35:56.552 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:35:56.549+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:35:56.588 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:35:56.585+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:35:56.598 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:35:56.593+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:35:56.719 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:35:56.713+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:35:56.796 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:56.791+0000 1694c700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:35:05.344724+0000 (oldest deadline 2019-11-29T03:35:45.344724+0000) 2019-11-29T03:35:56.798 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:56.793+0000 1694c700 -1 osd.3 281 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e279) 2019-11-29T03:35:56.960 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:35:56.955+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:35:57.170 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:35:57.167+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:35:57.592 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:35:57.588+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:35:57.601 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:35:57.598+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:35:57.616 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:35:57.611+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:35:57.745 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:35:57.741+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:35:57.844 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:57.839+0000 1694c700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:35:05.344724+0000 (oldest deadline 2019-11-29T03:35:45.344724+0000) 2019-11-29T03:35:57.845 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:57.841+0000 1694c700 -1 osd.3 281 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e279) 2019-11-29T03:35:58.005 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:35:57.999+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:35:58.133 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:35:58.129+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:35:58.550 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:35:58.546+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:35:58.652 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:35:58.644+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:35:58.652 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:35:58.640+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:35:58.736 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:35:58.731+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:35:58.897 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:58.893+0000 1694c700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:35:05.344724+0000 (oldest deadline 2019-11-29T03:35:45.344724+0000) 2019-11-29T03:35:58.899 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:58.896+0000 1694c700 -1 osd.3 281 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e279) 2019-11-29T03:35:59.059 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:35:59.053+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:35:59.140 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:35:59.139+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 35sec e281 v281) 2019-11-29T03:35:59.153 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:35:59.151+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:35:59.557 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:35:59.555+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:35:59.613 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:35:59.607+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:35:59.675 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:35:59.673+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:35:59.715 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:35:59.709+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:35:59.953 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:59.949+0000 1694c700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:35:05.344724+0000 (oldest deadline 2019-11-29T03:35:45.344724+0000) 2019-11-29T03:35:59.953 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:35:59.951+0000 1694c700 -1 osd.3 281 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e279) 2019-11-29T03:36:00.029 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:36:00.023+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:36:00.148 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:36:00.145+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:36:00.598 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:36:00.592+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:36:00.612 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:36:00.609+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:36:00.651 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:36:00.649+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:36:00.711 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:36:00.705+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:36:00.947 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:36:00.944+0000 1694c700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:35:05.344724+0000 (oldest deadline 2019-11-29T03:35:45.344724+0000) 2019-11-29T03:36:00.951 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:36:00.949+0000 1694c700 -1 osd.3 281 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e279) 2019-11-29T03:36:01.003 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:36:00.996+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:36:01.186 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:36:01.184+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:36:01.562 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:36:01.557+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:36:01.660 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:36:01.657+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:36:01.679 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:36:01.676+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:36:01.687 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:36:01.680+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:36:01.996 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:36:01.991+0000 1694c700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:35:05.344724+0000 (oldest deadline 2019-11-29T03:35:45.344724+0000) 2019-11-29T03:36:01.996 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:36:01.989+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:36:01.997 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:36:01.993+0000 1694c700 -1 osd.3 281 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e279) 2019-11-29T03:36:02.228 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:36:02.226+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:36:02.602 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:36:02.595+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:36:02.659 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:36:02.653+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:36:02.695 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:36:02.692+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:36:02.717 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:36:02.713+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:36:02.953 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:36:02.947+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:36:03.036 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:36:03.032+0000 1694c700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:35:05.344724+0000 (oldest deadline 2019-11-29T03:35:45.344724+0000) 2019-11-29T03:36:03.037 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:36:03.034+0000 1694c700 -1 osd.3 281 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e279) 2019-11-29T03:36:03.238 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:36:03.235+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:36:03.567 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:36:03.561+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:36:03.698 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:36:03.695+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:36:03.706 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:36:03.704+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:36:03.707 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:36:03.702+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:36:04.007 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:36:04.001+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:36:04.032 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:36:04.028+0000 1694c700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:35:05.344724+0000 (oldest deadline 2019-11-29T03:35:45.344724+0000) 2019-11-29T03:36:04.033 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:36:04.030+0000 1694c700 -1 osd.3 281 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e279) 2019-11-29T03:36:04.162 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:36:04.157+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 35sec e281 v281) 2019-11-29T03:36:04.249 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:36:04.246+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:36:04.619 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:36:04.614+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:36:04.690 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:36:04.684+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:36:04.698 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:36:04.695+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:36:04.706 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:36:04.703+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:36:05.056 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:36:05.050+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:36:05.075 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:36:05.071+0000 1694c700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:35:05.344724+0000 (oldest deadline 2019-11-29T03:35:45.344724+0000) 2019-11-29T03:36:05.075 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:36:05.073+0000 1694c700 -1 osd.3 281 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e279) 2019-11-29T03:36:05.252 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:36:05.249+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:36:05.589 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:36:05.585+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:36:05.682 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:36:05.680+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:36:05.691 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:36:05.688+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:36:05.698 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:36:05.693+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:36:06.069 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:36:06.062+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:36:06.101 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:36:06.098+0000 1694c700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:35:05.344724+0000 (oldest deadline 2019-11-29T03:35:45.344724+0000) 2019-11-29T03:36:06.102 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:36:06.099+0000 1694c700 -1 osd.3 281 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e279) 2019-11-29T03:36:06.256 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:36:06.253+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:36:06.559 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:36:06.553+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:36:06.661 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:36:06.659+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:36:06.680 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:36:06.675+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:36:06.687 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:36:06.685+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:36:07.042 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:36:07.037+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:36:07.067 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:36:07.063+0000 1694c700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:35:05.344724+0000 (oldest deadline 2019-11-29T03:35:45.344724+0000) 2019-11-29T03:36:07.068 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:36:07.065+0000 1694c700 -1 osd.3 281 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e279) 2019-11-29T03:36:07.303 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:36:07.301+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:36:07.556 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:36:07.546+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:36:07.664 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:36:07.662+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:36:07.697 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:36:07.692+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:36:07.699 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:36:07.696+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:36:08.008 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:36:08.001+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:36:08.075 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:36:08.072+0000 1694c700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:35:05.344724+0000 (oldest deadline 2019-11-29T03:35:45.344724+0000) 2019-11-29T03:36:08.079 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:36:08.076+0000 1694c700 -1 osd.3 281 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e279) 2019-11-29T03:36:08.327 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:36:08.325+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:36:08.524 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:36:08.518+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:36:08.623 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:36:08.621+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:36:08.692 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:36:08.689+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:36:08.693 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:36:08.688+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:36:09.051 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:36:09.045+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:36:09.100 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:36:09.097+0000 1694c700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:35:05.344724+0000 (oldest deadline 2019-11-29T03:35:45.344724+0000) 2019-11-29T03:36:09.100 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:36:09.098+0000 1694c700 -1 osd.3 281 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e279) 2019-11-29T03:36:09.211 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:36:09.209+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 35sec e281 v281) 2019-11-29T03:36:09.323 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:36:09.321+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:36:09.502 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:36:09.497+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:36:09.647 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:36:09.645+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:36:09.706 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:36:09.703+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:36:09.726 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:36:09.721+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:36:10.072 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:36:10.067+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:36:10.131 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:36:10.129+0000 1694c700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:35:05.344724+0000 (oldest deadline 2019-11-29T03:35:45.344724+0000) 2019-11-29T03:36:10.133 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:36:10.132+0000 1694c700 -1 osd.3 281 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e279) 2019-11-29T03:36:10.290 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:36:10.287+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:36:10.485 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:36:10.481+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:36:10.644 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:36:10.642+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:36:10.720 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:36:10.711+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:36:10.734 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:36:10.732+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:36:11.098 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:36:11.081+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:36:11.171 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:36:11.162+0000 1694c700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:35:05.344724+0000 (oldest deadline 2019-11-29T03:35:45.344724+0000) 2019-11-29T03:36:11.172 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:36:11.164+0000 1694c700 -1 osd.3 281 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e279) 2019-11-29T03:36:11.287 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:36:11.284+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:36:11.502 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:36:11.497+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:36:11.646 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:36:11.643+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:36:11.761 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:36:11.756+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:36:11.773 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:36:11.770+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:36:12.052 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:36:12.048+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:36:12.183 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:36:12.180+0000 1694c700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:35:05.344724+0000 (oldest deadline 2019-11-29T03:35:45.344724+0000) 2019-11-29T03:36:12.184 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:36:12.181+0000 1694c700 -1 osd.3 281 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e279) 2019-11-29T03:36:12.318 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:36:12.315+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:36:12.534 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:36:12.530+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:36:12.609 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:36:12.607+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:36:12.762 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:36:12.756+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:36:12.771 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:36:12.769+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:36:13.037 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:36:13.032+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:36:13.193 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:36:13.188+0000 1694c700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:35:05.344724+0000 (oldest deadline 2019-11-29T03:35:45.344724+0000) 2019-11-29T03:36:13.194 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:36:13.190+0000 1694c700 -1 osd.3 281 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e279) 2019-11-29T03:36:13.345 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:36:13.342+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:36:13.550 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:36:13.546+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:36:13.617 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:36:13.613+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:36:13.722 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:36:13.717+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:36:13.729 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:36:13.726+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:36:14.051 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:36:14.046+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:36:14.175 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:36:14.170+0000 1694c700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:35:05.344724+0000 (oldest deadline 2019-11-29T03:35:45.344724+0000) 2019-11-29T03:36:14.176 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:36:14.172+0000 1694c700 -1 osd.3 281 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e279) 2019-11-29T03:36:14.239 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:36:14.224+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 35sec e281 v281) 2019-11-29T03:36:14.387 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:36:14.384+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:36:14.506 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:36:14.501+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:36:14.645 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:36:14.641+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:36:14.704 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:36:14.698+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:36:14.720 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:36:14.716+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:36:15.041 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:36:15.036+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:36:15.210 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:36:15.206+0000 1694c700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:35:05.344724+0000 (oldest deadline 2019-11-29T03:35:45.344724+0000) 2019-11-29T03:36:15.213 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:36:15.211+0000 1694c700 -1 osd.3 281 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e279) 2019-11-29T03:36:15.431 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:36:15.428+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:36:15.537 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:36:15.528+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:36:15.601 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:36:15.597+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:36:15.713 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:36:15.709+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:36:15.730 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:36:15.724+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:36:16.011 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:36:16.006+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:36:16.210 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:36:16.205+0000 1694c700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:35:05.344724+0000 (oldest deadline 2019-11-29T03:35:45.344724+0000) 2019-11-29T03:36:16.210 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:36:16.207+0000 1694c700 -1 osd.3 281 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e279) 2019-11-29T03:36:16.417 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:36:16.413+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:36:16.561 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:36:16.554+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:36:16.650 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:36:16.647+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:36:16.712 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:36:16.706+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:36:16.750 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:36:16.746+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:36:17.029 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:36:17.023+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:36:17.244 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:36:17.241+0000 1694c700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:35:05.344724+0000 (oldest deadline 2019-11-29T03:35:45.344724+0000) 2019-11-29T03:36:17.246 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:36:17.244+0000 1694c700 -1 osd.3 281 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e279) 2019-11-29T03:36:17.457 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:36:17.453+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:36:17.546 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:36:17.542+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:36:17.671 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:36:17.667+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:36:17.725 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:36:17.721+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:36:17.764 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:36:17.759+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:36:18.066 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:36:18.061+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:36:18.225 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:36:18.221+0000 1694c700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:35:05.344724+0000 (oldest deadline 2019-11-29T03:35:45.344724+0000) 2019-11-29T03:36:18.225 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:36:18.222+0000 1694c700 -1 osd.3 281 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e279) 2019-11-29T03:36:18.430 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:36:18.427+0000 1694c700 -1 osd.0 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.000599+0000 front 2019-11-29T03:34:41.866314+0000 (oldest deadline 2019-11-29T03:35:22.238233+0000) 2019-11-29T03:36:18.558 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:36:18.553+0000 1694c700 -1 osd.7 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.030186+0000 front 2019-11-29T03:34:51.628016+0000 (oldest deadline 2019-11-29T03:35:33.439209+0000) 2019-11-29T03:36:18.651 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:36:18.647+0000 1694c700 -1 osd.2 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.748175+0000 front 2019-11-29T03:34:49.777397+0000 (oldest deadline 2019-11-29T03:35:23.802247+0000) 2019-11-29T03:36:18.714 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:36:18.709+0000 1694c700 -1 osd.6 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:48.018683+0000 front 2019-11-29T03:34:51.625592+0000 (oldest deadline 2019-11-29T03:35:27.517244+0000) 2019-11-29T03:36:18.767 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:36:18.763+0000 1694c700 -1 osd.1 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:49.032059+0000 front 2019-11-29T03:34:50.734550+0000 (oldest deadline 2019-11-29T03:35:24.257167+0000) 2019-11-29T03:36:19.075 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:36:19.070+0000 1694c700 -1 osd.4 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:34:50.884128+0000 front 2019-11-29T03:34:50.888081+0000 (oldest deadline 2019-11-29T03:35:34.320320+0000) 2019-11-29T03:36:19.246 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:36:19.241+0000 1694c700 -1 osd.3 281 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:35:05.344724+0000 (oldest deadline 2019-11-29T03:35:45.344724+0000) 2019-11-29T03:36:19.247 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:36:19.243+0000 1694c700 -1 osd.3 281 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e279) 2019-11-29T03:36:19.303 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:36:19.300+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 35sec e281 v281) 2019-11-29T03:36:20.003 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:36:19.955+0000 33f88700 -1 osd.3 282 build_incremental_map_msg missing incremental map 281 2019-11-29T03:37:48.741 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:37:48.735+0000 1694c700 -1 osd.4 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:02.725588+0000 front 2019-11-29T03:37:02.949228+0000 (oldest deadline 2019-11-29T03:37:47.988834+0000) 2019-11-29T03:37:49.147 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:37:49.141+0000 1694c700 -1 osd.7 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.851221+0000 front 2019-11-29T03:37:07.014118+0000 (oldest deadline 2019-11-29T03:37:48.421117+0000) 2019-11-29T03:37:49.646 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:37:49.643+0000 1694c700 -1 osd.2 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:03.392696+0000 front 2019-11-29T03:37:03.381104+0000 (oldest deadline 2019-11-29T03:37:49.276962+0000) 2019-11-29T03:37:49.714 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:37:49.709+0000 1694c700 -1 osd.4 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:02.725588+0000 front 2019-11-29T03:37:02.949228+0000 (oldest deadline 2019-11-29T03:37:47.988834+0000) 2019-11-29T03:37:50.185 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:37:50.179+0000 1694c700 -1 osd.7 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.851221+0000 front 2019-11-29T03:37:07.014118+0000 (oldest deadline 2019-11-29T03:37:48.421117+0000) 2019-11-29T03:37:50.566 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:37:50.561+0000 1694c700 -1 osd.6 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:05.241505+0000 front 2019-11-29T03:37:05.250205+0000 (oldest deadline 2019-11-29T03:37:49.900809+0000) 2019-11-29T03:37:50.624 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:37:50.620+0000 1694c700 -1 osd.2 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:03.392696+0000 front 2019-11-29T03:37:03.381104+0000 (oldest deadline 2019-11-29T03:37:49.276962+0000) 2019-11-29T03:37:50.702 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:37:50.696+0000 1694c700 -1 osd.4 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:02.725588+0000 front 2019-11-29T03:37:02.949228+0000 (oldest deadline 2019-11-29T03:37:47.988834+0000) 2019-11-29T03:37:51.196 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:37:51.189+0000 1694c700 -1 osd.7 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.851221+0000 front 2019-11-29T03:37:07.014118+0000 (oldest deadline 2019-11-29T03:37:48.421117+0000) 2019-11-29T03:37:51.612 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:37:51.607+0000 1694c700 -1 osd.2 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:03.392696+0000 front 2019-11-29T03:37:03.381104+0000 (oldest deadline 2019-11-29T03:37:49.276962+0000) 2019-11-29T03:37:51.613 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:37:51.608+0000 1694c700 -1 osd.6 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:05.241505+0000 front 2019-11-29T03:37:05.250205+0000 (oldest deadline 2019-11-29T03:37:49.900809+0000) 2019-11-29T03:37:51.626 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:37:51.622+0000 1694c700 -1 osd.0 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.810147+0000 front 2019-11-29T03:37:06.565502+0000 (oldest deadline 2019-11-29T03:37:50.653044+0000) 2019-11-29T03:37:51.717 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:37:51.712+0000 1694c700 -1 osd.4 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:02.725588+0000 front 2019-11-29T03:37:02.949228+0000 (oldest deadline 2019-11-29T03:37:47.988834+0000) 2019-11-29T03:37:52.250 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:37:52.244+0000 1694c700 -1 osd.7 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.851221+0000 front 2019-11-29T03:37:07.014118+0000 (oldest deadline 2019-11-29T03:37:48.421117+0000) 2019-11-29T03:37:52.622 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:37:52.619+0000 1694c700 -1 osd.2 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:03.392696+0000 front 2019-11-29T03:37:03.381104+0000 (oldest deadline 2019-11-29T03:37:49.276962+0000) 2019-11-29T03:37:52.662 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:37:52.657+0000 1694c700 -1 osd.6 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:05.241505+0000 front 2019-11-29T03:37:05.250205+0000 (oldest deadline 2019-11-29T03:37:49.900809+0000) 2019-11-29T03:37:52.677 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:37:52.673+0000 1694c700 -1 osd.0 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.810147+0000 front 2019-11-29T03:37:06.565502+0000 (oldest deadline 2019-11-29T03:37:50.653044+0000) 2019-11-29T03:37:52.678 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:37:52.672+0000 1694c700 -1 osd.4 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:02.725588+0000 front 2019-11-29T03:37:02.949228+0000 (oldest deadline 2019-11-29T03:37:47.988834+0000) 2019-11-29T03:37:52.822 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:37:52.819+0000 1694c700 -1 osd.1 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.467836+0000 front 2019-11-29T03:37:06.618144+0000 (oldest deadline 2019-11-29T03:37:52.324497+0000) 2019-11-29T03:37:53.261 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:37:53.255+0000 1694c700 -1 osd.7 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.851221+0000 front 2019-11-29T03:37:07.014118+0000 (oldest deadline 2019-11-29T03:37:48.421117+0000) 2019-11-29T03:37:53.365 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:37:53.359+0000 1694c700 -1 osd.5 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:07.271026+0000 front 2019-11-29T03:37:07.275380+0000 (oldest deadline 2019-11-29T03:37:52.527619+0000) 2019-11-29T03:37:53.626 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:37:53.623+0000 1694c700 -1 osd.2 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:03.392696+0000 front 2019-11-29T03:37:03.381104+0000 (oldest deadline 2019-11-29T03:37:49.276962+0000) 2019-11-29T03:37:53.653 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:37:53.647+0000 1694c700 -1 osd.6 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:05.241505+0000 front 2019-11-29T03:37:05.250205+0000 (oldest deadline 2019-11-29T03:37:49.900809+0000) 2019-11-29T03:37:53.665 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:37:53.661+0000 1694c700 -1 osd.0 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.810147+0000 front 2019-11-29T03:37:06.565502+0000 (oldest deadline 2019-11-29T03:37:50.653044+0000) 2019-11-29T03:37:53.696 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:37:53.686+0000 1694c700 -1 osd.4 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:02.725588+0000 front 2019-11-29T03:37:02.949228+0000 (oldest deadline 2019-11-29T03:37:47.988834+0000) 2019-11-29T03:37:53.775 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:37:53.771+0000 1694c700 -1 osd.1 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.467836+0000 front 2019-11-29T03:37:06.618144+0000 (oldest deadline 2019-11-29T03:37:52.324497+0000) 2019-11-29T03:37:54.275 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:37:54.270+0000 1694c700 -1 osd.7 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.851221+0000 front 2019-11-29T03:37:07.014118+0000 (oldest deadline 2019-11-29T03:37:48.421117+0000) 2019-11-29T03:37:54.365 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:37:54.358+0000 1694c700 -1 osd.5 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:07.271026+0000 front 2019-11-29T03:37:07.275380+0000 (oldest deadline 2019-11-29T03:37:52.527619+0000) 2019-11-29T03:37:54.646 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:37:54.640+0000 1694c700 -1 osd.4 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:02.725588+0000 front 2019-11-29T03:37:02.949228+0000 (oldest deadline 2019-11-29T03:37:47.988834+0000) 2019-11-29T03:37:54.656 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:37:54.651+0000 1694c700 -1 osd.6 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:05.241505+0000 front 2019-11-29T03:37:05.250205+0000 (oldest deadline 2019-11-29T03:37:49.900809+0000) 2019-11-29T03:37:54.669 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:37:54.666+0000 1694c700 -1 osd.2 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:03.392696+0000 front 2019-11-29T03:37:03.381104+0000 (oldest deadline 2019-11-29T03:37:49.276962+0000) 2019-11-29T03:37:54.681 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:37:54.678+0000 1694c700 -1 osd.0 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.810147+0000 front 2019-11-29T03:37:06.565502+0000 (oldest deadline 2019-11-29T03:37:50.653044+0000) 2019-11-29T03:37:54.806 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:37:54.803+0000 1694c700 -1 osd.1 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.467836+0000 front 2019-11-29T03:37:06.618144+0000 (oldest deadline 2019-11-29T03:37:52.324497+0000) 2019-11-29T03:37:55.320 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:37:55.314+0000 1694c700 -1 osd.7 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.851221+0000 front 2019-11-29T03:37:07.014118+0000 (oldest deadline 2019-11-29T03:37:48.421117+0000) 2019-11-29T03:37:55.322 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:37:55.316+0000 1694c700 -1 osd.5 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:07.271026+0000 front 2019-11-29T03:37:07.275380+0000 (oldest deadline 2019-11-29T03:37:52.527619+0000) 2019-11-29T03:37:55.630 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:37:55.626+0000 1694c700 -1 osd.2 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:03.392696+0000 front 2019-11-29T03:37:03.381104+0000 (oldest deadline 2019-11-29T03:37:49.276962+0000) 2019-11-29T03:37:55.657 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:37:55.651+0000 1694c700 -1 osd.4 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:02.725588+0000 front 2019-11-29T03:37:02.949228+0000 (oldest deadline 2019-11-29T03:37:47.988834+0000) 2019-11-29T03:37:55.666 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:37:55.662+0000 1694c700 -1 osd.0 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.810147+0000 front 2019-11-29T03:37:06.565502+0000 (oldest deadline 2019-11-29T03:37:50.653044+0000) 2019-11-29T03:37:55.681 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:37:55.675+0000 1694c700 -1 osd.6 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:05.241505+0000 front 2019-11-29T03:37:05.250205+0000 (oldest deadline 2019-11-29T03:37:49.900809+0000) 2019-11-29T03:37:55.855 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:37:55.852+0000 1694c700 -1 osd.1 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.467836+0000 front 2019-11-29T03:37:06.618144+0000 (oldest deadline 2019-11-29T03:37:52.324497+0000) 2019-11-29T03:37:56.297 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:37:56.291+0000 1694c700 -1 osd.5 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:07.271026+0000 front 2019-11-29T03:37:07.275380+0000 (oldest deadline 2019-11-29T03:37:52.527619+0000) 2019-11-29T03:37:56.358 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:37:56.353+0000 1694c700 -1 osd.7 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.851221+0000 front 2019-11-29T03:37:07.014118+0000 (oldest deadline 2019-11-29T03:37:48.421117+0000) 2019-11-29T03:37:56.640 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:37:56.635+0000 1694c700 -1 osd.4 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:02.725588+0000 front 2019-11-29T03:37:02.949228+0000 (oldest deadline 2019-11-29T03:37:47.988834+0000) 2019-11-29T03:37:56.648 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:37:56.645+0000 1694c700 -1 osd.2 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:03.392696+0000 front 2019-11-29T03:37:03.381104+0000 (oldest deadline 2019-11-29T03:37:49.276962+0000) 2019-11-29T03:37:56.667 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:37:56.663+0000 1694c700 -1 osd.0 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.810147+0000 front 2019-11-29T03:37:06.565502+0000 (oldest deadline 2019-11-29T03:37:50.653044+0000) 2019-11-29T03:37:56.695 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:37:56.689+0000 1694c700 -1 osd.6 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:05.241505+0000 front 2019-11-29T03:37:05.250205+0000 (oldest deadline 2019-11-29T03:37:49.900809+0000) 2019-11-29T03:37:56.892 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:37:56.887+0000 1694c700 -1 osd.1 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.467836+0000 front 2019-11-29T03:37:06.618144+0000 (oldest deadline 2019-11-29T03:37:52.324497+0000) 2019-11-29T03:37:57.323 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:37:57.318+0000 1694c700 -1 osd.7 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.851221+0000 front 2019-11-29T03:37:07.014118+0000 (oldest deadline 2019-11-29T03:37:48.421117+0000) 2019-11-29T03:37:57.324 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:37:57.319+0000 1694c700 -1 osd.5 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:07.271026+0000 front 2019-11-29T03:37:07.275380+0000 (oldest deadline 2019-11-29T03:37:52.527619+0000) 2019-11-29T03:37:57.648 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:37:57.644+0000 1694c700 -1 osd.0 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.810147+0000 front 2019-11-29T03:37:06.565502+0000 (oldest deadline 2019-11-29T03:37:50.653044+0000) 2019-11-29T03:37:57.668 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:37:57.663+0000 1694c700 -1 osd.2 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:03.392696+0000 front 2019-11-29T03:37:03.381104+0000 (oldest deadline 2019-11-29T03:37:49.276962+0000) 2019-11-29T03:37:57.676 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:37:57.667+0000 1694c700 -1 osd.4 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:02.725588+0000 front 2019-11-29T03:37:02.949228+0000 (oldest deadline 2019-11-29T03:37:47.988834+0000) 2019-11-29T03:37:57.719 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:37:57.712+0000 1694c700 -1 osd.6 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:05.241505+0000 front 2019-11-29T03:37:05.250205+0000 (oldest deadline 2019-11-29T03:37:49.900809+0000) 2019-11-29T03:37:57.899 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:37:57.896+0000 1694c700 -1 osd.1 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.467836+0000 front 2019-11-29T03:37:06.618144+0000 (oldest deadline 2019-11-29T03:37:52.324497+0000) 2019-11-29T03:37:58.283 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:37:58.276+0000 1694c700 -1 osd.5 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:07.271026+0000 front 2019-11-29T03:37:07.275380+0000 (oldest deadline 2019-11-29T03:37:52.527619+0000) 2019-11-29T03:37:58.399 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:37:58.371+0000 1694c700 -1 osd.7 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.851221+0000 front 2019-11-29T03:37:07.014118+0000 (oldest deadline 2019-11-29T03:37:48.421117+0000) 2019-11-29T03:37:58.610 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:37:58.606+0000 1694c700 -1 osd.0 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.810147+0000 front 2019-11-29T03:37:06.565502+0000 (oldest deadline 2019-11-29T03:37:50.653044+0000) 2019-11-29T03:37:58.676 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:37:58.672+0000 1694c700 -1 osd.2 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:03.392696+0000 front 2019-11-29T03:37:03.381104+0000 (oldest deadline 2019-11-29T03:37:49.276962+0000) 2019-11-29T03:37:58.695 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:37:58.690+0000 1694c700 -1 osd.4 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:02.725588+0000 front 2019-11-29T03:37:02.949228+0000 (oldest deadline 2019-11-29T03:37:47.988834+0000) 2019-11-29T03:37:58.752 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:37:58.746+0000 1694c700 -1 osd.6 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:05.241505+0000 front 2019-11-29T03:37:05.250205+0000 (oldest deadline 2019-11-29T03:37:49.900809+0000) 2019-11-29T03:37:58.875 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:37:58.870+0000 1694c700 -1 osd.1 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.467836+0000 front 2019-11-29T03:37:06.618144+0000 (oldest deadline 2019-11-29T03:37:52.324497+0000) 2019-11-29T03:37:59.274 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:37:59.268+0000 1694c700 -1 osd.5 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:07.271026+0000 front 2019-11-29T03:37:07.275380+0000 (oldest deadline 2019-11-29T03:37:52.527619+0000) 2019-11-29T03:37:59.421 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:37:59.416+0000 1694c700 -1 osd.7 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.851221+0000 front 2019-11-29T03:37:07.014118+0000 (oldest deadline 2019-11-29T03:37:48.421117+0000) 2019-11-29T03:37:59.594 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:37:59.590+0000 1694c700 -1 osd.0 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.810147+0000 front 2019-11-29T03:37:06.565502+0000 (oldest deadline 2019-11-29T03:37:50.653044+0000) 2019-11-29T03:37:59.671 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:37:59.668+0000 1694c700 -1 osd.2 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:03.392696+0000 front 2019-11-29T03:37:03.381104+0000 (oldest deadline 2019-11-29T03:37:49.276962+0000) 2019-11-29T03:37:59.725 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:37:59.720+0000 1694c700 -1 osd.6 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:05.241505+0000 front 2019-11-29T03:37:05.250205+0000 (oldest deadline 2019-11-29T03:37:49.900809+0000) 2019-11-29T03:37:59.734 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:37:59.728+0000 1694c700 -1 osd.4 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:02.725588+0000 front 2019-11-29T03:37:02.949228+0000 (oldest deadline 2019-11-29T03:37:47.988834+0000) 2019-11-29T03:37:59.847 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:37:59.843+0000 1694c700 -1 osd.1 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.467836+0000 front 2019-11-29T03:37:06.618144+0000 (oldest deadline 2019-11-29T03:37:52.324497+0000) 2019-11-29T03:38:00.315 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:38:00.309+0000 1694c700 -1 osd.5 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:07.271026+0000 front 2019-11-29T03:37:07.275380+0000 (oldest deadline 2019-11-29T03:37:52.527619+0000) 2019-11-29T03:38:00.391 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:38:00.385+0000 1694c700 -1 osd.7 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.851221+0000 front 2019-11-29T03:37:07.014118+0000 (oldest deadline 2019-11-29T03:37:48.421117+0000) 2019-11-29T03:38:00.568 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:38:00.565+0000 1694c700 -1 osd.0 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.810147+0000 front 2019-11-29T03:37:06.565502+0000 (oldest deadline 2019-11-29T03:37:50.653044+0000) 2019-11-29T03:38:00.635 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:38:00.631+0000 1694c700 -1 osd.2 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:03.392696+0000 front 2019-11-29T03:37:03.381104+0000 (oldest deadline 2019-11-29T03:37:49.276962+0000) 2019-11-29T03:38:00.708 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:38:00.703+0000 1694c700 -1 osd.6 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:05.241505+0000 front 2019-11-29T03:37:05.250205+0000 (oldest deadline 2019-11-29T03:37:49.900809+0000) 2019-11-29T03:38:00.769 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:38:00.763+0000 1694c700 -1 osd.4 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:02.725588+0000 front 2019-11-29T03:37:02.949228+0000 (oldest deadline 2019-11-29T03:37:47.988834+0000) 2019-11-29T03:38:00.815 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:38:00.810+0000 1694c700 -1 osd.1 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.467836+0000 front 2019-11-29T03:37:06.618144+0000 (oldest deadline 2019-11-29T03:37:52.324497+0000) 2019-11-29T03:38:01.362 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:38:01.356+0000 1694c700 -1 osd.5 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:07.271026+0000 front 2019-11-29T03:37:07.275380+0000 (oldest deadline 2019-11-29T03:37:52.527619+0000) 2019-11-29T03:38:01.367 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:38:01.361+0000 1694c700 -1 osd.7 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.851221+0000 front 2019-11-29T03:37:07.014118+0000 (oldest deadline 2019-11-29T03:37:48.421117+0000) 2019-11-29T03:38:01.574 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:38:01.569+0000 1694c700 -1 osd.0 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.810147+0000 front 2019-11-29T03:37:06.565502+0000 (oldest deadline 2019-11-29T03:37:50.653044+0000) 2019-11-29T03:38:01.598 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:38:01.594+0000 1694c700 -1 osd.2 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:03.392696+0000 front 2019-11-29T03:37:03.381104+0000 (oldest deadline 2019-11-29T03:37:49.276962+0000) 2019-11-29T03:38:01.729 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:38:01.723+0000 1694c700 -1 osd.6 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:05.241505+0000 front 2019-11-29T03:37:05.250205+0000 (oldest deadline 2019-11-29T03:37:49.900809+0000) 2019-11-29T03:38:01.807 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:38:01.801+0000 1694c700 -1 osd.4 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:02.725588+0000 front 2019-11-29T03:37:02.949228+0000 (oldest deadline 2019-11-29T03:37:47.988834+0000) 2019-11-29T03:38:01.859 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:38:01.855+0000 1694c700 -1 osd.1 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.467836+0000 front 2019-11-29T03:37:06.618144+0000 (oldest deadline 2019-11-29T03:37:52.324497+0000) 2019-11-29T03:38:02.324 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:38:02.318+0000 1694c700 -1 osd.7 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.851221+0000 front 2019-11-29T03:37:07.014118+0000 (oldest deadline 2019-11-29T03:37:48.421117+0000) 2019-11-29T03:38:02.344 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:38:02.339+0000 1694c700 -1 osd.5 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:07.271026+0000 front 2019-11-29T03:37:07.275380+0000 (oldest deadline 2019-11-29T03:37:52.527619+0000) 2019-11-29T03:38:02.591 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:38:02.587+0000 1694c700 -1 osd.0 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.810147+0000 front 2019-11-29T03:37:06.565502+0000 (oldest deadline 2019-11-29T03:37:50.653044+0000) 2019-11-29T03:38:02.611 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:38:02.607+0000 1694c700 -1 osd.2 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:03.392696+0000 front 2019-11-29T03:37:03.381104+0000 (oldest deadline 2019-11-29T03:37:49.276962+0000) 2019-11-29T03:38:02.771 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:38:02.765+0000 1694c700 -1 osd.6 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:05.241505+0000 front 2019-11-29T03:37:05.250205+0000 (oldest deadline 2019-11-29T03:37:49.900809+0000) 2019-11-29T03:38:02.845 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:38:02.839+0000 1694c700 -1 osd.4 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:02.725588+0000 front 2019-11-29T03:37:02.949228+0000 (oldest deadline 2019-11-29T03:37:47.988834+0000) 2019-11-29T03:38:02.854 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:38:02.850+0000 1694c700 -1 osd.1 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.467836+0000 front 2019-11-29T03:37:06.618144+0000 (oldest deadline 2019-11-29T03:37:52.324497+0000) 2019-11-29T03:38:03.312 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:38:03.306+0000 1694c700 -1 osd.7 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.851221+0000 front 2019-11-29T03:37:07.014118+0000 (oldest deadline 2019-11-29T03:37:48.421117+0000) 2019-11-29T03:38:03.345 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:38:03.338+0000 1694c700 -1 osd.5 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:07.271026+0000 front 2019-11-29T03:37:07.275380+0000 (oldest deadline 2019-11-29T03:37:52.527619+0000) 2019-11-29T03:38:03.602 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:38:03.584+0000 1694c700 -1 osd.2 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:03.392696+0000 front 2019-11-29T03:37:03.381104+0000 (oldest deadline 2019-11-29T03:37:49.276962+0000) 2019-11-29T03:38:03.620 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:38:03.607+0000 1694c700 -1 osd.0 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.810147+0000 front 2019-11-29T03:37:06.565502+0000 (oldest deadline 2019-11-29T03:37:50.653044+0000) 2019-11-29T03:38:03.812 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:38:03.802+0000 1694c700 -1 osd.6 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:05.241505+0000 front 2019-11-29T03:37:05.250205+0000 (oldest deadline 2019-11-29T03:37:49.900809+0000) 2019-11-29T03:38:03.815 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:38:03.806+0000 1694c700 -1 osd.1 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.467836+0000 front 2019-11-29T03:37:06.618144+0000 (oldest deadline 2019-11-29T03:37:52.324497+0000) 2019-11-29T03:38:03.864 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:38:03.856+0000 1694c700 -1 osd.4 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:02.725588+0000 front 2019-11-29T03:37:02.949228+0000 (oldest deadline 2019-11-29T03:37:47.988834+0000) 2019-11-29T03:38:04.313 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:38:04.307+0000 1694c700 -1 osd.7 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.851221+0000 front 2019-11-29T03:37:07.014118+0000 (oldest deadline 2019-11-29T03:37:48.421117+0000) 2019-11-29T03:38:04.393 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:38:04.388+0000 1694c700 -1 osd.5 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:07.271026+0000 front 2019-11-29T03:37:07.275380+0000 (oldest deadline 2019-11-29T03:37:52.527619+0000) 2019-11-29T03:38:04.570 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:38:04.567+0000 1694c700 -1 osd.0 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.810147+0000 front 2019-11-29T03:37:06.565502+0000 (oldest deadline 2019-11-29T03:37:50.653044+0000) 2019-11-29T03:38:04.604 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:38:04.601+0000 1694c700 -1 osd.2 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:03.392696+0000 front 2019-11-29T03:37:03.381104+0000 (oldest deadline 2019-11-29T03:37:49.276962+0000) 2019-11-29T03:38:04.770 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:38:04.767+0000 1694c700 -1 osd.1 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.467836+0000 front 2019-11-29T03:37:06.618144+0000 (oldest deadline 2019-11-29T03:37:52.324497+0000) 2019-11-29T03:38:04.838 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:38:04.833+0000 1694c700 -1 osd.6 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:05.241505+0000 front 2019-11-29T03:37:05.250205+0000 (oldest deadline 2019-11-29T03:37:49.900809+0000) 2019-11-29T03:38:04.914 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:38:04.909+0000 1694c700 -1 osd.4 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:02.725588+0000 front 2019-11-29T03:37:02.949228+0000 (oldest deadline 2019-11-29T03:37:47.988834+0000) 2019-11-29T03:38:05.301 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:38:05.296+0000 1694c700 -1 osd.7 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.851221+0000 front 2019-11-29T03:37:07.014118+0000 (oldest deadline 2019-11-29T03:37:48.421117+0000) 2019-11-29T03:38:05.365 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:38:05.359+0000 1694c700 -1 osd.5 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:07.271026+0000 front 2019-11-29T03:37:07.275380+0000 (oldest deadline 2019-11-29T03:37:52.527619+0000) 2019-11-29T03:38:05.585 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:38:05.582+0000 1694c700 -1 osd.2 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:03.392696+0000 front 2019-11-29T03:37:03.381104+0000 (oldest deadline 2019-11-29T03:37:49.276962+0000) 2019-11-29T03:38:05.624 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:38:05.620+0000 1694c700 -1 osd.0 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.810147+0000 front 2019-11-29T03:37:06.565502+0000 (oldest deadline 2019-11-29T03:37:50.653044+0000) 2019-11-29T03:38:05.767 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:38:05.764+0000 1694c700 -1 osd.1 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.467836+0000 front 2019-11-29T03:37:06.618144+0000 (oldest deadline 2019-11-29T03:37:52.324497+0000) 2019-11-29T03:38:05.839 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:38:05.834+0000 1694c700 -1 osd.6 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:05.241505+0000 front 2019-11-29T03:37:05.250205+0000 (oldest deadline 2019-11-29T03:37:49.900809+0000) 2019-11-29T03:38:05.893 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:38:05.887+0000 1694c700 -1 osd.4 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:02.725588+0000 front 2019-11-29T03:37:02.949228+0000 (oldest deadline 2019-11-29T03:37:47.988834+0000) 2019-11-29T03:38:06.336 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:38:06.330+0000 1694c700 -1 osd.7 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.851221+0000 front 2019-11-29T03:37:07.014118+0000 (oldest deadline 2019-11-29T03:37:48.421117+0000) 2019-11-29T03:38:06.376 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:38:06.370+0000 1694c700 -1 osd.5 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:07.271026+0000 front 2019-11-29T03:37:07.275380+0000 (oldest deadline 2019-11-29T03:37:52.527619+0000) 2019-11-29T03:38:06.590 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:38:06.586+0000 1694c700 -1 osd.2 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:03.392696+0000 front 2019-11-29T03:37:03.381104+0000 (oldest deadline 2019-11-29T03:37:49.276962+0000) 2019-11-29T03:38:06.655 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:38:06.650+0000 1694c700 -1 osd.0 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.810147+0000 front 2019-11-29T03:37:06.565502+0000 (oldest deadline 2019-11-29T03:37:50.653044+0000) 2019-11-29T03:38:06.759 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:38:06.756+0000 1694c700 -1 osd.1 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.467836+0000 front 2019-11-29T03:37:06.618144+0000 (oldest deadline 2019-11-29T03:37:52.324497+0000) 2019-11-29T03:38:06.839 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:38:06.834+0000 1694c700 -1 osd.6 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:05.241505+0000 front 2019-11-29T03:37:05.250205+0000 (oldest deadline 2019-11-29T03:37:49.900809+0000) 2019-11-29T03:38:06.945 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:38:06.940+0000 1694c700 -1 osd.4 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:02.725588+0000 front 2019-11-29T03:37:02.949228+0000 (oldest deadline 2019-11-29T03:37:47.988834+0000) 2019-11-29T03:38:07.296 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:38:07.290+0000 1694c700 -1 osd.7 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.851221+0000 front 2019-11-29T03:37:07.014118+0000 (oldest deadline 2019-11-29T03:37:48.421117+0000) 2019-11-29T03:38:07.387 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:38:07.381+0000 1694c700 -1 osd.5 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:07.271026+0000 front 2019-11-29T03:37:07.275380+0000 (oldest deadline 2019-11-29T03:37:52.527619+0000) 2019-11-29T03:38:07.640 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:38:07.638+0000 1694c700 -1 osd.2 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:03.392696+0000 front 2019-11-29T03:37:03.381104+0000 (oldest deadline 2019-11-29T03:37:49.276962+0000) 2019-11-29T03:38:07.691 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:38:07.688+0000 1694c700 -1 osd.0 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.810147+0000 front 2019-11-29T03:37:06.565502+0000 (oldest deadline 2019-11-29T03:37:50.653044+0000) 2019-11-29T03:38:07.775 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:38:07.772+0000 1694c700 -1 osd.1 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.467836+0000 front 2019-11-29T03:37:06.618144+0000 (oldest deadline 2019-11-29T03:37:52.324497+0000) 2019-11-29T03:38:07.824 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:38:07.818+0000 1694c700 -1 osd.6 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:05.241505+0000 front 2019-11-29T03:37:05.250205+0000 (oldest deadline 2019-11-29T03:37:49.900809+0000) 2019-11-29T03:38:07.930 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:38:07.925+0000 1694c700 -1 osd.4 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:02.725588+0000 front 2019-11-29T03:37:02.949228+0000 (oldest deadline 2019-11-29T03:37:47.988834+0000) 2019-11-29T03:38:08.315 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:38:08.309+0000 1694c700 -1 osd.7 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.851221+0000 front 2019-11-29T03:37:07.014118+0000 (oldest deadline 2019-11-29T03:37:48.421117+0000) 2019-11-29T03:38:08.365 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:38:08.359+0000 1694c700 -1 osd.5 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:07.271026+0000 front 2019-11-29T03:37:07.275380+0000 (oldest deadline 2019-11-29T03:37:52.527619+0000) 2019-11-29T03:38:08.642 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:38:08.638+0000 1694c700 -1 osd.2 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:03.392696+0000 front 2019-11-29T03:37:03.381104+0000 (oldest deadline 2019-11-29T03:37:49.276962+0000) 2019-11-29T03:38:08.689 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:38:08.684+0000 1694c700 -1 osd.0 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.810147+0000 front 2019-11-29T03:37:06.565502+0000 (oldest deadline 2019-11-29T03:37:50.653044+0000) 2019-11-29T03:38:08.747 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:38:08.744+0000 1694c700 -1 osd.1 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.467836+0000 front 2019-11-29T03:37:06.618144+0000 (oldest deadline 2019-11-29T03:37:52.324497+0000) 2019-11-29T03:38:08.800 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:38:08.794+0000 1694c700 -1 osd.6 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:05.241505+0000 front 2019-11-29T03:37:05.250205+0000 (oldest deadline 2019-11-29T03:37:49.900809+0000) 2019-11-29T03:38:08.962 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:38:08.955+0000 1694c700 -1 osd.4 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:02.725588+0000 front 2019-11-29T03:37:02.949228+0000 (oldest deadline 2019-11-29T03:37:47.988834+0000) 2019-11-29T03:38:09.284 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:38:09.278+0000 1694c700 -1 osd.7 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.851221+0000 front 2019-11-29T03:37:07.014118+0000 (oldest deadline 2019-11-29T03:37:48.421117+0000) 2019-11-29T03:38:09.327 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:38:09.321+0000 1694c700 -1 osd.5 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:07.271026+0000 front 2019-11-29T03:37:07.275380+0000 (oldest deadline 2019-11-29T03:37:52.527619+0000) 2019-11-29T03:38:09.637 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:38:09.634+0000 1694c700 -1 osd.2 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:03.392696+0000 front 2019-11-29T03:37:03.381104+0000 (oldest deadline 2019-11-29T03:37:49.276962+0000) 2019-11-29T03:38:09.709 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:38:09.706+0000 1694c700 -1 osd.1 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.467836+0000 front 2019-11-29T03:37:06.618144+0000 (oldest deadline 2019-11-29T03:37:52.324497+0000) 2019-11-29T03:38:09.734 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:38:09.731+0000 1694c700 -1 osd.0 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.810147+0000 front 2019-11-29T03:37:06.565502+0000 (oldest deadline 2019-11-29T03:37:50.653044+0000) 2019-11-29T03:38:09.780 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:38:09.775+0000 1694c700 -1 osd.6 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:05.241505+0000 front 2019-11-29T03:37:05.250205+0000 (oldest deadline 2019-11-29T03:37:49.900809+0000) 2019-11-29T03:38:09.926 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:38:09.920+0000 1694c700 -1 osd.4 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:02.725588+0000 front 2019-11-29T03:37:02.949228+0000 (oldest deadline 2019-11-29T03:37:47.988834+0000) 2019-11-29T03:38:10.317 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:38:10.311+0000 1694c700 -1 osd.5 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:07.271026+0000 front 2019-11-29T03:37:07.275380+0000 (oldest deadline 2019-11-29T03:37:52.527619+0000) 2019-11-29T03:38:10.333 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:38:10.329+0000 1694c700 -1 osd.7 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.851221+0000 front 2019-11-29T03:37:07.014118+0000 (oldest deadline 2019-11-29T03:37:48.421117+0000) 2019-11-29T03:38:10.628 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:38:10.624+0000 1694c700 -1 osd.2 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:03.392696+0000 front 2019-11-29T03:37:03.381104+0000 (oldest deadline 2019-11-29T03:37:49.276962+0000) 2019-11-29T03:38:10.743 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:38:10.740+0000 1694c700 -1 osd.1 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.467836+0000 front 2019-11-29T03:37:06.618144+0000 (oldest deadline 2019-11-29T03:37:52.324497+0000) 2019-11-29T03:38:10.768 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:38:10.762+0000 1694c700 -1 osd.6 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:05.241505+0000 front 2019-11-29T03:37:05.250205+0000 (oldest deadline 2019-11-29T03:37:49.900809+0000) 2019-11-29T03:38:10.781 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:38:10.778+0000 1694c700 -1 osd.0 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.810147+0000 front 2019-11-29T03:37:06.565502+0000 (oldest deadline 2019-11-29T03:37:50.653044+0000) 2019-11-29T03:38:10.947 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:38:10.941+0000 1694c700 -1 osd.4 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:02.725588+0000 front 2019-11-29T03:37:02.949228+0000 (oldest deadline 2019-11-29T03:37:47.988834+0000) 2019-11-29T03:38:11.325 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:38:11.320+0000 1694c700 -1 osd.7 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.851221+0000 front 2019-11-29T03:37:07.014118+0000 (oldest deadline 2019-11-29T03:37:48.421117+0000) 2019-11-29T03:38:11.329 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:38:11.324+0000 1694c700 -1 osd.5 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:07.271026+0000 front 2019-11-29T03:37:07.275380+0000 (oldest deadline 2019-11-29T03:37:52.527619+0000) 2019-11-29T03:38:11.608 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:38:11.604+0000 1694c700 -1 osd.2 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:03.392696+0000 front 2019-11-29T03:37:03.381104+0000 (oldest deadline 2019-11-29T03:37:49.276962+0000) 2019-11-29T03:38:11.724 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:38:11.718+0000 1694c700 -1 osd.6 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:05.241505+0000 front 2019-11-29T03:37:05.250205+0000 (oldest deadline 2019-11-29T03:37:49.900809+0000) 2019-11-29T03:38:11.794 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:38:11.790+0000 1694c700 -1 osd.1 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.467836+0000 front 2019-11-29T03:37:06.618144+0000 (oldest deadline 2019-11-29T03:37:52.324497+0000) 2019-11-29T03:38:11.811 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:38:11.807+0000 1694c700 -1 osd.0 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.810147+0000 front 2019-11-29T03:37:06.565502+0000 (oldest deadline 2019-11-29T03:37:50.653044+0000) 2019-11-29T03:38:11.954 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:38:11.948+0000 1694c700 -1 osd.4 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:02.725588+0000 front 2019-11-29T03:37:02.949228+0000 (oldest deadline 2019-11-29T03:37:47.988834+0000) 2019-11-29T03:38:12.331 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:38:12.325+0000 1694c700 -1 osd.7 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.851221+0000 front 2019-11-29T03:37:07.014118+0000 (oldest deadline 2019-11-29T03:37:48.421117+0000) 2019-11-29T03:38:12.334 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:38:12.329+0000 1694c700 -1 osd.5 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:07.271026+0000 front 2019-11-29T03:37:07.275380+0000 (oldest deadline 2019-11-29T03:37:52.527619+0000) 2019-11-29T03:38:12.637 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:38:12.633+0000 1694c700 -1 osd.2 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:03.392696+0000 front 2019-11-29T03:37:03.381104+0000 (oldest deadline 2019-11-29T03:37:49.276962+0000) 2019-11-29T03:38:12.757 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:38:12.751+0000 1694c700 -1 osd.6 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:05.241505+0000 front 2019-11-29T03:37:05.250205+0000 (oldest deadline 2019-11-29T03:37:49.900809+0000) 2019-11-29T03:38:12.758 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:38:12.754+0000 1694c700 -1 osd.1 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.467836+0000 front 2019-11-29T03:37:06.618144+0000 (oldest deadline 2019-11-29T03:37:52.324497+0000) 2019-11-29T03:38:12.826 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:38:12.821+0000 1694c700 -1 osd.0 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.810147+0000 front 2019-11-29T03:37:06.565502+0000 (oldest deadline 2019-11-29T03:37:50.653044+0000) 2019-11-29T03:38:12.974 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:38:12.968+0000 1694c700 -1 osd.4 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:02.725588+0000 front 2019-11-29T03:37:02.949228+0000 (oldest deadline 2019-11-29T03:37:47.988834+0000) 2019-11-29T03:38:13.351 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:38:13.346+0000 1694c700 -1 osd.5 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:07.271026+0000 front 2019-11-29T03:37:07.275380+0000 (oldest deadline 2019-11-29T03:37:52.527619+0000) 2019-11-29T03:38:13.362 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:38:13.356+0000 1694c700 -1 osd.7 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.851221+0000 front 2019-11-29T03:37:07.014118+0000 (oldest deadline 2019-11-29T03:37:48.421117+0000) 2019-11-29T03:38:13.666 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:38:13.662+0000 1694c700 -1 osd.2 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:03.392696+0000 front 2019-11-29T03:37:03.381104+0000 (oldest deadline 2019-11-29T03:37:49.276962+0000) 2019-11-29T03:38:13.732 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:38:13.728+0000 1694c700 -1 osd.1 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.467836+0000 front 2019-11-29T03:37:06.618144+0000 (oldest deadline 2019-11-29T03:37:52.324497+0000) 2019-11-29T03:38:13.760 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:38:13.755+0000 1694c700 -1 osd.6 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:05.241505+0000 front 2019-11-29T03:37:05.250205+0000 (oldest deadline 2019-11-29T03:37:49.900809+0000) 2019-11-29T03:38:13.814 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:38:13.810+0000 1694c700 -1 osd.0 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.810147+0000 front 2019-11-29T03:37:06.565502+0000 (oldest deadline 2019-11-29T03:37:50.653044+0000) 2019-11-29T03:38:13.991 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:38:13.985+0000 1694c700 -1 osd.4 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:02.725588+0000 front 2019-11-29T03:37:02.949228+0000 (oldest deadline 2019-11-29T03:37:47.988834+0000) 2019-11-29T03:38:14.330 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:38:14.324+0000 1694c700 -1 osd.7 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.851221+0000 front 2019-11-29T03:37:07.014118+0000 (oldest deadline 2019-11-29T03:37:48.421117+0000) 2019-11-29T03:38:14.396 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:38:14.390+0000 1694c700 -1 osd.5 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:07.271026+0000 front 2019-11-29T03:37:07.275380+0000 (oldest deadline 2019-11-29T03:37:52.527619+0000) 2019-11-29T03:38:14.646 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:38:14.643+0000 1694c700 -1 osd.2 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:03.392696+0000 front 2019-11-29T03:37:03.381104+0000 (oldest deadline 2019-11-29T03:37:49.276962+0000) 2019-11-29T03:38:14.751 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:38:14.749+0000 1694c700 -1 osd.1 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.467836+0000 front 2019-11-29T03:37:06.618144+0000 (oldest deadline 2019-11-29T03:37:52.324497+0000) 2019-11-29T03:38:14.773 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:38:14.768+0000 1694c700 -1 osd.6 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:05.241505+0000 front 2019-11-29T03:37:05.250205+0000 (oldest deadline 2019-11-29T03:37:49.900809+0000) 2019-11-29T03:38:14.847 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:38:14.843+0000 1694c700 -1 osd.0 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.810147+0000 front 2019-11-29T03:37:06.565502+0000 (oldest deadline 2019-11-29T03:37:50.653044+0000) 2019-11-29T03:38:15.041 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:38:15.035+0000 1694c700 -1 osd.4 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:02.725588+0000 front 2019-11-29T03:37:02.949228+0000 (oldest deadline 2019-11-29T03:37:47.988834+0000) 2019-11-29T03:38:15.306 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:38:15.301+0000 1694c700 -1 osd.7 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.851221+0000 front 2019-11-29T03:37:07.014118+0000 (oldest deadline 2019-11-29T03:37:48.421117+0000) 2019-11-29T03:38:15.409 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:38:15.403+0000 1694c700 -1 osd.5 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:07.271026+0000 front 2019-11-29T03:37:07.275380+0000 (oldest deadline 2019-11-29T03:37:52.527619+0000) 2019-11-29T03:38:15.656 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:38:15.653+0000 1694c700 -1 osd.2 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:03.392696+0000 front 2019-11-29T03:37:03.381104+0000 (oldest deadline 2019-11-29T03:37:49.276962+0000) 2019-11-29T03:38:15.793 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:38:15.791+0000 1694c700 -1 osd.1 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.467836+0000 front 2019-11-29T03:37:06.618144+0000 (oldest deadline 2019-11-29T03:37:52.324497+0000) 2019-11-29T03:38:15.804 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:38:15.798+0000 1694c700 -1 osd.6 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:05.241505+0000 front 2019-11-29T03:37:05.250205+0000 (oldest deadline 2019-11-29T03:37:49.900809+0000) 2019-11-29T03:38:15.898 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:38:15.894+0000 1694c700 -1 osd.0 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.810147+0000 front 2019-11-29T03:37:06.565502+0000 (oldest deadline 2019-11-29T03:37:50.653044+0000) 2019-11-29T03:38:16.051 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:38:16.046+0000 1694c700 -1 osd.4 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:02.725588+0000 front 2019-11-29T03:37:02.949228+0000 (oldest deadline 2019-11-29T03:37:47.988834+0000) 2019-11-29T03:38:16.349 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:38:16.345+0000 1694c700 -1 osd.7 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.851221+0000 front 2019-11-29T03:37:07.014118+0000 (oldest deadline 2019-11-29T03:37:48.421117+0000) 2019-11-29T03:38:16.362 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:38:16.357+0000 1694c700 -1 osd.5 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:07.271026+0000 front 2019-11-29T03:37:07.275380+0000 (oldest deadline 2019-11-29T03:37:52.527619+0000) 2019-11-29T03:38:16.622 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:38:16.619+0000 1694c700 -1 osd.2 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:03.392696+0000 front 2019-11-29T03:37:03.381104+0000 (oldest deadline 2019-11-29T03:37:49.276962+0000) 2019-11-29T03:38:16.776 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:38:16.770+0000 1694c700 -1 osd.6 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:05.241505+0000 front 2019-11-29T03:37:05.250205+0000 (oldest deadline 2019-11-29T03:37:49.900809+0000) 2019-11-29T03:38:16.782 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:38:16.780+0000 1694c700 -1 osd.1 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.467836+0000 front 2019-11-29T03:37:06.618144+0000 (oldest deadline 2019-11-29T03:37:52.324497+0000) 2019-11-29T03:38:16.936 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:38:16.932+0000 1694c700 -1 osd.0 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.810147+0000 front 2019-11-29T03:37:06.565502+0000 (oldest deadline 2019-11-29T03:37:50.653044+0000) 2019-11-29T03:38:17.106 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:38:17.101+0000 1694c700 -1 osd.4 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:02.725588+0000 front 2019-11-29T03:37:02.949228+0000 (oldest deadline 2019-11-29T03:37:47.988834+0000) 2019-11-29T03:38:17.318 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:38:17.312+0000 1694c700 -1 osd.5 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:07.271026+0000 front 2019-11-29T03:37:07.275380+0000 (oldest deadline 2019-11-29T03:37:52.527619+0000) 2019-11-29T03:38:17.364 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:38:17.359+0000 1694c700 -1 osd.7 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.851221+0000 front 2019-11-29T03:37:07.014118+0000 (oldest deadline 2019-11-29T03:37:48.421117+0000) 2019-11-29T03:38:17.670 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:38:17.667+0000 1694c700 -1 osd.2 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:03.392696+0000 front 2019-11-29T03:37:03.381104+0000 (oldest deadline 2019-11-29T03:37:49.276962+0000) 2019-11-29T03:38:17.773 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:38:17.770+0000 1694c700 -1 osd.1 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.467836+0000 front 2019-11-29T03:37:06.618144+0000 (oldest deadline 2019-11-29T03:37:52.324497+0000) 2019-11-29T03:38:17.779 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:38:17.773+0000 1694c700 -1 osd.6 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:05.241505+0000 front 2019-11-29T03:37:05.250205+0000 (oldest deadline 2019-11-29T03:37:49.900809+0000) 2019-11-29T03:38:17.941 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:38:17.938+0000 1694c700 -1 osd.0 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.810147+0000 front 2019-11-29T03:37:06.565502+0000 (oldest deadline 2019-11-29T03:37:50.653044+0000) 2019-11-29T03:38:18.149 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:38:18.143+0000 1694c700 -1 osd.4 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:02.725588+0000 front 2019-11-29T03:37:02.949228+0000 (oldest deadline 2019-11-29T03:37:47.988834+0000) 2019-11-29T03:38:18.315 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:38:18.308+0000 1694c700 -1 osd.5 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:07.271026+0000 front 2019-11-29T03:37:07.275380+0000 (oldest deadline 2019-11-29T03:37:52.527619+0000) 2019-11-29T03:38:18.325 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:38:18.319+0000 1694c700 -1 osd.7 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.851221+0000 front 2019-11-29T03:37:07.014118+0000 (oldest deadline 2019-11-29T03:37:48.421117+0000) 2019-11-29T03:38:18.651 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:38:18.648+0000 1694c700 -1 osd.2 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:03.392696+0000 front 2019-11-29T03:37:03.381104+0000 (oldest deadline 2019-11-29T03:37:49.276962+0000) 2019-11-29T03:38:18.750 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:38:18.747+0000 1694c700 -1 osd.1 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.467836+0000 front 2019-11-29T03:37:06.618144+0000 (oldest deadline 2019-11-29T03:37:52.324497+0000) 2019-11-29T03:38:18.786 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:38:18.781+0000 1694c700 -1 osd.6 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:05.241505+0000 front 2019-11-29T03:37:05.250205+0000 (oldest deadline 2019-11-29T03:37:49.900809+0000) 2019-11-29T03:38:18.933 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:38:18.930+0000 1694c700 -1 osd.0 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.810147+0000 front 2019-11-29T03:37:06.565502+0000 (oldest deadline 2019-11-29T03:37:50.653044+0000) 2019-11-29T03:38:19.145 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:38:19.139+0000 1694c700 -1 osd.4 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:02.725588+0000 front 2019-11-29T03:37:02.949228+0000 (oldest deadline 2019-11-29T03:37:47.988834+0000) 2019-11-29T03:38:19.318 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:38:19.312+0000 1694c700 -1 osd.7 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.851221+0000 front 2019-11-29T03:37:07.014118+0000 (oldest deadline 2019-11-29T03:37:48.421117+0000) 2019-11-29T03:38:19.336 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:38:19.331+0000 1694c700 -1 osd.5 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:07.271026+0000 front 2019-11-29T03:37:07.275380+0000 (oldest deadline 2019-11-29T03:37:52.527619+0000) 2019-11-29T03:38:19.609 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:38:19.605+0000 1694c700 -1 osd.2 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:03.392696+0000 front 2019-11-29T03:37:03.381104+0000 (oldest deadline 2019-11-29T03:37:49.276962+0000) 2019-11-29T03:38:19.719 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:38:19.716+0000 1694c700 -1 osd.1 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.467836+0000 front 2019-11-29T03:37:06.618144+0000 (oldest deadline 2019-11-29T03:37:52.324497+0000) 2019-11-29T03:38:19.743 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:38:19.737+0000 1694c700 -1 osd.6 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:05.241505+0000 front 2019-11-29T03:37:05.250205+0000 (oldest deadline 2019-11-29T03:37:49.900809+0000) 2019-11-29T03:38:19.956 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:38:19.952+0000 1694c700 -1 osd.0 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.810147+0000 front 2019-11-29T03:37:06.565502+0000 (oldest deadline 2019-11-29T03:37:50.653044+0000) 2019-11-29T03:38:20.135 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:38:20.129+0000 1694c700 -1 osd.4 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:02.725588+0000 front 2019-11-29T03:37:02.949228+0000 (oldest deadline 2019-11-29T03:37:47.988834+0000) 2019-11-29T03:38:20.329 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:38:20.324+0000 1694c700 -1 osd.5 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:07.271026+0000 front 2019-11-29T03:37:07.275380+0000 (oldest deadline 2019-11-29T03:37:52.527619+0000) 2019-11-29T03:38:20.361 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:38:20.355+0000 1694c700 -1 osd.7 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.851221+0000 front 2019-11-29T03:37:07.014118+0000 (oldest deadline 2019-11-29T03:37:48.421117+0000) 2019-11-29T03:38:20.595 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:38:20.592+0000 1694c700 -1 osd.2 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:03.392696+0000 front 2019-11-29T03:37:03.381104+0000 (oldest deadline 2019-11-29T03:37:49.276962+0000) 2019-11-29T03:38:20.742 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:38:20.737+0000 1694c700 -1 osd.1 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.467836+0000 front 2019-11-29T03:37:06.618144+0000 (oldest deadline 2019-11-29T03:37:52.324497+0000) 2019-11-29T03:38:20.783 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:38:20.778+0000 1694c700 -1 osd.6 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:05.241505+0000 front 2019-11-29T03:37:05.250205+0000 (oldest deadline 2019-11-29T03:37:49.900809+0000) 2019-11-29T03:38:21.006 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:38:21.004+0000 1694c700 -1 osd.0 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.810147+0000 front 2019-11-29T03:37:06.565502+0000 (oldest deadline 2019-11-29T03:37:50.653044+0000) 2019-11-29T03:38:21.149 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:38:21.143+0000 1694c700 -1 osd.4 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:02.725588+0000 front 2019-11-29T03:37:02.949228+0000 (oldest deadline 2019-11-29T03:37:47.988834+0000) 2019-11-29T03:38:21.341 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:38:21.335+0000 1694c700 -1 osd.5 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:07.271026+0000 front 2019-11-29T03:37:07.275380+0000 (oldest deadline 2019-11-29T03:37:52.527619+0000) 2019-11-29T03:38:21.377 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:38:21.371+0000 1694c700 -1 osd.7 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.851221+0000 front 2019-11-29T03:37:07.014118+0000 (oldest deadline 2019-11-29T03:37:48.421117+0000) 2019-11-29T03:38:21.557 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:38:21.554+0000 1694c700 -1 osd.2 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:03.392696+0000 front 2019-11-29T03:37:03.381104+0000 (oldest deadline 2019-11-29T03:37:49.276962+0000) 2019-11-29T03:38:21.707 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:38:21.703+0000 1694c700 -1 osd.1 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.467836+0000 front 2019-11-29T03:37:06.618144+0000 (oldest deadline 2019-11-29T03:37:52.324497+0000) 2019-11-29T03:38:21.807 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:38:21.801+0000 1694c700 -1 osd.6 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:05.241505+0000 front 2019-11-29T03:37:05.250205+0000 (oldest deadline 2019-11-29T03:37:49.900809+0000) 2019-11-29T03:38:22.020 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:38:22.017+0000 1694c700 -1 osd.0 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.810147+0000 front 2019-11-29T03:37:06.565502+0000 (oldest deadline 2019-11-29T03:37:50.653044+0000) 2019-11-29T03:38:22.130 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:38:22.124+0000 1694c700 -1 osd.4 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:02.725588+0000 front 2019-11-29T03:37:02.949228+0000 (oldest deadline 2019-11-29T03:37:47.988834+0000) 2019-11-29T03:38:22.389 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:38:22.382+0000 1694c700 -1 osd.5 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:07.271026+0000 front 2019-11-29T03:37:07.275380+0000 (oldest deadline 2019-11-29T03:37:52.527619+0000) 2019-11-29T03:38:22.431 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:38:22.424+0000 1694c700 -1 osd.7 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.851221+0000 front 2019-11-29T03:37:07.014118+0000 (oldest deadline 2019-11-29T03:37:48.421117+0000) 2019-11-29T03:38:22.576 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:38:22.574+0000 1694c700 -1 osd.2 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:03.392696+0000 front 2019-11-29T03:37:03.381104+0000 (oldest deadline 2019-11-29T03:37:49.276962+0000) 2019-11-29T03:38:22.684 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:38:22.680+0000 1694c700 -1 osd.1 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.467836+0000 front 2019-11-29T03:37:06.618144+0000 (oldest deadline 2019-11-29T03:37:52.324497+0000) 2019-11-29T03:38:22.795 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:38:22.788+0000 1694c700 -1 osd.6 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:05.241505+0000 front 2019-11-29T03:37:05.250205+0000 (oldest deadline 2019-11-29T03:37:49.900809+0000) 2019-11-29T03:38:23.031 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:38:23.027+0000 1694c700 -1 osd.0 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.810147+0000 front 2019-11-29T03:37:06.565502+0000 (oldest deadline 2019-11-29T03:37:50.653044+0000) 2019-11-29T03:38:23.173 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:38:23.166+0000 1694c700 -1 osd.4 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:02.725588+0000 front 2019-11-29T03:37:02.949228+0000 (oldest deadline 2019-11-29T03:37:47.988834+0000) 2019-11-29T03:38:23.417 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:38:23.411+0000 1694c700 -1 osd.5 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:07.271026+0000 front 2019-11-29T03:37:07.275380+0000 (oldest deadline 2019-11-29T03:37:52.527619+0000) 2019-11-29T03:38:23.419 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:38:23.413+0000 1694c700 -1 osd.7 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.851221+0000 front 2019-11-29T03:37:07.014118+0000 (oldest deadline 2019-11-29T03:37:48.421117+0000) 2019-11-29T03:38:23.581 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:38:23.579+0000 1694c700 -1 osd.2 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:03.392696+0000 front 2019-11-29T03:37:03.381104+0000 (oldest deadline 2019-11-29T03:37:49.276962+0000) 2019-11-29T03:38:23.712 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:38:23.709+0000 1694c700 -1 osd.1 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.467836+0000 front 2019-11-29T03:37:06.618144+0000 (oldest deadline 2019-11-29T03:37:52.324497+0000) 2019-11-29T03:38:23.819 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:38:23.813+0000 1694c700 -1 osd.6 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:05.241505+0000 front 2019-11-29T03:37:05.250205+0000 (oldest deadline 2019-11-29T03:37:49.900809+0000) 2019-11-29T03:38:24.014 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:38:24.012+0000 1694c700 -1 osd.0 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.810147+0000 front 2019-11-29T03:37:06.565502+0000 (oldest deadline 2019-11-29T03:37:50.653044+0000) 2019-11-29T03:38:24.218 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:38:24.206+0000 1694c700 -1 osd.4 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:02.725588+0000 front 2019-11-29T03:37:02.949228+0000 (oldest deadline 2019-11-29T03:37:47.988834+0000) 2019-11-29T03:38:24.405 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:38:24.398+0000 1694c700 -1 osd.5 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:07.271026+0000 front 2019-11-29T03:37:07.275380+0000 (oldest deadline 2019-11-29T03:37:52.527619+0000) 2019-11-29T03:38:24.428 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:38:24.422+0000 1694c700 -1 osd.7 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.851221+0000 front 2019-11-29T03:37:07.014118+0000 (oldest deadline 2019-11-29T03:37:48.421117+0000) 2019-11-29T03:38:24.575 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:38:24.572+0000 1694c700 -1 osd.2 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:03.392696+0000 front 2019-11-29T03:37:03.381104+0000 (oldest deadline 2019-11-29T03:37:49.276962+0000) 2019-11-29T03:38:24.680 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:38:24.678+0000 1694c700 -1 osd.1 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:06.467836+0000 front 2019-11-29T03:37:06.618144+0000 (oldest deadline 2019-11-29T03:37:52.324497+0000) 2019-11-29T03:38:24.779 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:38:24.776+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.74:6802/10096,v1:172.21.15.74:6803/10096] for 44sec e286 v286) 2019-11-29T03:38:24.856 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:38:24.828+0000 1694c700 -1 osd.6 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:05.241505+0000 front 2019-11-29T03:37:05.250205+0000 (oldest deadline 2019-11-29T03:37:49.900809+0000) 2019-11-29T03:38:24.936 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:52:07.154 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:38:24.959 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:52:07.177 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:38:24.994 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:52:07.213 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:38:25.011 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:52:07.239 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:38:25.011 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:52:07.230 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:38:25.012 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:52:07.241 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:38:25.155 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:52:07.384 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:38:25.157 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:52:07.375 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:38:25.183 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:52:07.400 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:38:25.381 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:38:25.372+0000 1694c700 -1 osd.5 286 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:37:07.271026+0000 front 2019-11-29T03:37:07.275380+0000 (oldest deadline 2019-11-29T03:37:52.527619+0000) 2019-11-29T03:38:57.963 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:38:57.938+0000 31783700 -1 osd.3 292 build_incremental_map_msg missing incremental map 292 2019-11-29T03:38:58.230 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:38:58.111+0000 32785700 -1 osd.3 292 build_incremental_map_msg missing incremental map 292 2019-11-29T03:38:58.321 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:38:58.190+0000 35f8c700 -1 osd.3 292 build_incremental_map_msg missing incremental map 292 2019-11-29T03:38:58.324 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:38:58.216+0000 35f8c700 -1 osd.3 292 build_incremental_map_msg missing incremental map 292 2019-11-29T03:38:58.381 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:38:58.378+0000 32f86700 -1 osd.3 292 build_incremental_map_msg missing incremental map 292 2019-11-29T03:39:00.646 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:00.570+0000 34789700 -1 osd.3 292 build_incremental_map_msg missing incremental map 292 2019-11-29T03:39:21.808 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:39:21.803+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:39:22.272 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:39:22.267+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:39:22.441 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:39:22.434+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:39:22.853 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:39:22.847+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:39:23.256 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:39:23.252+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:39:23.492 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:39:23.488+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:39:23.861 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:39:23.855+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:39:24.164 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:39:24.158+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:39:24.246 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:39:24.243+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:39:24.380 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:39:24.374+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:39:24.499 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:39:24.494+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:39:24.736 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:39:24.733+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:39:24.903 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:39:24.897+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:39:25.122 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:39:25.119+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:39:25.227 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:39:25.223+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:39:25.415 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:39:25.410+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:39:25.519 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:39:25.515+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:39:25.692 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:39:25.689+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:39:25.893 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:39:25.888+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:39:26.087 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:39:26.083+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:39:26.245 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:39:26.241+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:39:26.426 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:39:26.420+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:39:26.555 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:39:26.551+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:39:26.705 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:39:26.700+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:39:26.932 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:39:26.927+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:39:27.114 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:39:27.109+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:39:27.298 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:39:27.293+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:39:27.453 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:39:27.447+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:39:27.559 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:27.557+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:39:27.573 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:39:27.569+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:39:27.746 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:39:27.742+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:39:27.917 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:39:27.912+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:39:28.127 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:39:28.123+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:39:28.339 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:39:28.335+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:39:28.506 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:39:28.501+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:39:28.554 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:28.551+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:39:28.576 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:39:28.569+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:39:28.723 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:39:28.719+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:39:28.936 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:39:28.931+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:39:29.160 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:39:29.157+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:39:29.317 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:39:29.313+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:39:29.542 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:39:29.538+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:39:29.546 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:39:29.541+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:39:29.560 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:29.557+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:39:29.699 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:39:29.696+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:39:29.899 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:39:29.894+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:39:30.190 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:39:30.186+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:39:30.318 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:39:30.314+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:39:30.549 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:30.546+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:39:30.707 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:39:30.570+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:39:30.707 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:39:30.584+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:39:30.708 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:39:30.664+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:39:30.921 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:39:30.915+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:39:31.147 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:39:31.143+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:39:31.283 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:39:31.279+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:39:31.559 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:31.557+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:39:31.589 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:39:31.585+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:39:31.590 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:39:31.586+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:39:31.714 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:39:31.711+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:39:31.906 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:39:31.900+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:39:32.159 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:39:32.156+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:39:32.268 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:39:32.264+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:39:32.515 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:32.512+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:39:32.586 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:39:32.581+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:39:32.608 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:39:32.603+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:39:32.697 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:39:32.689+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:39:32.885 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:39:32.880+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:39:33.118 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:39:33.114+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:39:33.296 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:39:33.293+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:39:33.534 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:33.531+0000 1694c700 -1 osd.3 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:38:53.491161+0000 (oldest deadline 2019-11-29T03:39:33.491161+0000) 2019-11-29T03:39:33.535 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:33.533+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:39:33.596 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:39:33.591+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:39:33.654 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:39:33.651+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:39:33.670 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:39:33.660+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:39:33.869 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:39:33.864+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:39:34.096 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:39:34.092+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:39:34.315 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:39:34.311+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:39:34.564 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:34.561+0000 1694c700 -1 osd.3 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:38:53.491161+0000 (oldest deadline 2019-11-29T03:39:33.491161+0000) 2019-11-29T03:39:34.566 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:34.564+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:39:34.602 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:39:34.598+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:39:34.624 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:39:34.617+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:39:34.641 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:39:34.637+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:39:34.894 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:39:34.889+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:39:35.060 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:39:35.053+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:39:35.316 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:39:35.312+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:39:35.529 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:35.526+0000 1694c700 -1 osd.3 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:38:53.491161+0000 (oldest deadline 2019-11-29T03:39:33.491161+0000) 2019-11-29T03:39:35.531 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:35.528+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:39:35.571 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:39:35.565+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:39:35.578 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:39:35.575+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:39:35.652 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:39:35.648+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:39:35.884 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:39:35.876+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:39:36.019 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:39:36.015+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:39:36.355 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:39:36.349+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:39:36.523 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:36.519+0000 1694c700 -1 osd.3 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:38:53.491161+0000 (oldest deadline 2019-11-29T03:39:33.491161+0000) 2019-11-29T03:39:36.524 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:36.520+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:39:36.592 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:39:36.588+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:39:36.622 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:39:36.616+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:39:36.632 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:39:36.627+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:39:36.930 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:39:36.925+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:39:37.025 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:39:37.020+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:39:37.345 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:39:37.341+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:39:37.482 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:37.473+0000 1694c700 -1 osd.3 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:38:53.491161+0000 (oldest deadline 2019-11-29T03:39:33.491161+0000) 2019-11-29T03:39:37.482 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:37.476+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:39:37.614 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:39:37.609+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:39:37.616 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:39:37.612+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:39:37.630 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:39:37.625+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:39:37.960 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:39:37.955+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:39:38.044 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:39:38.039+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:39:38.343 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:39:38.339+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:39:38.527 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:38.521+0000 1694c700 -1 osd.3 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:38:53.491161+0000 (oldest deadline 2019-11-29T03:39:33.491161+0000) 2019-11-29T03:39:38.528 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:38.525+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:39:38.590 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:39:38.585+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:39:38.624 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:39:38.619+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:39:38.643 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:39:38.640+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:39:38.947 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:39:38.943+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:39:39.075 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:39:39.071+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:39:39.389 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:39:39.386+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:39:39.503 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:39.501+0000 1694c700 -1 osd.3 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:38:53.491161+0000 (oldest deadline 2019-11-29T03:39:33.491161+0000) 2019-11-29T03:39:39.505 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:39.503+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:39:39.561 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:39:39.557+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:39:39.613 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:39:39.609+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:39:39.616 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:39:39.613+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:39:39.928 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:39:39.924+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:39:40.048 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:39:40.045+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:39:40.081 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:53:22.299 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:39:40.091 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:53:22.309 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:39:40.106 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:53:22.324 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:39:40.108 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:53:22.328 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:39:40.109 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:53:22.337 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:39:40.114 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:53:22.343 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:39:40.198 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:53:22.416 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:39:40.211 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:53:22.430 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:39:40.278 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:53:22.507 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:39:40.409 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:39:40.405+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:39:40.493 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:40.491+0000 1694c700 -1 osd.3 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:38:53.491161+0000 (oldest deadline 2019-11-29T03:39:33.491161+0000) 2019-11-29T03:39:40.495 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:40.492+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:39:40.565 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:39:40.559+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:39:40.624 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:39:40.620+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:39:40.650 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:39:40.647+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:39:40.970 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:39:40.965+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:39:41.009 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:39:41.005+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:39:41.376 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:39:41.373+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:39:41.500 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:41.497+0000 1694c700 -1 osd.3 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:38:53.491161+0000 (oldest deadline 2019-11-29T03:39:33.491161+0000) 2019-11-29T03:39:41.501 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:41.498+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:39:41.588 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:39:41.583+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:39:41.592 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:39:41.587+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:39:41.644 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:39:41.640+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:39:41.969 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:39:41.965+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:39:41.977 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:39:41.973+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:39:42.387 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:39:42.383+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:39:42.463 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:42.459+0000 1694c700 -1 osd.3 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:38:53.491161+0000 (oldest deadline 2019-11-29T03:39:33.491161+0000) 2019-11-29T03:39:42.466 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:42.463+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:39:42.626 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:39:42.620+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:39:42.629 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:39:42.625+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:39:42.633 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:39:42.628+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:39:42.967 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:39:42.961+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:39:42.983 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:39:42.980+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:39:43.392 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:39:43.388+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:39:43.430 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:43.425+0000 1694c700 -1 osd.3 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:38:53.491161+0000 (oldest deadline 2019-11-29T03:39:33.491161+0000) 2019-11-29T03:39:43.432 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:43.429+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:39:43.592 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:39:43.588+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:39:43.595 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:39:43.590+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:39:43.656 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:39:43.652+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:39:43.989 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:39:43.984+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:39:44.009 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:39:44.003+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:39:44.432 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:39:44.428+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:39:44.466 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:44.462+0000 1694c700 -1 osd.3 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:38:53.491161+0000 (oldest deadline 2019-11-29T03:39:33.491161+0000) 2019-11-29T03:39:44.466 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:44.463+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:39:44.580 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:39:44.573+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:39:44.607 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:39:44.602+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:39:44.679 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:39:44.675+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:39:44.968 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:39:44.964+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:39:45.031 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:39:45.025+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:39:45.454 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:39:45.452+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:39:45.475 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:45.473+0000 1694c700 -1 osd.3 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:38:53.491161+0000 (oldest deadline 2019-11-29T03:39:33.491161+0000) 2019-11-29T03:39:45.477 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:45.475+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:39:45.570 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:39:45.565+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:39:45.652 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:39:45.647+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:39:45.704 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:39:45.702+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:39:45.933 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:39:45.926+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:39:46.057 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:39:46.053+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:39:46.431 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:39:46.429+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:39:46.442 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:46.440+0000 1694c700 -1 osd.3 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:38:53.491161+0000 (oldest deadline 2019-11-29T03:39:33.491161+0000) 2019-11-29T03:39:46.444 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:46.442+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:39:46.549 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:39:46.541+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:39:46.648 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:39:46.643+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:39:46.754 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:39:46.751+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:39:46.897 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:39:46.894+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:39:47.031 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:39:47.025+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:39:47.456 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:47.454+0000 1694c700 -1 osd.3 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:38:53.491161+0000 (oldest deadline 2019-11-29T03:39:33.491161+0000) 2019-11-29T03:39:47.457 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:47.454+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:39:47.476 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:39:47.474+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:39:47.578 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:39:47.574+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:39:47.652 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:39:47.647+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:39:47.777 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:39:47.775+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:39:47.948 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:39:47.945+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:39:48.047 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:39:48.042+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:39:48.442 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:48.439+0000 1694c700 -1 osd.3 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:38:53.491161+0000 (oldest deadline 2019-11-29T03:39:33.491161+0000) 2019-11-29T03:39:48.443 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:48.441+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:39:48.495 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:39:48.493+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:39:48.578 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:39:48.571+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:39:48.609 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:39:48.603+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:39:48.748 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:39:48.745+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:39:48.995 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:39:48.992+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:39:49.035 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:39:49.029+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:39:49.397 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:49.394+0000 1694c700 -1 osd.3 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:38:53.491161+0000 (oldest deadline 2019-11-29T03:39:33.491161+0000) 2019-11-29T03:39:49.398 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:49.395+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:39:49.505 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:39:49.504+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:39:49.552 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:39:49.547+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:39:49.602 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:39:49.597+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:39:49.735 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:39:49.731+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:39:49.960 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:39:49.956+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:39:50.053 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:39:50.048+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:39:50.368 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:50.362+0000 1694c700 -1 osd.3 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:38:53.491161+0000 (oldest deadline 2019-11-29T03:39:33.491161+0000) 2019-11-29T03:39:50.369 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:50.364+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:39:50.548 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:39:50.543+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:39:50.556 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:39:50.554+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:39:50.627 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:39:50.621+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:39:50.726 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:39:50.722+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:39:50.939 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:39:50.936+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:39:51.019 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:39:51.014+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:39:51.414 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:51.410+0000 1694c700 -1 osd.3 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:38:53.491161+0000 (oldest deadline 2019-11-29T03:39:33.491161+0000) 2019-11-29T03:39:51.415 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:51.412+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:39:51.517 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:39:51.512+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:39:51.543 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:39:51.541+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:39:51.672 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:39:51.668+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:39:51.693 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:39:51.690+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:39:51.921 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:39:51.919+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:39:52.008 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:39:52.001+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:39:52.449 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:52.446+0000 1694c700 -1 osd.3 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:38:53.491161+0000 (oldest deadline 2019-11-29T03:39:33.491161+0000) 2019-11-29T03:39:52.450 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:52.448+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:39:52.505 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:39:52.499+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:39:52.570 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:39:52.567+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:39:52.666 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:39:52.661+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:39:52.696 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:39:52.694+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:39:52.933 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:39:52.930+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:39:52.973 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:39:52.961+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:39:53.452 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:53.449+0000 1694c700 -1 osd.3 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:38:53.491161+0000 (oldest deadline 2019-11-29T03:39:33.491161+0000) 2019-11-29T03:39:53.453 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:53.450+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:39:53.469 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:39:53.464+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:39:53.573 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:39:53.569+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:39:53.678 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:39:53.674+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:39:53.712 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:39:53.709+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:39:53.928 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:39:53.925+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:39:54.011 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:39:54.006+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:39:54.441 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:54.438+0000 1694c700 -1 osd.3 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:38:53.491161+0000 (oldest deadline 2019-11-29T03:39:33.491161+0000) 2019-11-29T03:39:54.444 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:54.442+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:39:54.514 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:39:54.509+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:39:54.563 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:39:54.558+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:39:54.719 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:39:54.713+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:39:54.748 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:39:54.745+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:39:54.972 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:39:54.969+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:39:55.014 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:39:55.012+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 44sec e292 v292) 2019-11-29T03:39:55.034 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:39:55.029+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:39:55.431 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:55.428+0000 1694c700 -1 osd.3 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:38:53.491161+0000 (oldest deadline 2019-11-29T03:39:33.491161+0000) 2019-11-29T03:39:55.432 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:55.430+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:39:55.524 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:39:55.519+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:39:55.586 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:39:55.583+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:39:55.681 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:39:55.676+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:39:55.717 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:39:55.714+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:39:55.988 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:39:55.985+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:39:56.029 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:39:56.024+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:39:56.387 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:56.385+0000 1694c700 -1 osd.3 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:38:53.491161+0000 (oldest deadline 2019-11-29T03:39:33.491161+0000) 2019-11-29T03:39:56.390 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:56.389+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:39:56.526 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:39:56.520+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:39:56.544 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:39:56.541+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:39:56.682 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:39:56.675+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:39:56.758 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:39:56.755+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:39:57.036 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:39:57.032+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:39:57.076 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:39:57.070+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:39:57.441 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:57.439+0000 1694c700 -1 osd.3 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:38:53.491161+0000 (oldest deadline 2019-11-29T03:39:33.491161+0000) 2019-11-29T03:39:57.445 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:57.442+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:39:57.507 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:39:57.501+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:39:57.549 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:39:57.547+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:39:57.713 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:39:57.706+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:39:57.760 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:39:57.758+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:39:58.065 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:39:58.063+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:39:58.117 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:39:58.110+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:39:58.492 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:58.490+0000 1694c700 -1 osd.3 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:38:53.491161+0000 (oldest deadline 2019-11-29T03:39:33.491161+0000) 2019-11-29T03:39:58.495 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:58.494+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:39:58.541 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:39:58.538+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:39:58.557 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:39:58.551+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:39:58.725 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:39:58.718+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:39:58.738 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:39:58.735+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:39:59.084 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:39:59.080+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:39:59.108 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:39:59.101+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:39:59.472 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:59.468+0000 1694c700 -1 osd.3 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:38:53.491161+0000 (oldest deadline 2019-11-29T03:39:33.491161+0000) 2019-11-29T03:39:59.473 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:39:59.470+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:39:59.500 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:39:59.497+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:39:59.608 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:39:59.602+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:39:59.752 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:39:59.746+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:39:59.779 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:39:59.775+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:40:00.031 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:40:00.028+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 44sec e292 v292) 2019-11-29T03:40:00.083 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:40:00.079+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:40:00.110 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:40:00.105+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:40:00.498 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:40:00.496+0000 1694c700 -1 osd.3 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:38:53.491161+0000 (oldest deadline 2019-11-29T03:39:33.491161+0000) 2019-11-29T03:40:00.499 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:40:00.496+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:40:00.500 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:40:00.498+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:40:00.578 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:40:00.574+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:40:00.748 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:40:00.745+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:40:00.773 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:40:00.769+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:40:01.109 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:40:01.106+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:40:01.159 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:40:01.155+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:40:01.497 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:40:01.493+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:40:01.516 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:40:01.511+0000 1694c700 -1 osd.3 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:38:53.491161+0000 (oldest deadline 2019-11-29T03:39:33.491161+0000) 2019-11-29T03:40:01.516 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:40:01.513+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:40:01.594 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:40:01.590+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:40:01.716 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:40:01.713+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:40:01.729 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:40:01.724+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:40:02.139 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:40:02.133+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:40:02.148 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:40:02.144+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:40:02.470 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:40:02.465+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:40:02.549 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:40:02.545+0000 1694c700 -1 osd.3 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:38:53.491161+0000 (oldest deadline 2019-11-29T03:39:33.491161+0000) 2019-11-29T03:40:02.553 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:40:02.550+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:40:02.605 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:40:02.600+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:40:02.712 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:40:02.708+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:40:02.736 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:40:02.731+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:40:03.129 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:40:03.125+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:40:03.147 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:40:03.143+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:40:03.508 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:40:03.505+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:40:03.538 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:40:03.534+0000 1694c700 -1 osd.3 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:38:53.491161+0000 (oldest deadline 2019-11-29T03:39:33.491161+0000) 2019-11-29T03:40:03.539 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:40:03.536+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:40:03.613 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:40:03.608+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:40:03.741 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:40:03.737+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:40:03.779 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:40:03.774+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:40:04.127 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:40:04.123+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:40:04.137 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:40:04.132+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:40:04.500 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:40:04.496+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:40:04.525 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:40:04.521+0000 1694c700 -1 osd.3 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:38:53.491161+0000 (oldest deadline 2019-11-29T03:39:33.491161+0000) 2019-11-29T03:40:04.525 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:40:04.522+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:40:04.630 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:40:04.624+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:40:04.723 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:40:04.720+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:40:04.812 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:40:04.807+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:40:05.047 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:40:05.045+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 44sec e292 v292) 2019-11-29T03:40:05.137 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:40:05.134+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:40:05.152 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:40:05.148+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:40:05.496 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:40:05.492+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:40:05.562 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:40:05.558+0000 1694c700 -1 osd.3 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:38:53.491161+0000 (oldest deadline 2019-11-29T03:39:33.491161+0000) 2019-11-29T03:40:05.562 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:40:05.559+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:40:05.677 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:40:05.668+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:40:05.759 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:40:05.755+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:40:05.802 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:40:05.797+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:40:06.093 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:40:06.089+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:40:06.146 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:40:06.141+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:40:06.510 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:40:06.503+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:40:06.585 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:40:06.581+0000 1694c700 -1 osd.3 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:38:53.491161+0000 (oldest deadline 2019-11-29T03:39:33.491161+0000) 2019-11-29T03:40:06.588 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:40:06.586+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:40:06.692 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:40:06.687+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:40:06.724 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:40:06.720+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:40:06.804 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:40:06.798+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:40:07.049 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:40:07.046+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:40:07.198 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:40:07.193+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:40:07.539 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:40:07.536+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:40:07.546 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:40:07.542+0000 1694c700 -1 osd.3 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:38:53.491161+0000 (oldest deadline 2019-11-29T03:39:33.491161+0000) 2019-11-29T03:40:07.547 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:40:07.544+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:40:07.650 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:40:07.644+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:40:07.715 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:40:07.711+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:40:07.810 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:40:07.805+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:40:08.015 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:40:08.004+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:40:08.214 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:40:08.209+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:40:08.534 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:40:08.530+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:40:08.599 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:40:08.594+0000 1694c700 -1 osd.3 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:38:53.491161+0000 (oldest deadline 2019-11-29T03:39:33.491161+0000) 2019-11-29T03:40:08.599 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:40:08.596+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:40:08.645 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:40:08.640+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:40:08.728 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:40:08.723+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:40:08.771 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:40:08.766+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:40:09.007 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:40:09.003+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:40:09.175 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:40:09.170+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:40:09.534 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:40:09.530+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:40:09.583 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:40:09.578+0000 1694c700 -1 osd.3 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:38:53.491161+0000 (oldest deadline 2019-11-29T03:39:33.491161+0000) 2019-11-29T03:40:09.584 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:40:09.581+0000 1694c700 -1 osd.3 292 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:40:09.602 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:40:09.597+0000 1694c700 -1 osd.7 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:38.354155+0000 front 2019-11-29T03:38:42.031834+0000 (oldest deadline 2019-11-29T03:39:21.829761+0000) 2019-11-29T03:40:09.713 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:40:09.709+0000 1694c700 -1 osd.0 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:40.727698+0000 front 2019-11-29T03:38:40.546291+0000 (oldest deadline 2019-11-29T03:39:24.597988+0000) 2019-11-29T03:40:09.749 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:40:09.743+0000 1694c700 -1 osd.4 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:42.178102+0000 front 2019-11-29T03:38:40.544797+0000 (oldest deadline 2019-11-29T03:39:23.984448+0000) 2019-11-29T03:40:09.986 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:40:09.982+0000 1694c700 -1 osd.1 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.114190+0000 front 2019-11-29T03:38:40.730995+0000 (oldest deadline 2019-11-29T03:39:24.129811+0000) 2019-11-29T03:40:10.117 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:40:10.110+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 44sec e292 v292) 2019-11-29T03:40:10.224 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:40:10.220+0000 1694c700 -1 osd.6 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:41.263242+0000 front 2019-11-29T03:38:36.361428+0000 (oldest deadline 2019-11-29T03:39:21.229945+0000) 2019-11-29T03:40:10.504 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:40:10.501+0000 1694c700 -1 osd.2 292 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:38:39.549743+0000 front 2019-11-29T03:38:39.632753+0000 (oldest deadline 2019-11-29T03:39:22.089436+0000) 2019-11-29T03:40:10.685 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:40:10.678+0000 1694c700 -1 osd.3 293 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e291) 2019-11-29T03:40:10.959 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:40:10.953+0000 37f90700 -1 osd.3 293 build_incremental_map_msg missing incremental map 292 2019-11-29T03:41:40.513 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:41:40.509+0000 1694c700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.995365+0000 front 2019-11-29T03:40:57.145029+0000 (oldest deadline 2019-11-29T03:41:40.478791+0000) 2019-11-29T03:41:40.837 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:41:40.830+0000 1694c700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.485894+0000 front 2019-11-29T03:40:56.612776+0000 (oldest deadline 2019-11-29T03:41:39.828632+0000) 2019-11-29T03:41:40.961 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:41:40.953+0000 1694c700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.594647+0000 front 2019-11-29T03:40:58.463297+0000 (oldest deadline 2019-11-29T03:41:40.730528+0000) 2019-11-29T03:41:41.503 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:41:41.499+0000 1694c700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.995365+0000 front 2019-11-29T03:40:57.145029+0000 (oldest deadline 2019-11-29T03:41:40.478791+0000) 2019-11-29T03:41:41.886 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:41:41.880+0000 1694c700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.485894+0000 front 2019-11-29T03:40:56.612776+0000 (oldest deadline 2019-11-29T03:41:39.828632+0000) 2019-11-29T03:41:41.988 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:41:41.982+0000 1694c700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.594647+0000 front 2019-11-29T03:40:58.463297+0000 (oldest deadline 2019-11-29T03:41:40.730528+0000) 2019-11-29T03:41:42.530 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:41:42.526+0000 1694c700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.995365+0000 front 2019-11-29T03:40:57.145029+0000 (oldest deadline 2019-11-29T03:41:40.478791+0000) 2019-11-29T03:41:42.840 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:41:42.836+0000 1694c700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.626104+0000 front 2019-11-29T03:40:58.340990+0000 (oldest deadline 2019-11-29T03:41:42.407457+0000) 2019-11-29T03:41:42.927 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:41:42.922+0000 1694c700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.485894+0000 front 2019-11-29T03:40:56.612776+0000 (oldest deadline 2019-11-29T03:41:39.828632+0000) 2019-11-29T03:41:42.959 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:41:42.954+0000 1694c700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.594647+0000 front 2019-11-29T03:40:58.463297+0000 (oldest deadline 2019-11-29T03:41:40.730528+0000) 2019-11-29T03:41:42.963 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:41:42.958+0000 1694c700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.091387+0000 front 2019-11-29T03:40:57.078720+0000 (oldest deadline 2019-11-29T03:41:42.328749+0000) 2019-11-29T03:41:43.121 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:41:43.114+0000 1694c700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.650487+0000 front 2019-11-29T03:40:56.636176+0000 (oldest deadline 2019-11-29T03:41:42.523716+0000) 2019-11-29T03:41:43.222 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:41:43.217+0000 1694c700 -1 osd.5 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.676523+0000 front 2019-11-29T03:40:57.675068+0000 (oldest deadline 2019-11-29T03:41:42.554012+0000) 2019-11-29T03:41:43.551 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:41:43.548+0000 1694c700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.995365+0000 front 2019-11-29T03:40:57.145029+0000 (oldest deadline 2019-11-29T03:41:40.478791+0000) 2019-11-29T03:41:43.830 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:41:43.827+0000 1694c700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.626104+0000 front 2019-11-29T03:40:58.340990+0000 (oldest deadline 2019-11-29T03:41:42.407457+0000) 2019-11-29T03:41:43.924 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:41:43.918+0000 1694c700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.594647+0000 front 2019-11-29T03:40:58.463297+0000 (oldest deadline 2019-11-29T03:41:40.730528+0000) 2019-11-29T03:41:43.930 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:41:43.925+0000 1694c700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.485894+0000 front 2019-11-29T03:40:56.612776+0000 (oldest deadline 2019-11-29T03:41:39.828632+0000) 2019-11-29T03:41:43.975 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:41:43.971+0000 1694c700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.091387+0000 front 2019-11-29T03:40:57.078720+0000 (oldest deadline 2019-11-29T03:41:42.328749+0000) 2019-11-29T03:41:44.134 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:41:44.128+0000 1694c700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.650487+0000 front 2019-11-29T03:40:56.636176+0000 (oldest deadline 2019-11-29T03:41:42.523716+0000) 2019-11-29T03:41:44.243 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:41:44.238+0000 1694c700 -1 osd.5 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.676523+0000 front 2019-11-29T03:40:57.675068+0000 (oldest deadline 2019-11-29T03:41:42.554012+0000) 2019-11-29T03:41:44.525 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:41:44.521+0000 1694c700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.995365+0000 front 2019-11-29T03:40:57.145029+0000 (oldest deadline 2019-11-29T03:41:40.478791+0000) 2019-11-29T03:41:44.861 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:41:44.857+0000 1694c700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.626104+0000 front 2019-11-29T03:40:58.340990+0000 (oldest deadline 2019-11-29T03:41:42.407457+0000) 2019-11-29T03:41:44.911 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:41:44.906+0000 1694c700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.485894+0000 front 2019-11-29T03:40:56.612776+0000 (oldest deadline 2019-11-29T03:41:39.828632+0000) 2019-11-29T03:41:44.915 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:41:44.910+0000 1694c700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.594647+0000 front 2019-11-29T03:40:58.463297+0000 (oldest deadline 2019-11-29T03:41:40.730528+0000) 2019-11-29T03:41:44.966 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:41:44.961+0000 1694c700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.091387+0000 front 2019-11-29T03:40:57.078720+0000 (oldest deadline 2019-11-29T03:41:42.328749+0000) 2019-11-29T03:41:45.162 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:41:45.156+0000 1694c700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.650487+0000 front 2019-11-29T03:40:56.636176+0000 (oldest deadline 2019-11-29T03:41:42.523716+0000) 2019-11-29T03:41:45.215 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:41:45.207+0000 1694c700 -1 osd.5 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.676523+0000 front 2019-11-29T03:40:57.675068+0000 (oldest deadline 2019-11-29T03:41:42.554012+0000) 2019-11-29T03:41:45.494 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:41:45.490+0000 1694c700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.995365+0000 front 2019-11-29T03:40:57.145029+0000 (oldest deadline 2019-11-29T03:41:40.478791+0000) 2019-11-29T03:41:45.883 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:41:45.878+0000 1694c700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.626104+0000 front 2019-11-29T03:40:58.340990+0000 (oldest deadline 2019-11-29T03:41:42.407457+0000) 2019-11-29T03:41:45.914 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:41:45.908+0000 1694c700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.594647+0000 front 2019-11-29T03:40:58.463297+0000 (oldest deadline 2019-11-29T03:41:40.730528+0000) 2019-11-29T03:41:45.918 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:41:45.909+0000 1694c700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.485894+0000 front 2019-11-29T03:40:56.612776+0000 (oldest deadline 2019-11-29T03:41:39.828632+0000) 2019-11-29T03:41:45.993 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:41:45.990+0000 1694c700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.091387+0000 front 2019-11-29T03:40:57.078720+0000 (oldest deadline 2019-11-29T03:41:42.328749+0000) 2019-11-29T03:41:46.135 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:41:46.129+0000 1694c700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.650487+0000 front 2019-11-29T03:40:56.636176+0000 (oldest deadline 2019-11-29T03:41:42.523716+0000) 2019-11-29T03:41:46.217 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:41:46.212+0000 1694c700 -1 osd.5 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.676523+0000 front 2019-11-29T03:40:57.675068+0000 (oldest deadline 2019-11-29T03:41:42.554012+0000) 2019-11-29T03:41:46.509 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:41:46.505+0000 1694c700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.995365+0000 front 2019-11-29T03:40:57.145029+0000 (oldest deadline 2019-11-29T03:41:40.478791+0000) 2019-11-29T03:41:46.845 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:41:46.842+0000 1694c700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.626104+0000 front 2019-11-29T03:40:58.340990+0000 (oldest deadline 2019-11-29T03:41:42.407457+0000) 2019-11-29T03:41:46.952 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:41:46.946+0000 1694c700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.485894+0000 front 2019-11-29T03:40:56.612776+0000 (oldest deadline 2019-11-29T03:41:39.828632+0000) 2019-11-29T03:41:46.958 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:41:46.953+0000 1694c700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.594647+0000 front 2019-11-29T03:40:58.463297+0000 (oldest deadline 2019-11-29T03:41:40.730528+0000) 2019-11-29T03:41:47.022 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:41:47.018+0000 1694c700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.091387+0000 front 2019-11-29T03:40:57.078720+0000 (oldest deadline 2019-11-29T03:41:42.328749+0000) 2019-11-29T03:41:47.124 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:41:47.118+0000 1694c700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.650487+0000 front 2019-11-29T03:40:56.636176+0000 (oldest deadline 2019-11-29T03:41:42.523716+0000) 2019-11-29T03:41:47.270 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:41:47.265+0000 1694c700 -1 osd.5 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.676523+0000 front 2019-11-29T03:40:57.675068+0000 (oldest deadline 2019-11-29T03:41:42.554012+0000) 2019-11-29T03:41:47.556 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:41:47.553+0000 1694c700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.995365+0000 front 2019-11-29T03:40:57.145029+0000 (oldest deadline 2019-11-29T03:41:40.478791+0000) 2019-11-29T03:41:47.825 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:41:47.822+0000 1694c700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.626104+0000 front 2019-11-29T03:40:58.340990+0000 (oldest deadline 2019-11-29T03:41:42.407457+0000) 2019-11-29T03:41:47.926 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:41:47.921+0000 1694c700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.485894+0000 front 2019-11-29T03:40:56.612776+0000 (oldest deadline 2019-11-29T03:41:39.828632+0000) 2019-11-29T03:41:47.958 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:41:47.950+0000 1694c700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.594647+0000 front 2019-11-29T03:40:58.463297+0000 (oldest deadline 2019-11-29T03:41:40.730528+0000) 2019-11-29T03:41:48.030 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:41:48.027+0000 1694c700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.091387+0000 front 2019-11-29T03:40:57.078720+0000 (oldest deadline 2019-11-29T03:41:42.328749+0000) 2019-11-29T03:41:48.077 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:41:48.072+0000 1694c700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.650487+0000 front 2019-11-29T03:40:56.636176+0000 (oldest deadline 2019-11-29T03:41:42.523716+0000) 2019-11-29T03:41:48.266 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:41:48.261+0000 1694c700 -1 osd.5 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.676523+0000 front 2019-11-29T03:40:57.675068+0000 (oldest deadline 2019-11-29T03:41:42.554012+0000) 2019-11-29T03:41:48.576 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:41:48.572+0000 1694c700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.995365+0000 front 2019-11-29T03:40:57.145029+0000 (oldest deadline 2019-11-29T03:41:40.478791+0000) 2019-11-29T03:41:48.869 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:41:48.865+0000 1694c700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.626104+0000 front 2019-11-29T03:40:58.340990+0000 (oldest deadline 2019-11-29T03:41:42.407457+0000) 2019-11-29T03:41:48.944 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:41:48.938+0000 1694c700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.485894+0000 front 2019-11-29T03:40:56.612776+0000 (oldest deadline 2019-11-29T03:41:39.828632+0000) 2019-11-29T03:41:48.986 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:41:48.981+0000 1694c700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.594647+0000 front 2019-11-29T03:40:58.463297+0000 (oldest deadline 2019-11-29T03:41:40.730528+0000) 2019-11-29T03:41:49.022 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:41:49.017+0000 1694c700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.091387+0000 front 2019-11-29T03:40:57.078720+0000 (oldest deadline 2019-11-29T03:41:42.328749+0000) 2019-11-29T03:41:49.109 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:41:49.103+0000 1694c700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.650487+0000 front 2019-11-29T03:40:56.636176+0000 (oldest deadline 2019-11-29T03:41:42.523716+0000) 2019-11-29T03:41:49.316 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:41:49.310+0000 1694c700 -1 osd.5 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.676523+0000 front 2019-11-29T03:40:57.675068+0000 (oldest deadline 2019-11-29T03:41:42.554012+0000) 2019-11-29T03:41:49.582 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:41:49.579+0000 1694c700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.995365+0000 front 2019-11-29T03:40:57.145029+0000 (oldest deadline 2019-11-29T03:41:40.478791+0000) 2019-11-29T03:41:49.868 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:41:49.863+0000 1694c700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.626104+0000 front 2019-11-29T03:40:58.340990+0000 (oldest deadline 2019-11-29T03:41:42.407457+0000) 2019-11-29T03:41:49.945 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:41:49.939+0000 1694c700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.485894+0000 front 2019-11-29T03:40:56.612776+0000 (oldest deadline 2019-11-29T03:41:39.828632+0000) 2019-11-29T03:41:50.006 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:41:50.002+0000 1694c700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.091387+0000 front 2019-11-29T03:40:57.078720+0000 (oldest deadline 2019-11-29T03:41:42.328749+0000) 2019-11-29T03:41:50.011 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:41:50.005+0000 1694c700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.594647+0000 front 2019-11-29T03:40:58.463297+0000 (oldest deadline 2019-11-29T03:41:40.730528+0000) 2019-11-29T03:41:50.078 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:41:50.072+0000 1694c700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.650487+0000 front 2019-11-29T03:40:56.636176+0000 (oldest deadline 2019-11-29T03:41:42.523716+0000) 2019-11-29T03:41:50.320 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:41:50.314+0000 1694c700 -1 osd.5 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.676523+0000 front 2019-11-29T03:40:57.675068+0000 (oldest deadline 2019-11-29T03:41:42.554012+0000) 2019-11-29T03:41:50.614 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:41:50.610+0000 1694c700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.995365+0000 front 2019-11-29T03:40:57.145029+0000 (oldest deadline 2019-11-29T03:41:40.478791+0000) 2019-11-29T03:41:50.905 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:41:50.899+0000 1694c700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.485894+0000 front 2019-11-29T03:40:56.612776+0000 (oldest deadline 2019-11-29T03:41:39.828632+0000) 2019-11-29T03:41:50.919 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:41:50.915+0000 1694c700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.626104+0000 front 2019-11-29T03:40:58.340990+0000 (oldest deadline 2019-11-29T03:41:42.407457+0000) 2019-11-29T03:41:50.998 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:41:50.993+0000 1694c700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.091387+0000 front 2019-11-29T03:40:57.078720+0000 (oldest deadline 2019-11-29T03:41:42.328749+0000) 2019-11-29T03:41:51.064 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:41:51.058+0000 1694c700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.594647+0000 front 2019-11-29T03:40:58.463297+0000 (oldest deadline 2019-11-29T03:41:40.730528+0000) 2019-11-29T03:41:51.092 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:41:51.087+0000 1694c700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.650487+0000 front 2019-11-29T03:40:56.636176+0000 (oldest deadline 2019-11-29T03:41:42.523716+0000) 2019-11-29T03:41:51.333 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:41:51.328+0000 1694c700 -1 osd.5 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.676523+0000 front 2019-11-29T03:40:57.675068+0000 (oldest deadline 2019-11-29T03:41:42.554012+0000) 2019-11-29T03:41:51.632 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:41:51.627+0000 1694c700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.995365+0000 front 2019-11-29T03:40:57.145029+0000 (oldest deadline 2019-11-29T03:41:40.478791+0000) 2019-11-29T03:41:51.901 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:41:51.896+0000 1694c700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.626104+0000 front 2019-11-29T03:40:58.340990+0000 (oldest deadline 2019-11-29T03:41:42.407457+0000) 2019-11-29T03:41:51.919 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:41:51.914+0000 1694c700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.485894+0000 front 2019-11-29T03:40:56.612776+0000 (oldest deadline 2019-11-29T03:41:39.828632+0000) 2019-11-29T03:41:51.992 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:41:51.989+0000 1694c700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.091387+0000 front 2019-11-29T03:40:57.078720+0000 (oldest deadline 2019-11-29T03:41:42.328749+0000) 2019-11-29T03:41:52.064 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:41:52.058+0000 1694c700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.594647+0000 front 2019-11-29T03:40:58.463297+0000 (oldest deadline 2019-11-29T03:41:40.730528+0000) 2019-11-29T03:41:52.102 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:41:52.096+0000 1694c700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.650487+0000 front 2019-11-29T03:40:56.636176+0000 (oldest deadline 2019-11-29T03:41:42.523716+0000) 2019-11-29T03:41:52.333 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:41:52.327+0000 1694c700 -1 osd.5 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.676523+0000 front 2019-11-29T03:40:57.675068+0000 (oldest deadline 2019-11-29T03:41:42.554012+0000) 2019-11-29T03:41:52.634 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:41:52.630+0000 1694c700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.995365+0000 front 2019-11-29T03:40:57.145029+0000 (oldest deadline 2019-11-29T03:41:40.478791+0000) 2019-11-29T03:41:52.944 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:41:52.941+0000 1694c700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.626104+0000 front 2019-11-29T03:40:58.340990+0000 (oldest deadline 2019-11-29T03:41:42.407457+0000) 2019-11-29T03:41:52.948 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:41:52.944+0000 1694c700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.091387+0000 front 2019-11-29T03:40:57.078720+0000 (oldest deadline 2019-11-29T03:41:42.328749+0000) 2019-11-29T03:41:52.951 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:41:52.946+0000 1694c700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.485894+0000 front 2019-11-29T03:40:56.612776+0000 (oldest deadline 2019-11-29T03:41:39.828632+0000) 2019-11-29T03:41:53.040 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:41:53.033+0000 1694c700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.594647+0000 front 2019-11-29T03:40:58.463297+0000 (oldest deadline 2019-11-29T03:41:40.730528+0000) 2019-11-29T03:41:53.140 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:41:53.134+0000 1694c700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.650487+0000 front 2019-11-29T03:40:56.636176+0000 (oldest deadline 2019-11-29T03:41:42.523716+0000) 2019-11-29T03:41:53.294 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:41:53.289+0000 1694c700 -1 osd.5 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.676523+0000 front 2019-11-29T03:40:57.675068+0000 (oldest deadline 2019-11-29T03:41:42.554012+0000) 2019-11-29T03:41:53.671 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:41:53.667+0000 1694c700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.995365+0000 front 2019-11-29T03:40:57.145029+0000 (oldest deadline 2019-11-29T03:41:40.478791+0000) 2019-11-29T03:41:53.939 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:41:53.936+0000 1694c700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.091387+0000 front 2019-11-29T03:40:57.078720+0000 (oldest deadline 2019-11-29T03:41:42.328749+0000) 2019-11-29T03:41:53.988 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:41:53.984+0000 1694c700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.626104+0000 front 2019-11-29T03:40:58.340990+0000 (oldest deadline 2019-11-29T03:41:42.407457+0000) 2019-11-29T03:41:53.993 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:41:53.987+0000 1694c700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.485894+0000 front 2019-11-29T03:40:56.612776+0000 (oldest deadline 2019-11-29T03:41:39.828632+0000) 2019-11-29T03:41:54.079 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:41:54.073+0000 1694c700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.594647+0000 front 2019-11-29T03:40:58.463297+0000 (oldest deadline 2019-11-29T03:41:40.730528+0000) 2019-11-29T03:41:54.173 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:41:54.166+0000 1694c700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.650487+0000 front 2019-11-29T03:40:56.636176+0000 (oldest deadline 2019-11-29T03:41:42.523716+0000) 2019-11-29T03:41:54.318 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:41:54.312+0000 1694c700 -1 osd.5 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.676523+0000 front 2019-11-29T03:40:57.675068+0000 (oldest deadline 2019-11-29T03:41:42.554012+0000) 2019-11-29T03:41:54.674 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:41:54.671+0000 1694c700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.995365+0000 front 2019-11-29T03:40:57.145029+0000 (oldest deadline 2019-11-29T03:41:40.478791+0000) 2019-11-29T03:41:54.943 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:41:54.938+0000 1694c700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.626104+0000 front 2019-11-29T03:40:58.340990+0000 (oldest deadline 2019-11-29T03:41:42.407457+0000) 2019-11-29T03:41:54.946 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:41:54.942+0000 1694c700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.091387+0000 front 2019-11-29T03:40:57.078720+0000 (oldest deadline 2019-11-29T03:41:42.328749+0000) 2019-11-29T03:41:55.047 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:41:55.039+0000 1694c700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.485894+0000 front 2019-11-29T03:40:56.612776+0000 (oldest deadline 2019-11-29T03:41:39.828632+0000) 2019-11-29T03:41:55.109 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:41:55.103+0000 1694c700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.594647+0000 front 2019-11-29T03:40:58.463297+0000 (oldest deadline 2019-11-29T03:41:40.730528+0000) 2019-11-29T03:41:55.153 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:41:55.147+0000 1694c700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.650487+0000 front 2019-11-29T03:40:56.636176+0000 (oldest deadline 2019-11-29T03:41:42.523716+0000) 2019-11-29T03:41:55.342 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:41:55.337+0000 1694c700 -1 osd.5 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.676523+0000 front 2019-11-29T03:40:57.675068+0000 (oldest deadline 2019-11-29T03:41:42.554012+0000) 2019-11-29T03:41:55.699 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:41:55.696+0000 1694c700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.995365+0000 front 2019-11-29T03:40:57.145029+0000 (oldest deadline 2019-11-29T03:41:40.478791+0000) 2019-11-29T03:41:55.902 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:41:55.899+0000 1694c700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.626104+0000 front 2019-11-29T03:40:58.340990+0000 (oldest deadline 2019-11-29T03:41:42.407457+0000) 2019-11-29T03:41:55.994 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:41:55.989+0000 1694c700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.091387+0000 front 2019-11-29T03:40:57.078720+0000 (oldest deadline 2019-11-29T03:41:42.328749+0000) 2019-11-29T03:41:56.075 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:41:56.070+0000 1694c700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.485894+0000 front 2019-11-29T03:40:56.612776+0000 (oldest deadline 2019-11-29T03:41:39.828632+0000) 2019-11-29T03:41:56.092 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:41:56.088+0000 1694c700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.594647+0000 front 2019-11-29T03:40:58.463297+0000 (oldest deadline 2019-11-29T03:41:40.730528+0000) 2019-11-29T03:41:56.174 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:41:56.168+0000 1694c700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.650487+0000 front 2019-11-29T03:40:56.636176+0000 (oldest deadline 2019-11-29T03:41:42.523716+0000) 2019-11-29T03:41:56.355 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:41:56.349+0000 1694c700 -1 osd.5 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.676523+0000 front 2019-11-29T03:40:57.675068+0000 (oldest deadline 2019-11-29T03:41:42.554012+0000) 2019-11-29T03:41:56.703 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:41:56.699+0000 1694c700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.995365+0000 front 2019-11-29T03:40:57.145029+0000 (oldest deadline 2019-11-29T03:41:40.478791+0000) 2019-11-29T03:41:56.914 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:41:56.911+0000 1694c700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.626104+0000 front 2019-11-29T03:40:58.340990+0000 (oldest deadline 2019-11-29T03:41:42.407457+0000) 2019-11-29T03:41:56.948 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:41:56.945+0000 1694c700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.091387+0000 front 2019-11-29T03:40:57.078720+0000 (oldest deadline 2019-11-29T03:41:42.328749+0000) 2019-11-29T03:41:57.063 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:41:57.057+0000 1694c700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.485894+0000 front 2019-11-29T03:40:56.612776+0000 (oldest deadline 2019-11-29T03:41:39.828632+0000) 2019-11-29T03:41:57.113 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:41:57.107+0000 1694c700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.594647+0000 front 2019-11-29T03:40:58.463297+0000 (oldest deadline 2019-11-29T03:41:40.730528+0000) 2019-11-29T03:41:57.189 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:41:57.184+0000 1694c700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.650487+0000 front 2019-11-29T03:40:56.636176+0000 (oldest deadline 2019-11-29T03:41:42.523716+0000) 2019-11-29T03:41:57.323 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:41:57.317+0000 1694c700 -1 osd.5 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.676523+0000 front 2019-11-29T03:40:57.675068+0000 (oldest deadline 2019-11-29T03:41:42.554012+0000) 2019-11-29T03:41:57.708 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:41:57.703+0000 1694c700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.995365+0000 front 2019-11-29T03:40:57.145029+0000 (oldest deadline 2019-11-29T03:41:40.478791+0000) 2019-11-29T03:41:57.907 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:41:57.904+0000 1694c700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.626104+0000 front 2019-11-29T03:40:58.340990+0000 (oldest deadline 2019-11-29T03:41:42.407457+0000) 2019-11-29T03:41:57.951 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:41:57.948+0000 1694c700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.091387+0000 front 2019-11-29T03:40:57.078720+0000 (oldest deadline 2019-11-29T03:41:42.328749+0000) 2019-11-29T03:41:58.020 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:41:58.014+0000 1694c700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.485894+0000 front 2019-11-29T03:40:56.612776+0000 (oldest deadline 2019-11-29T03:41:39.828632+0000) 2019-11-29T03:41:58.088 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:41:58.082+0000 1694c700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.594647+0000 front 2019-11-29T03:40:58.463297+0000 (oldest deadline 2019-11-29T03:41:40.730528+0000) 2019-11-29T03:41:58.188 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:41:58.182+0000 1694c700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.650487+0000 front 2019-11-29T03:40:56.636176+0000 (oldest deadline 2019-11-29T03:41:42.523716+0000) 2019-11-29T03:41:58.377 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:41:58.371+0000 1694c700 -1 osd.5 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.676523+0000 front 2019-11-29T03:40:57.675068+0000 (oldest deadline 2019-11-29T03:41:42.554012+0000) 2019-11-29T03:41:58.697 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:41:58.693+0000 1694c700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.995365+0000 front 2019-11-29T03:40:57.145029+0000 (oldest deadline 2019-11-29T03:41:40.478791+0000) 2019-11-29T03:41:58.915 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:41:58.911+0000 1694c700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.626104+0000 front 2019-11-29T03:40:58.340990+0000 (oldest deadline 2019-11-29T03:41:42.407457+0000) 2019-11-29T03:41:58.977 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:41:58.974+0000 1694c700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.091387+0000 front 2019-11-29T03:40:57.078720+0000 (oldest deadline 2019-11-29T03:41:42.328749+0000) 2019-11-29T03:41:59.062 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:41:59.056+0000 1694c700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.485894+0000 front 2019-11-29T03:40:56.612776+0000 (oldest deadline 2019-11-29T03:41:39.828632+0000) 2019-11-29T03:41:59.159 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:41:59.132+0000 1694c700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.594647+0000 front 2019-11-29T03:40:58.463297+0000 (oldest deadline 2019-11-29T03:41:40.730528+0000) 2019-11-29T03:41:59.167 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:41:59.162+0000 1694c700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.650487+0000 front 2019-11-29T03:40:56.636176+0000 (oldest deadline 2019-11-29T03:41:42.523716+0000) 2019-11-29T03:41:59.400 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:41:59.394+0000 1694c700 -1 osd.5 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.676523+0000 front 2019-11-29T03:40:57.675068+0000 (oldest deadline 2019-11-29T03:41:42.554012+0000) 2019-11-29T03:41:59.740 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:41:59.734+0000 1694c700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.995365+0000 front 2019-11-29T03:40:57.145029+0000 (oldest deadline 2019-11-29T03:41:40.478791+0000) 2019-11-29T03:41:59.962 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:41:59.958+0000 1694c700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.626104+0000 front 2019-11-29T03:40:58.340990+0000 (oldest deadline 2019-11-29T03:41:42.407457+0000) 2019-11-29T03:41:59.972 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:41:59.968+0000 1694c700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.091387+0000 front 2019-11-29T03:40:57.078720+0000 (oldest deadline 2019-11-29T03:41:42.328749+0000) 2019-11-29T03:42:00.050 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:42:00.045+0000 1694c700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.485894+0000 front 2019-11-29T03:40:56.612776+0000 (oldest deadline 2019-11-29T03:41:39.828632+0000) 2019-11-29T03:42:00.126 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:42:00.120+0000 1694c700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.594647+0000 front 2019-11-29T03:40:58.463297+0000 (oldest deadline 2019-11-29T03:41:40.730528+0000) 2019-11-29T03:42:00.203 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:42:00.197+0000 1694c700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.650487+0000 front 2019-11-29T03:40:56.636176+0000 (oldest deadline 2019-11-29T03:41:42.523716+0000) 2019-11-29T03:42:00.376 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:42:00.371+0000 1694c700 -1 osd.5 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.676523+0000 front 2019-11-29T03:40:57.675068+0000 (oldest deadline 2019-11-29T03:41:42.554012+0000) 2019-11-29T03:42:00.724 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:42:00.721+0000 1694c700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.995365+0000 front 2019-11-29T03:40:57.145029+0000 (oldest deadline 2019-11-29T03:41:40.478791+0000) 2019-11-29T03:42:00.922 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:42:00.918+0000 1694c700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.626104+0000 front 2019-11-29T03:40:58.340990+0000 (oldest deadline 2019-11-29T03:41:42.407457+0000) 2019-11-29T03:42:00.982 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:42:00.979+0000 1694c700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.091387+0000 front 2019-11-29T03:40:57.078720+0000 (oldest deadline 2019-11-29T03:41:42.328749+0000) 2019-11-29T03:42:01.075 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:42:01.071+0000 1694c700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.485894+0000 front 2019-11-29T03:40:56.612776+0000 (oldest deadline 2019-11-29T03:41:39.828632+0000) 2019-11-29T03:42:01.105 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:42:01.100+0000 1694c700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.594647+0000 front 2019-11-29T03:40:58.463297+0000 (oldest deadline 2019-11-29T03:41:40.730528+0000) 2019-11-29T03:42:01.185 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:42:01.179+0000 1694c700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.650487+0000 front 2019-11-29T03:40:56.636176+0000 (oldest deadline 2019-11-29T03:41:42.523716+0000) 2019-11-29T03:42:01.368 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:42:01.362+0000 1694c700 -1 osd.5 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.676523+0000 front 2019-11-29T03:40:57.675068+0000 (oldest deadline 2019-11-29T03:41:42.554012+0000) 2019-11-29T03:42:01.757 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:42:01.754+0000 1694c700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.995365+0000 front 2019-11-29T03:40:57.145029+0000 (oldest deadline 2019-11-29T03:41:40.478791+0000) 2019-11-29T03:42:01.923 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:42:01.920+0000 1694c700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.626104+0000 front 2019-11-29T03:40:58.340990+0000 (oldest deadline 2019-11-29T03:41:42.407457+0000) 2019-11-29T03:42:01.936 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:42:01.934+0000 1694c700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.091387+0000 front 2019-11-29T03:40:57.078720+0000 (oldest deadline 2019-11-29T03:41:42.328749+0000) 2019-11-29T03:42:02.071 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:42:02.066+0000 1694c700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.485894+0000 front 2019-11-29T03:40:56.612776+0000 (oldest deadline 2019-11-29T03:41:39.828632+0000) 2019-11-29T03:42:02.147 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:42:02.141+0000 1694c700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.594647+0000 front 2019-11-29T03:40:58.463297+0000 (oldest deadline 2019-11-29T03:41:40.730528+0000) 2019-11-29T03:42:02.236 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:42:02.230+0000 1694c700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.650487+0000 front 2019-11-29T03:40:56.636176+0000 (oldest deadline 2019-11-29T03:41:42.523716+0000) 2019-11-29T03:42:02.352 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:42:02.346+0000 1694c700 -1 osd.5 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.676523+0000 front 2019-11-29T03:40:57.675068+0000 (oldest deadline 2019-11-29T03:41:42.554012+0000) 2019-11-29T03:42:02.770 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:42:02.766+0000 1694c700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.995365+0000 front 2019-11-29T03:40:57.145029+0000 (oldest deadline 2019-11-29T03:41:40.478791+0000) 2019-11-29T03:42:02.950 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:42:02.947+0000 1694c700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.091387+0000 front 2019-11-29T03:40:57.078720+0000 (oldest deadline 2019-11-29T03:41:42.328749+0000) 2019-11-29T03:42:02.964 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:42:02.960+0000 1694c700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.626104+0000 front 2019-11-29T03:40:58.340990+0000 (oldest deadline 2019-11-29T03:41:42.407457+0000) 2019-11-29T03:42:03.059 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:42:03.054+0000 1694c700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.485894+0000 front 2019-11-29T03:40:56.612776+0000 (oldest deadline 2019-11-29T03:41:39.828632+0000) 2019-11-29T03:42:03.111 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:42:03.105+0000 1694c700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.594647+0000 front 2019-11-29T03:40:58.463297+0000 (oldest deadline 2019-11-29T03:41:40.730528+0000) 2019-11-29T03:42:03.226 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:42:03.220+0000 1694c700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.650487+0000 front 2019-11-29T03:40:56.636176+0000 (oldest deadline 2019-11-29T03:41:42.523716+0000) 2019-11-29T03:42:03.350 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:42:03.344+0000 1694c700 -1 osd.5 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.676523+0000 front 2019-11-29T03:40:57.675068+0000 (oldest deadline 2019-11-29T03:41:42.554012+0000) 2019-11-29T03:42:03.771 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:42:03.768+0000 1694c700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.995365+0000 front 2019-11-29T03:40:57.145029+0000 (oldest deadline 2019-11-29T03:41:40.478791+0000) 2019-11-29T03:42:03.958 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:42:03.953+0000 1694c700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.626104+0000 front 2019-11-29T03:40:58.340990+0000 (oldest deadline 2019-11-29T03:41:42.407457+0000) 2019-11-29T03:42:03.985 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:42:03.981+0000 1694c700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.091387+0000 front 2019-11-29T03:40:57.078720+0000 (oldest deadline 2019-11-29T03:41:42.328749+0000) 2019-11-29T03:42:04.067 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:42:04.061+0000 1694c700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.485894+0000 front 2019-11-29T03:40:56.612776+0000 (oldest deadline 2019-11-29T03:41:39.828632+0000) 2019-11-29T03:42:04.151 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:42:04.146+0000 1694c700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.594647+0000 front 2019-11-29T03:40:58.463297+0000 (oldest deadline 2019-11-29T03:41:40.730528+0000) 2019-11-29T03:42:04.249 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:42:04.244+0000 1694c700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.650487+0000 front 2019-11-29T03:40:56.636176+0000 (oldest deadline 2019-11-29T03:41:42.523716+0000) 2019-11-29T03:42:04.362 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:42:04.356+0000 1694c700 -1 osd.5 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.676523+0000 front 2019-11-29T03:40:57.675068+0000 (oldest deadline 2019-11-29T03:41:42.554012+0000) 2019-11-29T03:42:04.800 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:42:04.797+0000 1694c700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.995365+0000 front 2019-11-29T03:40:57.145029+0000 (oldest deadline 2019-11-29T03:41:40.478791+0000) 2019-11-29T03:42:04.916 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:42:04.912+0000 1694c700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.626104+0000 front 2019-11-29T03:40:58.340990+0000 (oldest deadline 2019-11-29T03:41:42.407457+0000) 2019-11-29T03:42:05.010 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:42:05.008+0000 1694c700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.091387+0000 front 2019-11-29T03:40:57.078720+0000 (oldest deadline 2019-11-29T03:41:42.328749+0000) 2019-11-29T03:42:05.059 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:42:05.053+0000 1694c700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.485894+0000 front 2019-11-29T03:40:56.612776+0000 (oldest deadline 2019-11-29T03:41:39.828632+0000) 2019-11-29T03:42:05.169 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:42:05.163+0000 1694c700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.594647+0000 front 2019-11-29T03:40:58.463297+0000 (oldest deadline 2019-11-29T03:41:40.730528+0000) 2019-11-29T03:42:05.269 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:42:05.263+0000 1694c700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.650487+0000 front 2019-11-29T03:40:56.636176+0000 (oldest deadline 2019-11-29T03:41:42.523716+0000) 2019-11-29T03:42:05.406 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:42:05.401+0000 1694c700 -1 osd.5 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.676523+0000 front 2019-11-29T03:40:57.675068+0000 (oldest deadline 2019-11-29T03:41:42.554012+0000) 2019-11-29T03:42:05.769 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:42:05.765+0000 1694c700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.995365+0000 front 2019-11-29T03:40:57.145029+0000 (oldest deadline 2019-11-29T03:41:40.478791+0000) 2019-11-29T03:42:05.903 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:42:05.900+0000 1694c700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.626104+0000 front 2019-11-29T03:40:58.340990+0000 (oldest deadline 2019-11-29T03:41:42.407457+0000) 2019-11-29T03:42:05.976 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:42:05.973+0000 1694c700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.091387+0000 front 2019-11-29T03:40:57.078720+0000 (oldest deadline 2019-11-29T03:41:42.328749+0000) 2019-11-29T03:42:06.033 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:42:06.028+0000 1694c700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.485894+0000 front 2019-11-29T03:40:56.612776+0000 (oldest deadline 2019-11-29T03:41:39.828632+0000) 2019-11-29T03:42:06.159 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:42:06.153+0000 1694c700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.594647+0000 front 2019-11-29T03:40:58.463297+0000 (oldest deadline 2019-11-29T03:41:40.730528+0000) 2019-11-29T03:42:06.251 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:42:06.245+0000 1694c700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.650487+0000 front 2019-11-29T03:40:56.636176+0000 (oldest deadline 2019-11-29T03:41:42.523716+0000) 2019-11-29T03:42:06.456 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:42:06.451+0000 1694c700 -1 osd.5 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.676523+0000 front 2019-11-29T03:40:57.675068+0000 (oldest deadline 2019-11-29T03:41:42.554012+0000) 2019-11-29T03:42:06.796 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:42:06.793+0000 1694c700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.995365+0000 front 2019-11-29T03:40:57.145029+0000 (oldest deadline 2019-11-29T03:41:40.478791+0000) 2019-11-29T03:42:06.954 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:42:06.950+0000 1694c700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.626104+0000 front 2019-11-29T03:40:58.340990+0000 (oldest deadline 2019-11-29T03:41:42.407457+0000) 2019-11-29T03:42:06.971 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:42:06.969+0000 1694c700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.091387+0000 front 2019-11-29T03:40:57.078720+0000 (oldest deadline 2019-11-29T03:41:42.328749+0000) 2019-11-29T03:42:07.078 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:42:07.072+0000 1694c700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.485894+0000 front 2019-11-29T03:40:56.612776+0000 (oldest deadline 2019-11-29T03:41:39.828632+0000) 2019-11-29T03:42:07.173 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:42:07.167+0000 1694c700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.594647+0000 front 2019-11-29T03:40:58.463297+0000 (oldest deadline 2019-11-29T03:41:40.730528+0000) 2019-11-29T03:42:07.226 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:42:07.220+0000 1694c700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.650487+0000 front 2019-11-29T03:40:56.636176+0000 (oldest deadline 2019-11-29T03:41:42.523716+0000) 2019-11-29T03:42:07.497 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:42:07.492+0000 1694c700 -1 osd.5 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.676523+0000 front 2019-11-29T03:40:57.675068+0000 (oldest deadline 2019-11-29T03:41:42.554012+0000) 2019-11-29T03:42:07.800 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:42:07.797+0000 1694c700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.995365+0000 front 2019-11-29T03:40:57.145029+0000 (oldest deadline 2019-11-29T03:41:40.478791+0000) 2019-11-29T03:42:07.929 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:42:07.926+0000 1694c700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.091387+0000 front 2019-11-29T03:40:57.078720+0000 (oldest deadline 2019-11-29T03:41:42.328749+0000) 2019-11-29T03:42:07.956 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:42:07.953+0000 1694c700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.626104+0000 front 2019-11-29T03:40:58.340990+0000 (oldest deadline 2019-11-29T03:41:42.407457+0000) 2019-11-29T03:42:08.109 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:42:08.103+0000 1694c700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.485894+0000 front 2019-11-29T03:40:56.612776+0000 (oldest deadline 2019-11-29T03:41:39.828632+0000) 2019-11-29T03:42:08.149 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:42:08.144+0000 1694c700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.594647+0000 front 2019-11-29T03:40:58.463297+0000 (oldest deadline 2019-11-29T03:41:40.730528+0000) 2019-11-29T03:42:08.266 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:42:08.260+0000 1694c700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.650487+0000 front 2019-11-29T03:40:56.636176+0000 (oldest deadline 2019-11-29T03:41:42.523716+0000) 2019-11-29T03:42:08.480 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:42:08.474+0000 1694c700 -1 osd.5 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.676523+0000 front 2019-11-29T03:40:57.675068+0000 (oldest deadline 2019-11-29T03:41:42.554012+0000) 2019-11-29T03:42:08.760 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:42:08.755+0000 1694c700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.995365+0000 front 2019-11-29T03:40:57.145029+0000 (oldest deadline 2019-11-29T03:41:40.478791+0000) 2019-11-29T03:42:08.884 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:42:08.881+0000 1694c700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.091387+0000 front 2019-11-29T03:40:57.078720+0000 (oldest deadline 2019-11-29T03:41:42.328749+0000) 2019-11-29T03:42:08.917 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:42:08.914+0000 1694c700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.626104+0000 front 2019-11-29T03:40:58.340990+0000 (oldest deadline 2019-11-29T03:41:42.407457+0000) 2019-11-29T03:42:09.104 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:42:09.098+0000 1694c700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.485894+0000 front 2019-11-29T03:40:56.612776+0000 (oldest deadline 2019-11-29T03:41:39.828632+0000) 2019-11-29T03:42:09.167 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:42:09.162+0000 1694c700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.594647+0000 front 2019-11-29T03:40:58.463297+0000 (oldest deadline 2019-11-29T03:41:40.730528+0000) 2019-11-29T03:42:09.222 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:42:09.217+0000 1694c700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.650487+0000 front 2019-11-29T03:40:56.636176+0000 (oldest deadline 2019-11-29T03:41:42.523716+0000) 2019-11-29T03:42:09.446 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:42:09.441+0000 1694c700 -1 osd.5 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.676523+0000 front 2019-11-29T03:40:57.675068+0000 (oldest deadline 2019-11-29T03:41:42.554012+0000) 2019-11-29T03:42:09.774 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:42:09.772+0000 1694c700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.995365+0000 front 2019-11-29T03:40:57.145029+0000 (oldest deadline 2019-11-29T03:41:40.478791+0000) 2019-11-29T03:42:09.865 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:42:09.862+0000 1694c700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.091387+0000 front 2019-11-29T03:40:57.078720+0000 (oldest deadline 2019-11-29T03:41:42.328749+0000) 2019-11-29T03:42:09.887 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:42:09.885+0000 1694c700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.626104+0000 front 2019-11-29T03:40:58.340990+0000 (oldest deadline 2019-11-29T03:41:42.407457+0000) 2019-11-29T03:42:10.115 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:42:10.109+0000 1694c700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.485894+0000 front 2019-11-29T03:40:56.612776+0000 (oldest deadline 2019-11-29T03:41:39.828632+0000) 2019-11-29T03:42:10.131 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:42:10.126+0000 1694c700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.594647+0000 front 2019-11-29T03:40:58.463297+0000 (oldest deadline 2019-11-29T03:41:40.730528+0000) 2019-11-29T03:42:10.218 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:42:10.212+0000 1694c700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.650487+0000 front 2019-11-29T03:40:56.636176+0000 (oldest deadline 2019-11-29T03:41:42.523716+0000) 2019-11-29T03:42:10.463 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:42:10.457+0000 1694c700 -1 osd.5 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.676523+0000 front 2019-11-29T03:40:57.675068+0000 (oldest deadline 2019-11-29T03:41:42.554012+0000) 2019-11-29T03:42:10.802 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:42:10.799+0000 1694c700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.995365+0000 front 2019-11-29T03:40:57.145029+0000 (oldest deadline 2019-11-29T03:41:40.478791+0000) 2019-11-29T03:42:10.872 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:42:10.869+0000 1694c700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.091387+0000 front 2019-11-29T03:40:57.078720+0000 (oldest deadline 2019-11-29T03:41:42.328749+0000) 2019-11-29T03:42:10.883 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:42:10.881+0000 1694c700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.626104+0000 front 2019-11-29T03:40:58.340990+0000 (oldest deadline 2019-11-29T03:41:42.407457+0000) 2019-11-29T03:42:11.089 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:42:11.083+0000 1694c700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.485894+0000 front 2019-11-29T03:40:56.612776+0000 (oldest deadline 2019-11-29T03:41:39.828632+0000) 2019-11-29T03:42:11.159 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:42:11.153+0000 1694c700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.594647+0000 front 2019-11-29T03:40:58.463297+0000 (oldest deadline 2019-11-29T03:41:40.730528+0000) 2019-11-29T03:42:11.235 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:42:11.229+0000 1694c700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.650487+0000 front 2019-11-29T03:40:56.636176+0000 (oldest deadline 2019-11-29T03:41:42.523716+0000) 2019-11-29T03:42:11.484 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:42:11.478+0000 1694c700 -1 osd.5 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.676523+0000 front 2019-11-29T03:40:57.675068+0000 (oldest deadline 2019-11-29T03:41:42.554012+0000) 2019-11-29T03:42:11.838 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:42:11.835+0000 1694c700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.626104+0000 front 2019-11-29T03:40:58.340990+0000 (oldest deadline 2019-11-29T03:41:42.407457+0000) 2019-11-29T03:42:11.848 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:42:11.845+0000 1694c700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.995365+0000 front 2019-11-29T03:40:57.145029+0000 (oldest deadline 2019-11-29T03:41:40.478791+0000) 2019-11-29T03:42:11.868 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:42:11.865+0000 1694c700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.091387+0000 front 2019-11-29T03:40:57.078720+0000 (oldest deadline 2019-11-29T03:41:42.328749+0000) 2019-11-29T03:42:12.118 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:42:12.112+0000 1694c700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.485894+0000 front 2019-11-29T03:40:56.612776+0000 (oldest deadline 2019-11-29T03:41:39.828632+0000) 2019-11-29T03:42:12.157 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:42:12.146+0000 1694c700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.594647+0000 front 2019-11-29T03:40:58.463297+0000 (oldest deadline 2019-11-29T03:41:40.730528+0000) 2019-11-29T03:42:12.271 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:42:12.266+0000 1694c700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.650487+0000 front 2019-11-29T03:40:56.636176+0000 (oldest deadline 2019-11-29T03:41:42.523716+0000) 2019-11-29T03:42:12.523 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:42:12.517+0000 1694c700 -1 osd.5 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.676523+0000 front 2019-11-29T03:40:57.675068+0000 (oldest deadline 2019-11-29T03:41:42.554012+0000) 2019-11-29T03:42:12.826 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:42:12.822+0000 1694c700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.626104+0000 front 2019-11-29T03:40:58.340990+0000 (oldest deadline 2019-11-29T03:41:42.407457+0000) 2019-11-29T03:42:12.849 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:42:12.846+0000 1694c700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.995365+0000 front 2019-11-29T03:40:57.145029+0000 (oldest deadline 2019-11-29T03:41:40.478791+0000) 2019-11-29T03:42:12.877 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:42:12.875+0000 1694c700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.091387+0000 front 2019-11-29T03:40:57.078720+0000 (oldest deadline 2019-11-29T03:41:42.328749+0000) 2019-11-29T03:42:13.148 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:42:13.142+0000 1694c700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.485894+0000 front 2019-11-29T03:40:56.612776+0000 (oldest deadline 2019-11-29T03:41:39.828632+0000) 2019-11-29T03:42:13.203 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:42:13.197+0000 1694c700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.594647+0000 front 2019-11-29T03:40:58.463297+0000 (oldest deadline 2019-11-29T03:41:40.730528+0000) 2019-11-29T03:42:13.232 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:42:13.226+0000 1694c700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.650487+0000 front 2019-11-29T03:40:56.636176+0000 (oldest deadline 2019-11-29T03:41:42.523716+0000) 2019-11-29T03:42:13.551 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:42:13.546+0000 1694c700 -1 osd.5 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.676523+0000 front 2019-11-29T03:40:57.675068+0000 (oldest deadline 2019-11-29T03:41:42.554012+0000) 2019-11-29T03:42:13.809 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:42:13.806+0000 1694c700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.626104+0000 front 2019-11-29T03:40:58.340990+0000 (oldest deadline 2019-11-29T03:41:42.407457+0000) 2019-11-29T03:42:13.864 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:42:13.862+0000 1694c700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.995365+0000 front 2019-11-29T03:40:57.145029+0000 (oldest deadline 2019-11-29T03:41:40.478791+0000) 2019-11-29T03:42:13.910 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:42:13.908+0000 1694c700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.091387+0000 front 2019-11-29T03:40:57.078720+0000 (oldest deadline 2019-11-29T03:41:42.328749+0000) 2019-11-29T03:42:14.200 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:42:14.194+0000 1694c700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.485894+0000 front 2019-11-29T03:40:56.612776+0000 (oldest deadline 2019-11-29T03:41:39.828632+0000) 2019-11-29T03:42:14.236 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:42:14.230+0000 1694c700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.594647+0000 front 2019-11-29T03:40:58.463297+0000 (oldest deadline 2019-11-29T03:41:40.730528+0000) 2019-11-29T03:42:14.241 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:42:14.235+0000 1694c700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.650487+0000 front 2019-11-29T03:40:56.636176+0000 (oldest deadline 2019-11-29T03:41:42.523716+0000) 2019-11-29T03:42:14.537 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:42:14.532+0000 1694c700 -1 osd.5 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.676523+0000 front 2019-11-29T03:40:57.675068+0000 (oldest deadline 2019-11-29T03:41:42.554012+0000) 2019-11-29T03:42:14.797 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:42:14.794+0000 1694c700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.626104+0000 front 2019-11-29T03:40:58.340990+0000 (oldest deadline 2019-11-29T03:41:42.407457+0000) 2019-11-29T03:42:14.897 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:42:14.894+0000 1694c700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.091387+0000 front 2019-11-29T03:40:57.078720+0000 (oldest deadline 2019-11-29T03:41:42.328749+0000) 2019-11-29T03:42:14.919 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:42:14.915+0000 1694c700 -1 osd.0 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.995365+0000 front 2019-11-29T03:40:57.145029+0000 (oldest deadline 2019-11-29T03:41:40.478791+0000) 2019-11-29T03:42:15.223 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:42:15.217+0000 1694c700 -1 osd.6 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.485894+0000 front 2019-11-29T03:40:56.612776+0000 (oldest deadline 2019-11-29T03:41:39.828632+0000) 2019-11-29T03:42:15.259 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:42:15.254+0000 1694c700 -1 osd.7 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:56.650487+0000 front 2019-11-29T03:40:56.636176+0000 (oldest deadline 2019-11-29T03:41:42.523716+0000) 2019-11-29T03:42:15.287 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:42:15.281+0000 1694c700 -1 osd.4 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.594647+0000 front 2019-11-29T03:40:58.463297+0000 (oldest deadline 2019-11-29T03:41:40.730528+0000) 2019-11-29T03:42:15.519 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:42:15.511+0000 1694c700 -1 osd.5 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.676523+0000 front 2019-11-29T03:40:57.675068+0000 (oldest deadline 2019-11-29T03:41:42.554012+0000) 2019-11-29T03:42:15.547 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:42:15.539+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.74:6802/10096,v1:172.21.15.74:6803/10096] for 43sec e298 v298) 2019-11-29T03:42:15.827 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:42:15.823+0000 1694c700 -1 osd.1 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:58.626104+0000 front 2019-11-29T03:40:58.340990+0000 (oldest deadline 2019-11-29T03:41:42.407457+0000) 2019-11-29T03:42:15.902 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:42:15.898+0000 1694c700 -1 osd.2 298 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:40:57.091387+0000 front 2019-11-29T03:40:57.078720+0000 (oldest deadline 2019-11-29T03:41:42.328749+0000) 2019-11-29T03:42:50.589 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:42:50.577+0000 31783700 -1 osd.3 304 build_incremental_map_msg missing incremental map 304 2019-11-29T03:42:50.640 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:42:50.629+0000 31783700 -1 osd.3 304 build_incremental_map_msg missing incremental map 304 2019-11-29T03:42:50.741 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:42:50.713+0000 31f84700 -1 osd.3 304 build_incremental_map_msg missing incremental map 304 2019-11-29T03:42:51.264 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:42:51.241+0000 31783700 -1 osd.3 304 build_incremental_map_msg missing incremental map 304 2019-11-29T03:42:51.265 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:42:51.243+0000 31f84700 -1 osd.3 304 build_incremental_map_msg missing incremental map 304 2019-11-29T03:42:52.037 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:42:51.959+0000 3678d700 -1 osd.3 304 build_incremental_map_msg missing incremental map 304 2019-11-29T03:42:54.083 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:42:54.062+0000 34789700 -1 osd.3 304 build_incremental_map_msg missing incremental map 304 2019-11-29T03:43:14.090 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:14.086+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:14.105 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:14.101+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:14.543 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:14.539+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:15.016 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:15.012+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:15.127 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:15.124+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:15.128 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:15.125+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:15.595 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:15.590+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:15.722 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:15.719+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:15.985 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:15.971+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:15.986 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:15.978+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:16.082 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:16.077+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:16.105 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:16.100+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:16.598 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:16.593+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:16.735 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:16.731+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:16.965 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:16.958+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:17.024 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:17.019+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:17.059 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:17.056+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:17.099 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:17.096+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:17.641 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:17.635+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:17.697 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:17.693+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:17.925 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:17.919+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:18.016 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:18.012+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:18.053 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:18.047+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:18.081 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:18.078+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:18.637 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:18.631+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:18.701 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:18.696+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:18.977 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:18.972+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:19.003 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:18.998+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:19.015 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:19.010+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:19.074 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:19.070+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:19.664 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:19.659+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:19.704 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:19.701+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:19.975 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:19.970+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:19.988 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:19.984+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:20.048 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:20.043+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:20.092 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:20.088+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:20.438 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:20.434+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:43:20.664 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:20.657+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:20.690 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:20.685+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:20.981 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:20.977+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:21.008 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:21.004+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:21.027 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:21.023+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:21.133 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:21.130+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:21.447 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:21.444+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:43:21.695 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:21.691+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:21.729 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:21.724+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:22.009 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:22.006+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:22.024 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:22.020+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:22.028 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:22.024+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:22.106 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:22.102+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:22.475 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:22.472+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:43:22.663 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:22.660+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:22.754 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:22.749+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:22.979 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:22.976+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:23.025 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:23.017+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:23.072 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:23.067+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:23.098 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:23.094+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:23.521 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:23.518+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:43:23.669 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:23.666+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:23.725 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:23.721+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:23.982 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:23.979+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:24.029 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:24.024+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:24.075 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:24.071+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:24.084 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:24.081+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:24.486 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:24.483+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:43:24.697 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:24.694+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:24.754 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:24.749+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:25.000 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:24.995+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:25.018 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:25.013+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:25.103 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:25.097+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:25.107 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:25.103+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:25.454 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:25.449+0000 1694c700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:42:45.209744+0000 (oldest deadline 2019-11-29T03:43:25.209744+0000) 2019-11-29T03:43:25.455 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:25.451+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:43:25.657 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:25.654+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:25.763 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:25.758+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:26.018 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:26.014+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:26.033 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:26.028+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:26.110 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:26.106+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:26.154 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:26.148+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:26.419 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:26.414+0000 1694c700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:42:45.209744+0000 (oldest deadline 2019-11-29T03:43:25.209744+0000) 2019-11-29T03:43:26.420 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:26.416+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:43:26.703 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:26.699+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:26.820 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:26.815+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:26.996 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:26.990+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:27.007 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:27.001+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:27.127 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:27.124+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:27.177 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:27.172+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:27.411 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:27.407+0000 1694c700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:42:45.209744+0000 (oldest deadline 2019-11-29T03:43:25.209744+0000) 2019-11-29T03:43:27.412 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:27.409+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:43:27.692 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:27.689+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:27.828 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:27.823+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:28.033 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:28.027+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:28.037 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:28.034+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:28.101 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:28.097+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:28.223 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:28.218+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:28.414 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:28.408+0000 1694c700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:42:45.209744+0000 (oldest deadline 2019-11-29T03:43:25.209744+0000) 2019-11-29T03:43:28.414 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:28.411+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:43:28.711 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:28.707+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:28.826 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:28.821+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:29.006 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:29.002+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:29.072 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:29.068+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:29.084 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:29.079+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:29.213 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:29.207+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:29.408 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:29.404+0000 1694c700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:42:45.209744+0000 (oldest deadline 2019-11-29T03:43:25.209744+0000) 2019-11-29T03:43:29.409 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:29.405+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:43:29.721 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:29.718+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:29.844 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:29.838+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:30.009 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:30.005+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:30.072 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:30.067+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:30.114 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:30.110+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:30.209 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:30.204+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:30.420 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:30.416+0000 1694c700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:42:45.209744+0000 (oldest deadline 2019-11-29T03:43:25.209744+0000) 2019-11-29T03:43:30.421 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:30.417+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:43:30.736 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:30.732+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:30.821 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:30.816+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:31.040 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:31.037+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:31.049 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:57:13.267 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:43:31.067 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:57:13.286 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:43:31.083 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:31.079+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:31.098 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:57:13.317 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:43:31.118 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:57:13.338 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:43:31.127 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:31.124+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:31.164 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:57:13.393 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:43:31.167 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:57:13.396 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:43:31.254 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:31.249+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:31.351 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:57:13.570 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:43:31.370 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:57:13.589 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:43:31.377 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:31.374+0000 1694c700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:42:45.209744+0000 (oldest deadline 2019-11-29T03:43:25.209744+0000) 2019-11-29T03:43:31.377 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:31.374+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:43:31.440 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:57:13.668 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:43:31.778 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:31.775+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:31.797 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:31.792+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:32.049 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:32.043+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:32.095 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:32.092+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:32.101 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:32.098+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:32.215 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:32.210+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:32.426 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:32.419+0000 1694c700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:42:45.209744+0000 (oldest deadline 2019-11-29T03:43:25.209744+0000) 2019-11-29T03:43:32.427 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:32.422+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:43:32.808 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:32.805+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:32.830 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:32.823+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:33.098 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:33.092+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:33.105 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:33.102+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:33.127 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:33.124+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:33.248 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:33.243+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:33.441 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:33.438+0000 1694c700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:42:45.209744+0000 (oldest deadline 2019-11-29T03:43:25.209744+0000) 2019-11-29T03:43:33.444 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:33.442+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:43:33.687 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:57:15.905 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:43:33.695 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:57:15.913 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:43:33.699 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:57:15.918 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:43:33.703 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:57:15.922 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:43:33.710 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:57:15.938 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:43:33.717 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:57:15.945 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:43:33.724 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:05:57:15.942 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:43:33.730 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:05:57:15.949 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:43:33.768 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:05:57:15.997 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:43:33.816 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:33.812+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:33.867 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:33.862+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:34.064 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:34.062+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:34.119 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:34.117+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:34.150 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:34.145+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:34.219 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:34.214+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:34.418 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:34.415+0000 1694c700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:42:45.209744+0000 (oldest deadline 2019-11-29T03:43:25.209744+0000) 2019-11-29T03:43:34.419 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:34.416+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:43:34.786 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:34.783+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:34.890 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:34.884+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:35.080 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:35.077+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:35.094 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:35.091+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:35.158 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:35.153+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:35.221 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:35.215+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:35.463 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:35.461+0000 1694c700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:42:45.209744+0000 (oldest deadline 2019-11-29T03:43:25.209744+0000) 2019-11-29T03:43:35.465 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:35.464+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:43:35.814 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:35.811+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:35.933 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:35.928+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:36.118 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:36.115+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:36.124 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:36.122+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:36.162 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:36.157+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:36.208 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:36.197+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:36.460 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:36.457+0000 1694c700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:42:45.209744+0000 (oldest deadline 2019-11-29T03:43:25.209744+0000) 2019-11-29T03:43:36.461 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:36.459+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:43:36.861 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:36.858+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:36.912 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:36.907+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:37.130 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:37.125+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:37.163 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:37.160+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:37.173 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:37.171+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:37.222 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:37.217+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:37.430 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:37.427+0000 1694c700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:42:45.209744+0000 (oldest deadline 2019-11-29T03:43:25.209744+0000) 2019-11-29T03:43:37.431 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:37.430+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:43:37.857 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:37.854+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:37.891 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:37.887+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:38.143 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:38.138+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:38.161 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:38.158+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:38.169 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:38.167+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:38.242 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:38.238+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:38.454 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:38.450+0000 1694c700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:42:45.209744+0000 (oldest deadline 2019-11-29T03:43:25.209744+0000) 2019-11-29T03:43:38.455 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:38.452+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:43:38.873 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:38.870+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:38.924 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:38.920+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:39.169 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:39.164+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:39.195 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:39.192+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:39.198 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:39.195+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:39.244 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:39.239+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:39.473 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:39.469+0000 1694c700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:42:45.209744+0000 (oldest deadline 2019-11-29T03:43:25.209744+0000) 2019-11-29T03:43:39.473 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:39.471+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:43:39.870 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:39.867+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:39.944 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:39.939+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:40.166 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:40.164+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:40.181 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:40.176+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:40.228 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:40.226+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:40.231 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:40.226+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:40.453 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:40.450+0000 1694c700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:42:45.209744+0000 (oldest deadline 2019-11-29T03:43:25.209744+0000) 2019-11-29T03:43:40.454 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:40.452+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:43:40.894 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:40.891+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:40.987 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:40.982+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:41.141 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:41.139+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:41.171 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:41.165+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:41.188 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:41.184+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:41.255 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:41.253+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:41.481 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:41.478+0000 1694c700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:42:45.209744+0000 (oldest deadline 2019-11-29T03:43:25.209744+0000) 2019-11-29T03:43:41.481 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:41.479+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:43:41.905 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:41.902+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:42.010 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:42.005+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:42.126 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:42.124+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:42.201 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:42.195+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:42.211 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:42.208+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:42.212 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:42.207+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:42.522 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:42.519+0000 1694c700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:42:45.209744+0000 (oldest deadline 2019-11-29T03:43:25.209744+0000) 2019-11-29T03:43:42.523 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:42.520+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:43:42.925 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:42.923+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:43.045 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:43.040+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:43.090 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:43.088+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:43.178 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:43.175+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:43.241 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:43.236+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:43.246 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:43.241+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:43.501 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:43.498+0000 1694c700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:42:45.209744+0000 (oldest deadline 2019-11-29T03:43:25.209744+0000) 2019-11-29T03:43:43.502 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:43.499+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:43:43.933 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:43.930+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:44.048 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:44.046+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:44.090 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:44.084+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:44.153 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:44.150+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:44.226 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:44.221+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:44.247 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:44.237+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:44.528 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:44.524+0000 1694c700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:42:45.209744+0000 (oldest deadline 2019-11-29T03:43:25.209744+0000) 2019-11-29T03:43:44.529 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:44.526+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:43:44.906 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:44.903+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:45.083 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:45.079+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:45.129 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:45.120+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:45.178 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:45.175+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:45.239 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:45.232+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:45.244 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:45.238+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:45.508 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:45.504+0000 1694c700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:42:45.209744+0000 (oldest deadline 2019-11-29T03:43:25.209744+0000) 2019-11-29T03:43:45.511 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:45.508+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:43:45.929 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:45.925+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:46.017 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:43:46.011+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 46sec e304 v304) 2019-11-29T03:43:46.061 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:46.057+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:46.125 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:46.119+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:46.207 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:46.204+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:46.238 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:46.232+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:46.255 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:46.250+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:46.488 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:46.484+0000 1694c700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:42:45.209744+0000 (oldest deadline 2019-11-29T03:43:25.209744+0000) 2019-11-29T03:43:46.490 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:46.487+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:43:46.953 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:46.949+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:47.080 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:47.076+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:47.120 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:47.115+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:47.172 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:47.167+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:47.210 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:47.205+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:47.274 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:47.268+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:47.473 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:47.469+0000 1694c700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:42:45.209744+0000 (oldest deadline 2019-11-29T03:43:25.209744+0000) 2019-11-29T03:43:47.473 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:47.471+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:43:47.955 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:47.951+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:48.105 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:48.100+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:48.115 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:48.111+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:48.189 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:48.185+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:48.206 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:48.201+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:48.239 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:48.233+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:48.519 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:48.514+0000 1694c700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:42:45.209744+0000 (oldest deadline 2019-11-29T03:43:25.209744+0000) 2019-11-29T03:43:48.520 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:48.516+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:43:48.949 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:48.945+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:49.081 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:49.077+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:49.102 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:49.097+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:49.182 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:49.178+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:49.212 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:49.207+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:49.249 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:49.244+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:49.551 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:49.546+0000 1694c700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:42:45.209744+0000 (oldest deadline 2019-11-29T03:43:25.209744+0000) 2019-11-29T03:43:49.552 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:49.548+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:43:49.963 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:49.958+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:50.052 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:50.048+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:50.142 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:50.136+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:50.168 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:50.164+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:50.213 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:50.208+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:50.236 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:50.232+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:50.543 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:50.540+0000 1694c700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:42:45.209744+0000 (oldest deadline 2019-11-29T03:43:25.209744+0000) 2019-11-29T03:43:50.547 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:50.544+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:43:50.938 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:50.934+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:51.032 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:43:51.028+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 46sec e304 v304) 2019-11-29T03:43:51.091 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:51.086+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:51.117 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:51.112+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:51.169 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:51.164+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:51.205 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:51.200+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:51.254 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:51.251+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:51.540 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:51.536+0000 1694c700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:42:45.209744+0000 (oldest deadline 2019-11-29T03:43:25.209744+0000) 2019-11-29T03:43:51.541 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:51.538+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:43:51.980 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:51.977+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:52.073 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:52.069+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:52.102 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:52.097+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:52.199 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:52.191+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:52.209 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:52.205+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:52.241 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:52.238+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:52.567 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:52.562+0000 1694c700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:42:45.209744+0000 (oldest deadline 2019-11-29T03:43:25.209744+0000) 2019-11-29T03:43:52.567 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:52.564+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:43:53.029 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:53.025+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:53.075 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:53.069+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:53.077 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:53.073+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:53.215 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:53.208+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:53.220 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:53.213+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:53.280 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:53.276+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:53.588 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:53.583+0000 1694c700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:42:45.209744+0000 (oldest deadline 2019-11-29T03:43:25.209744+0000) 2019-11-29T03:43:53.588 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:53.585+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:43:54.043 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:54.037+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:54.063 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:54.060+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:54.082 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:54.079+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:54.189 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:54.183+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:54.231 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:54.225+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:54.317 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:54.314+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:54.568 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:54.562+0000 1694c700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:42:45.209744+0000 (oldest deadline 2019-11-29T03:43:25.209744+0000) 2019-11-29T03:43:54.569 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:54.564+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:43:55.029 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:55.023+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:55.078 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:55.074+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:55.115 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:55.111+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:55.198 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:43:55.192+0000 1694c700 -1 osd.6 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.032444+0000 front 2019-11-29T03:42:31.076416+0000 (oldest deadline 2019-11-29T03:43:14.515919+0000) 2019-11-29T03:43:55.278 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:55.272+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:55.364 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:55.360+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:55.521 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:55.518+0000 1694c700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:42:45.209744+0000 (oldest deadline 2019-11-29T03:43:25.209744+0000) 2019-11-29T03:43:55.522 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:55.519+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:43:56.040 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:43:56.037+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 46sec e304 v304) 2019-11-29T03:43:56.063 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:56.060+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:56.068 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:56.061+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:56.149 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:56.146+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:56.313 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:56.308+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:56.328 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:56.325+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:56.530 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:56.525+0000 1694c700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:42:45.209744+0000 (oldest deadline 2019-11-29T03:43:25.209744+0000) 2019-11-29T03:43:56.531 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:56.527+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:43:57.027 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:57.022+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:57.062 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:57.057+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:57.112 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:57.108+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:57.283 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:57.280+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:57.352 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:57.347+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:57.502 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:57.496+0000 1694c700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:42:45.209744+0000 (oldest deadline 2019-11-29T03:43:25.209744+0000) 2019-11-29T03:43:57.503 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:57.499+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:43:58.032 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:58.027+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:58.096 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:58.093+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:58.102 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:58.099+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:58.253 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:58.249+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:58.394 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:58.389+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:58.476 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:58.471+0000 1694c700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:42:45.209744+0000 (oldest deadline 2019-11-29T03:43:25.209744+0000) 2019-11-29T03:43:58.477 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:58.473+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:43:59.078 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:43:59.073+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:43:59.111 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:43:59.106+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:43:59.137 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:43:59.133+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:43:59.302 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:43:59.299+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:43:59.446 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:43:59.441+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:43:59.451 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:59.448+0000 1694c700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:42:45.209744+0000 (oldest deadline 2019-11-29T03:43:25.209744+0000) 2019-11-29T03:43:59.452 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:43:59.449+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:44:00.066 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:44:00.062+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:44:00.092 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:44:00.088+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:44:00.118 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:44:00.113+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:44:00.325 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:44:00.320+0000 1694c700 -1 osd.0 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.166795+0000 front 2019-11-29T03:42:29.014734+0000 (oldest deadline 2019-11-29T03:43:13.665485+0000) 2019-11-29T03:44:00.429 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:44:00.424+0000 1694c700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:42:45.209744+0000 (oldest deadline 2019-11-29T03:43:25.209744+0000) 2019-11-29T03:44:00.430 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:44:00.425+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:44:00.492 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:44:00.487+0000 1694c700 -1 osd.4 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:32.452366+0000 front 2019-11-29T03:42:32.840138+0000 (oldest deadline 2019-11-29T03:43:15.262617+0000) 2019-11-29T03:44:01.038 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:44:01.034+0000 1694c700 -1 osd.1 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:28.723960+0000 front 2019-11-29T03:42:28.880847+0000 (oldest deadline 2019-11-29T03:43:13.996248+0000) 2019-11-29T03:44:01.105 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:44:01.101+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 46sec e304 v304) 2019-11-29T03:44:01.123 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:44:01.118+0000 1694c700 -1 osd.7 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:29.502505+0000 front 2019-11-29T03:42:29.537161+0000 (oldest deadline 2019-11-29T03:43:13.574263+0000) 2019-11-29T03:44:01.143 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:44:01.139+0000 1694c700 -1 osd.2 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:42:31.049268+0000 front 2019-11-29T03:42:30.334975+0000 (oldest deadline 2019-11-29T03:43:15.221605+0000) 2019-11-29T03:44:01.453 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:44:01.446+0000 1694c700 -1 osd.3 304 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:42:45.209744+0000 (oldest deadline 2019-11-29T03:43:25.209744+0000) 2019-11-29T03:44:01.456 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:44:01.449+0000 1694c700 -1 osd.3 304 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e302) 2019-11-29T03:44:32.162 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:44:32.154+0000 31783700 -1 osd.5 309 build_incremental_map_msg missing incremental map 309 2019-11-29T03:44:32.448 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:44:32.439+0000 31f84700 -1 osd.5 309 build_incremental_map_msg missing incremental map 309 2019-11-29T03:44:32.633 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:44:32.578+0000 3578b700 -1 osd.5 309 build_incremental_map_msg missing incremental map 309 2019-11-29T03:44:32.698 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:44:32.636+0000 3578b700 -1 osd.5 309 build_incremental_map_msg missing incremental map 309 2019-11-29T03:44:32.765 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:44:32.697+0000 30f82700 -1 osd.5 309 build_incremental_map_msg missing incremental map 309 2019-11-29T03:45:31.322 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:45:31.316+0000 1694c700 -1 osd.5 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.038417+0000 front 2019-11-29T03:44:46.980793+0000 (oldest deadline 2019-11-29T03:45:31.048485+0000) 2019-11-29T03:45:31.642 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:45:31.639+0000 1694c700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:48.440025+0000 front 2019-11-29T03:44:48.565043+0000 (oldest deadline 2019-11-29T03:45:31.326111+0000) 2019-11-29T03:45:32.339 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:45:32.332+0000 1694c700 -1 osd.5 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.038417+0000 front 2019-11-29T03:44:46.980793+0000 (oldest deadline 2019-11-29T03:45:31.048485+0000) 2019-11-29T03:45:32.489 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:45:32.486+0000 1694c700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.060738+0000 front 2019-11-29T03:44:49.060139+0000 (oldest deadline 2019-11-29T03:45:32.451861+0000) 2019-11-29T03:45:32.609 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:45:32.603+0000 1694c700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.602251+0000 front 2019-11-29T03:44:47.624313+0000 (oldest deadline 2019-11-29T03:45:32.263858+0000) 2019-11-29T03:45:32.662 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:45:32.659+0000 1694c700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:48.440025+0000 front 2019-11-29T03:44:48.565043+0000 (oldest deadline 2019-11-29T03:45:31.326111+0000) 2019-11-29T03:45:33.305 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:45:33.299+0000 1694c700 -1 osd.5 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.038417+0000 front 2019-11-29T03:44:46.980793+0000 (oldest deadline 2019-11-29T03:45:31.048485+0000) 2019-11-29T03:45:33.539 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:45:33.536+0000 1694c700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.060738+0000 front 2019-11-29T03:44:49.060139+0000 (oldest deadline 2019-11-29T03:45:32.451861+0000) 2019-11-29T03:45:33.644 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:45:33.637+0000 1694c700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.602251+0000 front 2019-11-29T03:44:47.624313+0000 (oldest deadline 2019-11-29T03:45:32.263858+0000) 2019-11-29T03:45:33.711 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:45:33.707+0000 1694c700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:48.440025+0000 front 2019-11-29T03:44:48.565043+0000 (oldest deadline 2019-11-29T03:45:31.326111+0000) 2019-11-29T03:45:33.773 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:45:33.769+0000 1694c700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.344597+0000 front 2019-11-29T03:44:50.314057+0000 (oldest deadline 2019-11-29T03:45:33.090204+0000) 2019-11-29T03:45:34.293 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:45:34.287+0000 1694c700 -1 osd.5 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.038417+0000 front 2019-11-29T03:44:46.980793+0000 (oldest deadline 2019-11-29T03:45:31.048485+0000) 2019-11-29T03:45:34.569 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:45:34.565+0000 1694c700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.060738+0000 front 2019-11-29T03:44:49.060139+0000 (oldest deadline 2019-11-29T03:45:32.451861+0000) 2019-11-29T03:45:34.669 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:45:34.662+0000 1694c700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.602251+0000 front 2019-11-29T03:44:47.624313+0000 (oldest deadline 2019-11-29T03:45:32.263858+0000) 2019-11-29T03:45:34.684 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:45:34.680+0000 1694c700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:48.440025+0000 front 2019-11-29T03:44:48.565043+0000 (oldest deadline 2019-11-29T03:45:31.326111+0000) 2019-11-29T03:45:34.793 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:45:34.787+0000 1694c700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.344597+0000 front 2019-11-29T03:44:50.314057+0000 (oldest deadline 2019-11-29T03:45:33.090204+0000) 2019-11-29T03:45:34.827 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:45:34.822+0000 1694c700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.566301+0000 front 2019-11-29T03:44:49.626266+0000 (oldest deadline 2019-11-29T03:45:34.181066+0000) 2019-11-29T03:45:35.119 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:45:35.114+0000 1694c700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.432785+0000 front 2019-11-29T03:44:50.607655+0000 (oldest deadline 2019-11-29T03:45:35.104454+0000) 2019-11-29T03:45:35.261 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:45:35.255+0000 1694c700 -1 osd.5 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.038417+0000 front 2019-11-29T03:44:46.980793+0000 (oldest deadline 2019-11-29T03:45:31.048485+0000) 2019-11-29T03:45:35.609 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:45:35.606+0000 1694c700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.060738+0000 front 2019-11-29T03:44:49.060139+0000 (oldest deadline 2019-11-29T03:45:32.451861+0000) 2019-11-29T03:45:35.714 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:45:35.708+0000 1694c700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.602251+0000 front 2019-11-29T03:44:47.624313+0000 (oldest deadline 2019-11-29T03:45:32.263858+0000) 2019-11-29T03:45:35.739 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:45:35.735+0000 1694c700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:48.440025+0000 front 2019-11-29T03:44:48.565043+0000 (oldest deadline 2019-11-29T03:45:31.326111+0000) 2019-11-29T03:45:35.813 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:45:35.809+0000 1694c700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.344597+0000 front 2019-11-29T03:44:50.314057+0000 (oldest deadline 2019-11-29T03:45:33.090204+0000) 2019-11-29T03:45:35.861 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:45:35.856+0000 1694c700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.566301+0000 front 2019-11-29T03:44:49.626266+0000 (oldest deadline 2019-11-29T03:45:34.181066+0000) 2019-11-29T03:45:36.074 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:45:36.072+0000 1694c700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.432785+0000 front 2019-11-29T03:44:50.607655+0000 (oldest deadline 2019-11-29T03:45:35.104454+0000) 2019-11-29T03:45:36.242 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:45:36.237+0000 1694c700 -1 osd.5 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.038417+0000 front 2019-11-29T03:44:46.980793+0000 (oldest deadline 2019-11-29T03:45:31.048485+0000) 2019-11-29T03:45:36.597 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:45:36.592+0000 1694c700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.060738+0000 front 2019-11-29T03:44:49.060139+0000 (oldest deadline 2019-11-29T03:45:32.451861+0000) 2019-11-29T03:45:36.741 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:45:36.735+0000 1694c700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.602251+0000 front 2019-11-29T03:44:47.624313+0000 (oldest deadline 2019-11-29T03:45:32.263858+0000) 2019-11-29T03:45:36.786 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:45:36.781+0000 1694c700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:48.440025+0000 front 2019-11-29T03:44:48.565043+0000 (oldest deadline 2019-11-29T03:45:31.326111+0000) 2019-11-29T03:45:36.827 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:45:36.820+0000 1694c700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.566301+0000 front 2019-11-29T03:44:49.626266+0000 (oldest deadline 2019-11-29T03:45:34.181066+0000) 2019-11-29T03:45:36.834 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:45:36.826+0000 1694c700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.344597+0000 front 2019-11-29T03:44:50.314057+0000 (oldest deadline 2019-11-29T03:45:33.090204+0000) 2019-11-29T03:45:37.123 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:45:37.119+0000 1694c700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.432785+0000 front 2019-11-29T03:44:50.607655+0000 (oldest deadline 2019-11-29T03:45:35.104454+0000) 2019-11-29T03:45:37.258 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:45:37.252+0000 1694c700 -1 osd.5 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.038417+0000 front 2019-11-29T03:44:46.980793+0000 (oldest deadline 2019-11-29T03:45:31.048485+0000) 2019-11-29T03:45:37.577 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:45:37.573+0000 1694c700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.060738+0000 front 2019-11-29T03:44:49.060139+0000 (oldest deadline 2019-11-29T03:45:32.451861+0000) 2019-11-29T03:45:37.737 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:45:37.732+0000 1694c700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.602251+0000 front 2019-11-29T03:44:47.624313+0000 (oldest deadline 2019-11-29T03:45:32.263858+0000) 2019-11-29T03:45:37.770 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:45:37.768+0000 1694c700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:48.440025+0000 front 2019-11-29T03:44:48.565043+0000 (oldest deadline 2019-11-29T03:45:31.326111+0000) 2019-11-29T03:45:37.828 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:45:37.823+0000 1694c700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.566301+0000 front 2019-11-29T03:44:49.626266+0000 (oldest deadline 2019-11-29T03:45:34.181066+0000) 2019-11-29T03:45:37.869 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:45:37.865+0000 1694c700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.344597+0000 front 2019-11-29T03:44:50.314057+0000 (oldest deadline 2019-11-29T03:45:33.090204+0000) 2019-11-29T03:45:38.175 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:45:38.171+0000 1694c700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.432785+0000 front 2019-11-29T03:44:50.607655+0000 (oldest deadline 2019-11-29T03:45:35.104454+0000) 2019-11-29T03:45:38.306 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:45:38.296+0000 1694c700 -1 osd.5 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.038417+0000 front 2019-11-29T03:44:46.980793+0000 (oldest deadline 2019-11-29T03:45:31.048485+0000) 2019-11-29T03:45:38.555 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:45:38.550+0000 1694c700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.060738+0000 front 2019-11-29T03:44:49.060139+0000 (oldest deadline 2019-11-29T03:45:32.451861+0000) 2019-11-29T03:45:38.726 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:45:38.721+0000 1694c700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.602251+0000 front 2019-11-29T03:44:47.624313+0000 (oldest deadline 2019-11-29T03:45:32.263858+0000) 2019-11-29T03:45:38.775 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:45:38.770+0000 1694c700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:48.440025+0000 front 2019-11-29T03:44:48.565043+0000 (oldest deadline 2019-11-29T03:45:31.326111+0000) 2019-11-29T03:45:38.799 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:45:38.794+0000 1694c700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.566301+0000 front 2019-11-29T03:44:49.626266+0000 (oldest deadline 2019-11-29T03:45:34.181066+0000) 2019-11-29T03:45:38.899 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:45:38.893+0000 1694c700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.344597+0000 front 2019-11-29T03:44:50.314057+0000 (oldest deadline 2019-11-29T03:45:33.090204+0000) 2019-11-29T03:45:39.192 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:45:39.189+0000 1694c700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.432785+0000 front 2019-11-29T03:44:50.607655+0000 (oldest deadline 2019-11-29T03:45:35.104454+0000) 2019-11-29T03:45:39.317 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:45:39.312+0000 1694c700 -1 osd.5 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.038417+0000 front 2019-11-29T03:44:46.980793+0000 (oldest deadline 2019-11-29T03:45:31.048485+0000) 2019-11-29T03:45:39.608 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:45:39.603+0000 1694c700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.060738+0000 front 2019-11-29T03:44:49.060139+0000 (oldest deadline 2019-11-29T03:45:32.451861+0000) 2019-11-29T03:45:39.783 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:45:39.777+0000 1694c700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.602251+0000 front 2019-11-29T03:44:47.624313+0000 (oldest deadline 2019-11-29T03:45:32.263858+0000) 2019-11-29T03:45:39.804 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:45:39.801+0000 1694c700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:48.440025+0000 front 2019-11-29T03:44:48.565043+0000 (oldest deadline 2019-11-29T03:45:31.326111+0000) 2019-11-29T03:45:39.849 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:45:39.843+0000 1694c700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.566301+0000 front 2019-11-29T03:44:49.626266+0000 (oldest deadline 2019-11-29T03:45:34.181066+0000) 2019-11-29T03:45:39.857 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:45:39.852+0000 1694c700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.344597+0000 front 2019-11-29T03:44:50.314057+0000 (oldest deadline 2019-11-29T03:45:33.090204+0000) 2019-11-29T03:45:40.178 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:45:40.173+0000 1694c700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.432785+0000 front 2019-11-29T03:44:50.607655+0000 (oldest deadline 2019-11-29T03:45:35.104454+0000) 2019-11-29T03:45:40.352 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:45:40.345+0000 1694c700 -1 osd.5 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.038417+0000 front 2019-11-29T03:44:46.980793+0000 (oldest deadline 2019-11-29T03:45:31.048485+0000) 2019-11-29T03:45:40.636 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:45:40.633+0000 1694c700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.060738+0000 front 2019-11-29T03:44:49.060139+0000 (oldest deadline 2019-11-29T03:45:32.451861+0000) 2019-11-29T03:45:40.770 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:45:40.764+0000 1694c700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.602251+0000 front 2019-11-29T03:44:47.624313+0000 (oldest deadline 2019-11-29T03:45:32.263858+0000) 2019-11-29T03:45:40.821 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:45:40.815+0000 1694c700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.344597+0000 front 2019-11-29T03:44:50.314057+0000 (oldest deadline 2019-11-29T03:45:33.090204+0000) 2019-11-29T03:45:40.822 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:45:40.817+0000 1694c700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.566301+0000 front 2019-11-29T03:44:49.626266+0000 (oldest deadline 2019-11-29T03:45:34.181066+0000) 2019-11-29T03:45:40.835 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:45:40.832+0000 1694c700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:48.440025+0000 front 2019-11-29T03:44:48.565043+0000 (oldest deadline 2019-11-29T03:45:31.326111+0000) 2019-11-29T03:45:41.220 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:45:41.217+0000 1694c700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.432785+0000 front 2019-11-29T03:44:50.607655+0000 (oldest deadline 2019-11-29T03:45:35.104454+0000) 2019-11-29T03:45:41.398 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:45:41.392+0000 1694c700 -1 osd.5 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.038417+0000 front 2019-11-29T03:44:46.980793+0000 (oldest deadline 2019-11-29T03:45:31.048485+0000) 2019-11-29T03:45:41.620 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:45:41.617+0000 1694c700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.060738+0000 front 2019-11-29T03:44:49.060139+0000 (oldest deadline 2019-11-29T03:45:32.451861+0000) 2019-11-29T03:45:41.782 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:45:41.777+0000 1694c700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.602251+0000 front 2019-11-29T03:44:47.624313+0000 (oldest deadline 2019-11-29T03:45:32.263858+0000) 2019-11-29T03:45:41.802 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:45:41.796+0000 1694c700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.566301+0000 front 2019-11-29T03:44:49.626266+0000 (oldest deadline 2019-11-29T03:45:34.181066+0000) 2019-11-29T03:45:41.834 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:45:41.830+0000 1694c700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:48.440025+0000 front 2019-11-29T03:44:48.565043+0000 (oldest deadline 2019-11-29T03:45:31.326111+0000) 2019-11-29T03:45:41.835 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:45:41.829+0000 1694c700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.344597+0000 front 2019-11-29T03:44:50.314057+0000 (oldest deadline 2019-11-29T03:45:33.090204+0000) 2019-11-29T03:45:42.264 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:45:42.259+0000 1694c700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.432785+0000 front 2019-11-29T03:44:50.607655+0000 (oldest deadline 2019-11-29T03:45:35.104454+0000) 2019-11-29T03:45:42.435 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:45:42.429+0000 1694c700 -1 osd.5 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.038417+0000 front 2019-11-29T03:44:46.980793+0000 (oldest deadline 2019-11-29T03:45:31.048485+0000) 2019-11-29T03:45:42.628 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:45:42.624+0000 1694c700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.060738+0000 front 2019-11-29T03:44:49.060139+0000 (oldest deadline 2019-11-29T03:45:32.451861+0000) 2019-11-29T03:45:42.786 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:45:42.780+0000 1694c700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.602251+0000 front 2019-11-29T03:44:47.624313+0000 (oldest deadline 2019-11-29T03:45:32.263858+0000) 2019-11-29T03:45:42.793 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:45:42.790+0000 1694c700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:48.440025+0000 front 2019-11-29T03:44:48.565043+0000 (oldest deadline 2019-11-29T03:45:31.326111+0000) 2019-11-29T03:45:42.809 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:45:42.803+0000 1694c700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.344597+0000 front 2019-11-29T03:44:50.314057+0000 (oldest deadline 2019-11-29T03:45:33.090204+0000) 2019-11-29T03:45:42.834 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:45:42.828+0000 1694c700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.566301+0000 front 2019-11-29T03:44:49.626266+0000 (oldest deadline 2019-11-29T03:45:34.181066+0000) 2019-11-29T03:45:43.264 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:45:43.261+0000 1694c700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.432785+0000 front 2019-11-29T03:44:50.607655+0000 (oldest deadline 2019-11-29T03:45:35.104454+0000) 2019-11-29T03:45:43.468 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:45:43.462+0000 1694c700 -1 osd.5 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.038417+0000 front 2019-11-29T03:44:46.980793+0000 (oldest deadline 2019-11-29T03:45:31.048485+0000) 2019-11-29T03:45:43.616 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:45:43.612+0000 1694c700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.060738+0000 front 2019-11-29T03:44:49.060139+0000 (oldest deadline 2019-11-29T03:45:32.451861+0000) 2019-11-29T03:45:43.765 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:45:43.760+0000 1694c700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.344597+0000 front 2019-11-29T03:44:50.314057+0000 (oldest deadline 2019-11-29T03:45:33.090204+0000) 2019-11-29T03:45:43.770 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:45:43.767+0000 1694c700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:48.440025+0000 front 2019-11-29T03:44:48.565043+0000 (oldest deadline 2019-11-29T03:45:31.326111+0000) 2019-11-29T03:45:43.790 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:45:43.784+0000 1694c700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.566301+0000 front 2019-11-29T03:44:49.626266+0000 (oldest deadline 2019-11-29T03:45:34.181066+0000) 2019-11-29T03:45:43.831 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:45:43.826+0000 1694c700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.602251+0000 front 2019-11-29T03:44:47.624313+0000 (oldest deadline 2019-11-29T03:45:32.263858+0000) 2019-11-29T03:45:44.232 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:45:44.226+0000 1694c700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.432785+0000 front 2019-11-29T03:44:50.607655+0000 (oldest deadline 2019-11-29T03:45:35.104454+0000) 2019-11-29T03:45:44.463 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:45:44.457+0000 1694c700 -1 osd.5 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.038417+0000 front 2019-11-29T03:44:46.980793+0000 (oldest deadline 2019-11-29T03:45:31.048485+0000) 2019-11-29T03:45:44.707 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:45:44.609+0000 1694c700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.060738+0000 front 2019-11-29T03:44:49.060139+0000 (oldest deadline 2019-11-29T03:45:32.451861+0000) 2019-11-29T03:45:44.785 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:45:44.781+0000 1694c700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:48.440025+0000 front 2019-11-29T03:44:48.565043+0000 (oldest deadline 2019-11-29T03:45:31.326111+0000) 2019-11-29T03:45:44.805 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:45:44.799+0000 1694c700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.344597+0000 front 2019-11-29T03:44:50.314057+0000 (oldest deadline 2019-11-29T03:45:33.090204+0000) 2019-11-29T03:45:44.829 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:45:44.823+0000 1694c700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.566301+0000 front 2019-11-29T03:44:49.626266+0000 (oldest deadline 2019-11-29T03:45:34.181066+0000) 2019-11-29T03:45:44.846 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:45:44.840+0000 1694c700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.602251+0000 front 2019-11-29T03:44:47.624313+0000 (oldest deadline 2019-11-29T03:45:32.263858+0000) 2019-11-29T03:45:45.211 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:45:45.207+0000 1694c700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.432785+0000 front 2019-11-29T03:44:50.607655+0000 (oldest deadline 2019-11-29T03:45:35.104454+0000) 2019-11-29T03:45:45.427 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:45:45.422+0000 1694c700 -1 osd.5 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.038417+0000 front 2019-11-29T03:44:46.980793+0000 (oldest deadline 2019-11-29T03:45:31.048485+0000) 2019-11-29T03:45:45.657 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:45:45.653+0000 1694c700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.060738+0000 front 2019-11-29T03:44:49.060139+0000 (oldest deadline 2019-11-29T03:45:32.451861+0000) 2019-11-29T03:45:45.781 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:45:45.775+0000 1694c700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.344597+0000 front 2019-11-29T03:44:50.314057+0000 (oldest deadline 2019-11-29T03:45:33.090204+0000) 2019-11-29T03:45:45.818 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:45:45.812+0000 1694c700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.566301+0000 front 2019-11-29T03:44:49.626266+0000 (oldest deadline 2019-11-29T03:45:34.181066+0000) 2019-11-29T03:45:45.840 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:45:45.831+0000 1694c700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:48.440025+0000 front 2019-11-29T03:44:48.565043+0000 (oldest deadline 2019-11-29T03:45:31.326111+0000) 2019-11-29T03:45:45.882 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:45:45.876+0000 1694c700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.602251+0000 front 2019-11-29T03:44:47.624313+0000 (oldest deadline 2019-11-29T03:45:32.263858+0000) 2019-11-29T03:45:46.230 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:45:46.226+0000 1694c700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.432785+0000 front 2019-11-29T03:44:50.607655+0000 (oldest deadline 2019-11-29T03:45:35.104454+0000) 2019-11-29T03:45:46.424 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:45:46.418+0000 1694c700 -1 osd.5 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.038417+0000 front 2019-11-29T03:44:46.980793+0000 (oldest deadline 2019-11-29T03:45:31.048485+0000) 2019-11-29T03:45:46.629 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:45:46.624+0000 1694c700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.060738+0000 front 2019-11-29T03:44:49.060139+0000 (oldest deadline 2019-11-29T03:45:32.451861+0000) 2019-11-29T03:45:46.798 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:45:46.794+0000 1694c700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:48.440025+0000 front 2019-11-29T03:44:48.565043+0000 (oldest deadline 2019-11-29T03:45:31.326111+0000) 2019-11-29T03:45:46.812 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:45:46.807+0000 1694c700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.344597+0000 front 2019-11-29T03:44:50.314057+0000 (oldest deadline 2019-11-29T03:45:33.090204+0000) 2019-11-29T03:45:46.869 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:45:46.863+0000 1694c700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.566301+0000 front 2019-11-29T03:44:49.626266+0000 (oldest deadline 2019-11-29T03:45:34.181066+0000) 2019-11-29T03:45:46.932 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:45:46.926+0000 1694c700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.602251+0000 front 2019-11-29T03:44:47.624313+0000 (oldest deadline 2019-11-29T03:45:32.263858+0000) 2019-11-29T03:45:47.188 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:45:47.185+0000 1694c700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.432785+0000 front 2019-11-29T03:44:50.607655+0000 (oldest deadline 2019-11-29T03:45:35.104454+0000) 2019-11-29T03:45:47.431 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:45:47.424+0000 1694c700 -1 osd.5 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.038417+0000 front 2019-11-29T03:44:46.980793+0000 (oldest deadline 2019-11-29T03:45:31.048485+0000) 2019-11-29T03:45:47.630 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:45:47.628+0000 1694c700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.060738+0000 front 2019-11-29T03:44:49.060139+0000 (oldest deadline 2019-11-29T03:45:32.451861+0000) 2019-11-29T03:45:47.833 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:45:47.827+0000 1694c700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.344597+0000 front 2019-11-29T03:44:50.314057+0000 (oldest deadline 2019-11-29T03:45:33.090204+0000) 2019-11-29T03:45:47.834 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:45:47.831+0000 1694c700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:48.440025+0000 front 2019-11-29T03:44:48.565043+0000 (oldest deadline 2019-11-29T03:45:31.326111+0000) 2019-11-29T03:45:47.908 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:45:47.902+0000 1694c700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.566301+0000 front 2019-11-29T03:44:49.626266+0000 (oldest deadline 2019-11-29T03:45:34.181066+0000) 2019-11-29T03:45:47.978 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:45:47.973+0000 1694c700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.602251+0000 front 2019-11-29T03:44:47.624313+0000 (oldest deadline 2019-11-29T03:45:32.263858+0000) 2019-11-29T03:45:48.207 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:45:48.205+0000 1694c700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.432785+0000 front 2019-11-29T03:44:50.607655+0000 (oldest deadline 2019-11-29T03:45:35.104454+0000) 2019-11-29T03:45:48.422 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:45:48.416+0000 1694c700 -1 osd.5 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.038417+0000 front 2019-11-29T03:44:46.980793+0000 (oldest deadline 2019-11-29T03:45:31.048485+0000) 2019-11-29T03:45:48.679 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:45:48.675+0000 1694c700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.060738+0000 front 2019-11-29T03:44:49.060139+0000 (oldest deadline 2019-11-29T03:45:32.451861+0000) 2019-11-29T03:45:48.828 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:45:48.823+0000 1694c700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.344597+0000 front 2019-11-29T03:44:50.314057+0000 (oldest deadline 2019-11-29T03:45:33.090204+0000) 2019-11-29T03:45:48.831 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:45:48.829+0000 1694c700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:48.440025+0000 front 2019-11-29T03:44:48.565043+0000 (oldest deadline 2019-11-29T03:45:31.326111+0000) 2019-11-29T03:45:48.922 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:45:48.917+0000 1694c700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.566301+0000 front 2019-11-29T03:44:49.626266+0000 (oldest deadline 2019-11-29T03:45:34.181066+0000) 2019-11-29T03:45:49.001 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:45:48.996+0000 1694c700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.602251+0000 front 2019-11-29T03:44:47.624313+0000 (oldest deadline 2019-11-29T03:45:32.263858+0000) 2019-11-29T03:45:49.163 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:45:49.159+0000 1694c700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.432785+0000 front 2019-11-29T03:44:50.607655+0000 (oldest deadline 2019-11-29T03:45:35.104454+0000) 2019-11-29T03:45:49.418 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:45:49.412+0000 1694c700 -1 osd.5 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.038417+0000 front 2019-11-29T03:44:46.980793+0000 (oldest deadline 2019-11-29T03:45:31.048485+0000) 2019-11-29T03:45:49.675 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:45:49.672+0000 1694c700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.060738+0000 front 2019-11-29T03:44:49.060139+0000 (oldest deadline 2019-11-29T03:45:32.451861+0000) 2019-11-29T03:45:49.793 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:45:49.788+0000 1694c700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.344597+0000 front 2019-11-29T03:44:50.314057+0000 (oldest deadline 2019-11-29T03:45:33.090204+0000) 2019-11-29T03:45:49.833 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:45:49.831+0000 1694c700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:48.440025+0000 front 2019-11-29T03:44:48.565043+0000 (oldest deadline 2019-11-29T03:45:31.326111+0000) 2019-11-29T03:45:49.963 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:45:49.957+0000 1694c700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.566301+0000 front 2019-11-29T03:44:49.626266+0000 (oldest deadline 2019-11-29T03:45:34.181066+0000) 2019-11-29T03:45:50.038 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:45:50.032+0000 1694c700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.602251+0000 front 2019-11-29T03:44:47.624313+0000 (oldest deadline 2019-11-29T03:45:32.263858+0000) 2019-11-29T03:45:50.130 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:45:50.127+0000 1694c700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.432785+0000 front 2019-11-29T03:44:50.607655+0000 (oldest deadline 2019-11-29T03:45:35.104454+0000) 2019-11-29T03:45:50.429 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:45:50.423+0000 1694c700 -1 osd.5 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.038417+0000 front 2019-11-29T03:44:46.980793+0000 (oldest deadline 2019-11-29T03:45:31.048485+0000) 2019-11-29T03:45:50.682 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:45:50.678+0000 1694c700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.060738+0000 front 2019-11-29T03:44:49.060139+0000 (oldest deadline 2019-11-29T03:45:32.451861+0000) 2019-11-29T03:45:50.798 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:45:50.792+0000 1694c700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.344597+0000 front 2019-11-29T03:44:50.314057+0000 (oldest deadline 2019-11-29T03:45:33.090204+0000) 2019-11-29T03:45:50.849 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:45:50.846+0000 1694c700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:48.440025+0000 front 2019-11-29T03:44:48.565043+0000 (oldest deadline 2019-11-29T03:45:31.326111+0000) 2019-11-29T03:45:50.937 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:45:50.930+0000 1694c700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.566301+0000 front 2019-11-29T03:44:49.626266+0000 (oldest deadline 2019-11-29T03:45:34.181066+0000) 2019-11-29T03:45:50.999 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:45:50.994+0000 1694c700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.602251+0000 front 2019-11-29T03:44:47.624313+0000 (oldest deadline 2019-11-29T03:45:32.263858+0000) 2019-11-29T03:45:51.148 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:45:51.146+0000 1694c700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.432785+0000 front 2019-11-29T03:44:50.607655+0000 (oldest deadline 2019-11-29T03:45:35.104454+0000) 2019-11-29T03:45:51.400 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:45:51.394+0000 1694c700 -1 osd.5 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.038417+0000 front 2019-11-29T03:44:46.980793+0000 (oldest deadline 2019-11-29T03:45:31.048485+0000) 2019-11-29T03:45:51.701 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:45:51.696+0000 1694c700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.060738+0000 front 2019-11-29T03:44:49.060139+0000 (oldest deadline 2019-11-29T03:45:32.451861+0000) 2019-11-29T03:45:51.815 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:45:51.809+0000 1694c700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.344597+0000 front 2019-11-29T03:44:50.314057+0000 (oldest deadline 2019-11-29T03:45:33.090204+0000) 2019-11-29T03:45:51.865 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:45:51.862+0000 1694c700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:48.440025+0000 front 2019-11-29T03:44:48.565043+0000 (oldest deadline 2019-11-29T03:45:31.326111+0000) 2019-11-29T03:45:51.916 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:45:51.908+0000 1694c700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.566301+0000 front 2019-11-29T03:44:49.626266+0000 (oldest deadline 2019-11-29T03:45:34.181066+0000) 2019-11-29T03:45:51.989 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:45:51.984+0000 1694c700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.602251+0000 front 2019-11-29T03:44:47.624313+0000 (oldest deadline 2019-11-29T03:45:32.263858+0000) 2019-11-29T03:45:52.132 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:45:52.130+0000 1694c700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.432785+0000 front 2019-11-29T03:44:50.607655+0000 (oldest deadline 2019-11-29T03:45:35.104454+0000) 2019-11-29T03:45:52.363 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:45:52.358+0000 1694c700 -1 osd.5 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.038417+0000 front 2019-11-29T03:44:46.980793+0000 (oldest deadline 2019-11-29T03:45:31.048485+0000) 2019-11-29T03:45:52.688 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:45:52.684+0000 1694c700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.060738+0000 front 2019-11-29T03:44:49.060139+0000 (oldest deadline 2019-11-29T03:45:32.451861+0000) 2019-11-29T03:45:52.810 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:45:52.804+0000 1694c700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.344597+0000 front 2019-11-29T03:44:50.314057+0000 (oldest deadline 2019-11-29T03:45:33.090204+0000) 2019-11-29T03:45:52.830 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:45:52.828+0000 1694c700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:48.440025+0000 front 2019-11-29T03:44:48.565043+0000 (oldest deadline 2019-11-29T03:45:31.326111+0000) 2019-11-29T03:45:52.955 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:45:52.949+0000 1694c700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.602251+0000 front 2019-11-29T03:44:47.624313+0000 (oldest deadline 2019-11-29T03:45:32.263858+0000) 2019-11-29T03:45:52.966 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:45:52.960+0000 1694c700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.566301+0000 front 2019-11-29T03:44:49.626266+0000 (oldest deadline 2019-11-29T03:45:34.181066+0000) 2019-11-29T03:45:53.185 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:45:53.182+0000 1694c700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.432785+0000 front 2019-11-29T03:44:50.607655+0000 (oldest deadline 2019-11-29T03:45:35.104454+0000) 2019-11-29T03:45:53.412 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:45:53.406+0000 1694c700 -1 osd.5 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.038417+0000 front 2019-11-29T03:44:46.980793+0000 (oldest deadline 2019-11-29T03:45:31.048485+0000) 2019-11-29T03:45:53.704 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:45:53.702+0000 1694c700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.060738+0000 front 2019-11-29T03:44:49.060139+0000 (oldest deadline 2019-11-29T03:45:32.451861+0000) 2019-11-29T03:45:53.792 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:45:53.787+0000 1694c700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.344597+0000 front 2019-11-29T03:44:50.314057+0000 (oldest deadline 2019-11-29T03:45:33.090204+0000) 2019-11-29T03:45:53.809 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:45:53.806+0000 1694c700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:48.440025+0000 front 2019-11-29T03:44:48.565043+0000 (oldest deadline 2019-11-29T03:45:31.326111+0000) 2019-11-29T03:45:53.957 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:45:53.952+0000 1694c700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.566301+0000 front 2019-11-29T03:44:49.626266+0000 (oldest deadline 2019-11-29T03:45:34.181066+0000) 2019-11-29T03:45:53.961 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:45:53.956+0000 1694c700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.602251+0000 front 2019-11-29T03:44:47.624313+0000 (oldest deadline 2019-11-29T03:45:32.263858+0000) 2019-11-29T03:45:54.197 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:45:54.193+0000 1694c700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.432785+0000 front 2019-11-29T03:44:50.607655+0000 (oldest deadline 2019-11-29T03:45:35.104454+0000) 2019-11-29T03:45:54.429 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:45:54.424+0000 1694c700 -1 osd.5 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.038417+0000 front 2019-11-29T03:44:46.980793+0000 (oldest deadline 2019-11-29T03:45:31.048485+0000) 2019-11-29T03:45:54.722 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:45:54.719+0000 1694c700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.060738+0000 front 2019-11-29T03:44:49.060139+0000 (oldest deadline 2019-11-29T03:45:32.451861+0000) 2019-11-29T03:45:54.820 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:45:54.814+0000 1694c700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.344597+0000 front 2019-11-29T03:44:50.314057+0000 (oldest deadline 2019-11-29T03:45:33.090204+0000) 2019-11-29T03:45:54.829 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:45:54.825+0000 1694c700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:48.440025+0000 front 2019-11-29T03:44:48.565043+0000 (oldest deadline 2019-11-29T03:45:31.326111+0000) 2019-11-29T03:45:54.918 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:45:54.912+0000 1694c700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.566301+0000 front 2019-11-29T03:44:49.626266+0000 (oldest deadline 2019-11-29T03:45:34.181066+0000) 2019-11-29T03:45:54.943 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:45:54.937+0000 1694c700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.602251+0000 front 2019-11-29T03:44:47.624313+0000 (oldest deadline 2019-11-29T03:45:32.263858+0000) 2019-11-29T03:45:55.177 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:45:55.174+0000 1694c700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.432785+0000 front 2019-11-29T03:44:50.607655+0000 (oldest deadline 2019-11-29T03:45:35.104454+0000) 2019-11-29T03:45:55.415 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:45:55.409+0000 1694c700 -1 osd.5 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.038417+0000 front 2019-11-29T03:44:46.980793+0000 (oldest deadline 2019-11-29T03:45:31.048485+0000) 2019-11-29T03:45:55.763 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:45:55.760+0000 1694c700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.060738+0000 front 2019-11-29T03:44:49.060139+0000 (oldest deadline 2019-11-29T03:45:32.451861+0000) 2019-11-29T03:45:55.781 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:45:55.779+0000 1694c700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:48.440025+0000 front 2019-11-29T03:44:48.565043+0000 (oldest deadline 2019-11-29T03:45:31.326111+0000) 2019-11-29T03:45:55.818 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:45:55.813+0000 1694c700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.344597+0000 front 2019-11-29T03:44:50.314057+0000 (oldest deadline 2019-11-29T03:45:33.090204+0000) 2019-11-29T03:45:55.909 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:45:55.904+0000 1694c700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.566301+0000 front 2019-11-29T03:44:49.626266+0000 (oldest deadline 2019-11-29T03:45:34.181066+0000) 2019-11-29T03:45:55.910 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:45:55.904+0000 1694c700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.602251+0000 front 2019-11-29T03:44:47.624313+0000 (oldest deadline 2019-11-29T03:45:32.263858+0000) 2019-11-29T03:45:56.176 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:45:56.173+0000 1694c700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.432785+0000 front 2019-11-29T03:44:50.607655+0000 (oldest deadline 2019-11-29T03:45:35.104454+0000) 2019-11-29T03:45:56.412 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:45:56.406+0000 1694c700 -1 osd.5 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.038417+0000 front 2019-11-29T03:44:46.980793+0000 (oldest deadline 2019-11-29T03:45:31.048485+0000) 2019-11-29T03:45:56.741 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:45:56.737+0000 1694c700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:48.440025+0000 front 2019-11-29T03:44:48.565043+0000 (oldest deadline 2019-11-29T03:45:31.326111+0000) 2019-11-29T03:45:56.745 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:45:56.742+0000 1694c700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.060738+0000 front 2019-11-29T03:44:49.060139+0000 (oldest deadline 2019-11-29T03:45:32.451861+0000) 2019-11-29T03:45:56.783 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:45:56.774+0000 1694c700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.344597+0000 front 2019-11-29T03:44:50.314057+0000 (oldest deadline 2019-11-29T03:45:33.090204+0000) 2019-11-29T03:45:56.905 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:45:56.899+0000 1694c700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.566301+0000 front 2019-11-29T03:44:49.626266+0000 (oldest deadline 2019-11-29T03:45:34.181066+0000) 2019-11-29T03:45:56.916 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:45:56.910+0000 1694c700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.602251+0000 front 2019-11-29T03:44:47.624313+0000 (oldest deadline 2019-11-29T03:45:32.263858+0000) 2019-11-29T03:45:57.146 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:45:57.143+0000 1694c700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.432785+0000 front 2019-11-29T03:44:50.607655+0000 (oldest deadline 2019-11-29T03:45:35.104454+0000) 2019-11-29T03:45:57.454 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:45:57.448+0000 1694c700 -1 osd.5 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.038417+0000 front 2019-11-29T03:44:46.980793+0000 (oldest deadline 2019-11-29T03:45:31.048485+0000) 2019-11-29T03:45:57.707 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:45:57.704+0000 1694c700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.060738+0000 front 2019-11-29T03:44:49.060139+0000 (oldest deadline 2019-11-29T03:45:32.451861+0000) 2019-11-29T03:45:57.718 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:45:57.716+0000 1694c700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:48.440025+0000 front 2019-11-29T03:44:48.565043+0000 (oldest deadline 2019-11-29T03:45:31.326111+0000) 2019-11-29T03:45:57.765 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:45:57.759+0000 1694c700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.344597+0000 front 2019-11-29T03:44:50.314057+0000 (oldest deadline 2019-11-29T03:45:33.090204+0000) 2019-11-29T03:45:57.863 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:45:57.857+0000 1694c700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.566301+0000 front 2019-11-29T03:44:49.626266+0000 (oldest deadline 2019-11-29T03:45:34.181066+0000) 2019-11-29T03:45:57.963 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:45:57.957+0000 1694c700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.602251+0000 front 2019-11-29T03:44:47.624313+0000 (oldest deadline 2019-11-29T03:45:32.263858+0000) 2019-11-29T03:45:58.147 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:45:58.144+0000 1694c700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.432785+0000 front 2019-11-29T03:44:50.607655+0000 (oldest deadline 2019-11-29T03:45:35.104454+0000) 2019-11-29T03:45:58.460 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:45:58.455+0000 1694c700 -1 osd.5 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.038417+0000 front 2019-11-29T03:44:46.980793+0000 (oldest deadline 2019-11-29T03:45:31.048485+0000) 2019-11-29T03:45:58.703 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:45:58.700+0000 1694c700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.060738+0000 front 2019-11-29T03:44:49.060139+0000 (oldest deadline 2019-11-29T03:45:32.451861+0000) 2019-11-29T03:45:58.741 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:45:58.737+0000 1694c700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:48.440025+0000 front 2019-11-29T03:44:48.565043+0000 (oldest deadline 2019-11-29T03:45:31.326111+0000) 2019-11-29T03:45:58.742 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:45:58.736+0000 1694c700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.344597+0000 front 2019-11-29T03:44:50.314057+0000 (oldest deadline 2019-11-29T03:45:33.090204+0000) 2019-11-29T03:45:58.860 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:45:58.854+0000 1694c700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.566301+0000 front 2019-11-29T03:44:49.626266+0000 (oldest deadline 2019-11-29T03:45:34.181066+0000) 2019-11-29T03:45:59.016 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:45:59.009+0000 1694c700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.602251+0000 front 2019-11-29T03:44:47.624313+0000 (oldest deadline 2019-11-29T03:45:32.263858+0000) 2019-11-29T03:45:59.161 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:45:59.157+0000 1694c700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.432785+0000 front 2019-11-29T03:44:50.607655+0000 (oldest deadline 2019-11-29T03:45:35.104454+0000) 2019-11-29T03:45:59.450 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:45:59.444+0000 1694c700 -1 osd.5 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.038417+0000 front 2019-11-29T03:44:46.980793+0000 (oldest deadline 2019-11-29T03:45:31.048485+0000) 2019-11-29T03:45:59.705 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:45:59.702+0000 1694c700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:48.440025+0000 front 2019-11-29T03:44:48.565043+0000 (oldest deadline 2019-11-29T03:45:31.326111+0000) 2019-11-29T03:45:59.708 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:45:59.705+0000 1694c700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.060738+0000 front 2019-11-29T03:44:49.060139+0000 (oldest deadline 2019-11-29T03:45:32.451861+0000) 2019-11-29T03:45:59.750 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:45:59.744+0000 1694c700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.344597+0000 front 2019-11-29T03:44:50.314057+0000 (oldest deadline 2019-11-29T03:45:33.090204+0000) 2019-11-29T03:45:59.873 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:45:59.867+0000 1694c700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.566301+0000 front 2019-11-29T03:44:49.626266+0000 (oldest deadline 2019-11-29T03:45:34.181066+0000) 2019-11-29T03:45:59.984 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:45:59.979+0000 1694c700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.602251+0000 front 2019-11-29T03:44:47.624313+0000 (oldest deadline 2019-11-29T03:45:32.263858+0000) 2019-11-29T03:46:00.161 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:46:00.158+0000 1694c700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.432785+0000 front 2019-11-29T03:44:50.607655+0000 (oldest deadline 2019-11-29T03:45:35.104454+0000) 2019-11-29T03:46:00.503 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:46:00.497+0000 1694c700 -1 osd.5 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.038417+0000 front 2019-11-29T03:44:46.980793+0000 (oldest deadline 2019-11-29T03:45:31.048485+0000) 2019-11-29T03:46:00.693 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:46:00.690+0000 1694c700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:48.440025+0000 front 2019-11-29T03:44:48.565043+0000 (oldest deadline 2019-11-29T03:45:31.326111+0000) 2019-11-29T03:46:00.699 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:46:00.696+0000 1694c700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.060738+0000 front 2019-11-29T03:44:49.060139+0000 (oldest deadline 2019-11-29T03:45:32.451861+0000) 2019-11-29T03:46:00.767 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:46:00.761+0000 1694c700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.344597+0000 front 2019-11-29T03:44:50.314057+0000 (oldest deadline 2019-11-29T03:45:33.090204+0000) 2019-11-29T03:46:00.883 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:46:00.877+0000 1694c700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.566301+0000 front 2019-11-29T03:44:49.626266+0000 (oldest deadline 2019-11-29T03:45:34.181066+0000) 2019-11-29T03:46:01.028 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:46:01.021+0000 1694c700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.602251+0000 front 2019-11-29T03:44:47.624313+0000 (oldest deadline 2019-11-29T03:45:32.263858+0000) 2019-11-29T03:46:01.206 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:46:01.201+0000 1694c700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.432785+0000 front 2019-11-29T03:44:50.607655+0000 (oldest deadline 2019-11-29T03:45:35.104454+0000) 2019-11-29T03:46:01.516 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:46:01.510+0000 1694c700 -1 osd.5 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.038417+0000 front 2019-11-29T03:44:46.980793+0000 (oldest deadline 2019-11-29T03:45:31.048485+0000) 2019-11-29T03:46:01.665 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:46:01.661+0000 1694c700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.060738+0000 front 2019-11-29T03:44:49.060139+0000 (oldest deadline 2019-11-29T03:45:32.451861+0000) 2019-11-29T03:46:01.697 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:46:01.693+0000 1694c700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:48.440025+0000 front 2019-11-29T03:44:48.565043+0000 (oldest deadline 2019-11-29T03:45:31.326111+0000) 2019-11-29T03:46:01.746 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:46:01.741+0000 1694c700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.344597+0000 front 2019-11-29T03:44:50.314057+0000 (oldest deadline 2019-11-29T03:45:33.090204+0000) 2019-11-29T03:46:01.879 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:46:01.873+0000 1694c700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.566301+0000 front 2019-11-29T03:44:49.626266+0000 (oldest deadline 2019-11-29T03:45:34.181066+0000) 2019-11-29T03:46:02.027 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:46:02.020+0000 1694c700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.602251+0000 front 2019-11-29T03:44:47.624313+0000 (oldest deadline 2019-11-29T03:45:32.263858+0000) 2019-11-29T03:46:02.221 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:46:02.217+0000 1694c700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.432785+0000 front 2019-11-29T03:44:50.607655+0000 (oldest deadline 2019-11-29T03:45:35.104454+0000) 2019-11-29T03:46:02.484 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:46:02.478+0000 1694c700 -1 osd.5 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.038417+0000 front 2019-11-29T03:44:46.980793+0000 (oldest deadline 2019-11-29T03:45:31.048485+0000) 2019-11-29T03:46:02.655 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:46:02.652+0000 1694c700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:48.440025+0000 front 2019-11-29T03:44:48.565043+0000 (oldest deadline 2019-11-29T03:45:31.326111+0000) 2019-11-29T03:46:02.665 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:46:02.660+0000 1694c700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.060738+0000 front 2019-11-29T03:44:49.060139+0000 (oldest deadline 2019-11-29T03:45:32.451861+0000) 2019-11-29T03:46:02.761 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:46:02.755+0000 1694c700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.344597+0000 front 2019-11-29T03:44:50.314057+0000 (oldest deadline 2019-11-29T03:45:33.090204+0000) 2019-11-29T03:46:02.884 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:46:02.878+0000 1694c700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.566301+0000 front 2019-11-29T03:44:49.626266+0000 (oldest deadline 2019-11-29T03:45:34.181066+0000) 2019-11-29T03:46:03.057 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:46:03.051+0000 1694c700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.602251+0000 front 2019-11-29T03:44:47.624313+0000 (oldest deadline 2019-11-29T03:45:32.263858+0000) 2019-11-29T03:46:03.177 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:46:03.172+0000 1694c700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.432785+0000 front 2019-11-29T03:44:50.607655+0000 (oldest deadline 2019-11-29T03:45:35.104454+0000) 2019-11-29T03:46:03.515 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:46:03.510+0000 1694c700 -1 osd.5 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.038417+0000 front 2019-11-29T03:44:46.980793+0000 (oldest deadline 2019-11-29T03:45:31.048485+0000) 2019-11-29T03:46:03.655 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:46:03.652+0000 1694c700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.060738+0000 front 2019-11-29T03:44:49.060139+0000 (oldest deadline 2019-11-29T03:45:32.451861+0000) 2019-11-29T03:46:03.667 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:46:03.664+0000 1694c700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:48.440025+0000 front 2019-11-29T03:44:48.565043+0000 (oldest deadline 2019-11-29T03:45:31.326111+0000) 2019-11-29T03:46:03.760 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:46:03.755+0000 1694c700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.344597+0000 front 2019-11-29T03:44:50.314057+0000 (oldest deadline 2019-11-29T03:45:33.090204+0000) 2019-11-29T03:46:03.856 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:46:03.850+0000 1694c700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.566301+0000 front 2019-11-29T03:44:49.626266+0000 (oldest deadline 2019-11-29T03:45:34.181066+0000) 2019-11-29T03:46:04.107 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:46:04.092+0000 1694c700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.602251+0000 front 2019-11-29T03:44:47.624313+0000 (oldest deadline 2019-11-29T03:45:32.263858+0000) 2019-11-29T03:46:04.183 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:46:04.179+0000 1694c700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.432785+0000 front 2019-11-29T03:44:50.607655+0000 (oldest deadline 2019-11-29T03:45:35.104454+0000) 2019-11-29T03:46:04.551 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:46:04.545+0000 1694c700 -1 osd.5 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.038417+0000 front 2019-11-29T03:44:46.980793+0000 (oldest deadline 2019-11-29T03:45:31.048485+0000) 2019-11-29T03:46:04.630 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:46:04.625+0000 1694c700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.060738+0000 front 2019-11-29T03:44:49.060139+0000 (oldest deadline 2019-11-29T03:45:32.451861+0000) 2019-11-29T03:46:04.680 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:46:04.677+0000 1694c700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:48.440025+0000 front 2019-11-29T03:44:48.565043+0000 (oldest deadline 2019-11-29T03:45:31.326111+0000) 2019-11-29T03:46:04.797 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:46:04.792+0000 1694c700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.344597+0000 front 2019-11-29T03:44:50.314057+0000 (oldest deadline 2019-11-29T03:45:33.090204+0000) 2019-11-29T03:46:04.893 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:46:04.888+0000 1694c700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.566301+0000 front 2019-11-29T03:44:49.626266+0000 (oldest deadline 2019-11-29T03:45:34.181066+0000) 2019-11-29T03:46:05.150 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:46:05.144+0000 1694c700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.602251+0000 front 2019-11-29T03:44:47.624313+0000 (oldest deadline 2019-11-29T03:45:32.263858+0000) 2019-11-29T03:46:05.220 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:46:05.214+0000 1694c700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.432785+0000 front 2019-11-29T03:44:50.607655+0000 (oldest deadline 2019-11-29T03:45:35.104454+0000) 2019-11-29T03:46:05.539 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:46:05.534+0000 1694c700 -1 osd.5 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.038417+0000 front 2019-11-29T03:44:46.980793+0000 (oldest deadline 2019-11-29T03:45:31.048485+0000) 2019-11-29T03:46:05.624 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:46:05.620+0000 1694c700 -1 osd.0 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.060738+0000 front 2019-11-29T03:44:49.060139+0000 (oldest deadline 2019-11-29T03:45:32.451861+0000) 2019-11-29T03:46:05.677 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:46:05.673+0000 1694c700 -1 osd.2 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:48.440025+0000 front 2019-11-29T03:44:48.565043+0000 (oldest deadline 2019-11-29T03:45:31.326111+0000) 2019-11-29T03:46:05.846 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:46:05.842+0000 1694c700 -1 osd.6 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.344597+0000 front 2019-11-29T03:44:50.314057+0000 (oldest deadline 2019-11-29T03:45:33.090204+0000) 2019-11-29T03:46:05.876 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:46:05.871+0000 1694c700 -1 osd.4 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:49.566301+0000 front 2019-11-29T03:44:49.626266+0000 (oldest deadline 2019-11-29T03:45:34.181066+0000) 2019-11-29T03:46:06.112 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:46:06.107+0000 1694c700 -1 osd.7 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.602251+0000 front 2019-11-29T03:44:47.624313+0000 (oldest deadline 2019-11-29T03:45:32.263858+0000) 2019-11-29T03:46:06.259 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:46:06.254+0000 1694c700 -1 osd.1 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:50.432785+0000 front 2019-11-29T03:44:50.607655+0000 (oldest deadline 2019-11-29T03:45:35.104454+0000) 2019-11-29T03:46:06.430 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:46:06.426+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.74:6802/10096,v1:172.21.15.74:6803/10096] for 45sec e309 v309) 2019-11-29T03:46:06.541 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:46:06.505+0000 1694c700 -1 osd.5 309 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:44:47.038417+0000 front 2019-11-29T03:44:46.980793+0000 (oldest deadline 2019-11-29T03:45:31.048485+0000) 2019-11-29T03:46:37.868 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:46:37.847+0000 38791700 -1 osd.0 313 build_incremental_map_msg missing incremental map 313 2019-11-29T03:46:38.041 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:46:37.987+0000 38791700 -1 osd.0 313 build_incremental_map_msg missing incremental map 313 2019-11-29T03:46:38.045 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:46:38.001+0000 35f8c700 -1 osd.0 313 build_incremental_map_msg missing incremental map 313 2019-11-29T03:46:40.649 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:46:40.576+0000 31783700 -1 osd.3 315 build_incremental_map_msg missing incremental map 315 2019-11-29T03:46:40.747 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:46:40.673+0000 3678d700 -1 osd.3 315 build_incremental_map_msg missing incremental map 315 2019-11-29T03:46:40.907 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:46:40.767+0000 33f88700 -1 osd.3 315 build_incremental_map_msg missing incremental map 315 2019-11-29T03:46:40.944 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:46:40.819+0000 35f8c700 -1 osd.3 315 build_incremental_map_msg missing incremental map 315 2019-11-29T03:46:41.026 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:46:40.991+0000 38791700 -1 osd.3 315 build_incremental_map_msg missing incremental map 315 2019-11-29T03:46:42.726 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:46:42.718+0000 37f90700 -1 osd.3 315 build_incremental_map_msg missing incremental map 315 2019-11-29T03:46:42.736 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:46:42.733+0000 38791700 -1 osd.3 315 build_incremental_map_msg missing incremental map 315 2019-11-29T03:46:46.787 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:06:00:29.006 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:46:46.797 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:06:00:29.016 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:46:46.834 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:06:00:29.063 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:46:46.836 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:06:00:29.065 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:46:46.839 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:06:00:29.058 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:46:46.842 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:06:00:29.062 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:46:46.997 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:06:00:29.215 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:46:46.999 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:06:00:29.228 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:46:47.015 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:06:00:29.235 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:47:04.979 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:04.975+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:05.081 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:05.075+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:05.199 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:05.193+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:05.935 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:05.932+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:06.107 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:06.101+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:06.165 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:06.160+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:06.702 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:06.697+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:06.900 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:06.897+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:07.066 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:07.060+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:07.198 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:07.193+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:07.754 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:07.749+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:07.861 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:07.857+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:08.021 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:08.017+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:08.240 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:08.235+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:08.331 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:08.327+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:08.727 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:08.721+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:08.727 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:08.724+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:08.823 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:08.818+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:08.985 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:08.980+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:09.214 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:09.208+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:09.344 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:09.340+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:09.379 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:09.376+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:09.720 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:09.713+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:09.768 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:09.764+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:09.874 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:09.869+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:09.971 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:09.965+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:10.223 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:10.219+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:10.386 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:10.382+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:10.404 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:10.401+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:10.714 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:10.709+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:10.759 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:10.755+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:10.898 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:10.893+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:11.012 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:11.008+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:11.254 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:11.249+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:11.395 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:11.392+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:11.425 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:11.422+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:11.726 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:11.723+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:11.729 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:11.725+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:11.898 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:11.893+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:11.977 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:11.973+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:12.300 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:12.295+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:12.380 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:12.378+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:12.424 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:12.420+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:12.708 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:12.704+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:12.737 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:12.732+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:12.922 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:12.920+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:12.983 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:12.976+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:13.332 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:13.327+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:13.337 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:13.334+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:13.393 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:13.390+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:13.699 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:13.695+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:13.742 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:13.739+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:13.893 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:13.890+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:13.996 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:13.991+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:14.339 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:14.334+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:14.351 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:14.347+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:14.352 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:14.349+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:14.695 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:14.690+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:14.729 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:14.725+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:14.867 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:14.863+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:14.973 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:14.967+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:15.343 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:15.339+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:15.348 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:15.345+0000 1694c700 -1 osd.3 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:46:34.996434+0000 (oldest deadline 2019-11-29T03:47:14.996434+0000) 2019-11-29T03:47:15.351 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:15.348+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:15.358 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:15.353+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:15.732 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:15.727+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:15.784 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:15.779+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:15.837 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:15.833+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:15.974 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:15.970+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:16.338 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:16.335+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:16.357 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:16.354+0000 1694c700 -1 osd.3 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:46:34.996434+0000 (oldest deadline 2019-11-29T03:47:14.996434+0000) 2019-11-29T03:47:16.358 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:16.355+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:16.367 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:16.362+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:16.766 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:16.763+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:16.789 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:16.781+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:16.835 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:16.832+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:16.986 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:16.981+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:17.333 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:17.327+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:17.348 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:17.344+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:17.378 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:17.374+0000 1694c700 -1 osd.3 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:46:34.996434+0000 (oldest deadline 2019-11-29T03:47:14.996434+0000) 2019-11-29T03:47:17.378 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:17.375+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:17.772 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:17.769+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:17.780 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:17.775+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:17.804 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:17.801+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:17.953 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:17.947+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:18.316 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:18.313+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:18.344 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:18.340+0000 1694c700 -1 osd.3 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:46:34.996434+0000 (oldest deadline 2019-11-29T03:47:14.996434+0000) 2019-11-29T03:47:18.347 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:18.346+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:18.383 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:18.378+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:18.781 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:18.776+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:18.807 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:18.801+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:18.819 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:18.815+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:18.976 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:18.971+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:19.285 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:19.282+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:19.365 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:19.362+0000 1694c700 -1 osd.3 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:46:34.996434+0000 (oldest deadline 2019-11-29T03:47:14.996434+0000) 2019-11-29T03:47:19.367 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:19.364+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:19.433 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:19.428+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:19.761 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:19.756+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:19.790 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:19.787+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:19.839 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:19.837+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:20.015 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:20.010+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:20.244 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:20.241+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:20.333 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:20.329+0000 1694c700 -1 osd.3 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:46:34.996434+0000 (oldest deadline 2019-11-29T03:47:14.996434+0000) 2019-11-29T03:47:20.334 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:20.331+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:20.444 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:20.439+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:20.785 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:20.779+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:20.805 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:20.803+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:20.870 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:20.868+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:20.994 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:20.989+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:21.280 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:21.277+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:21.343 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:21.339+0000 1694c700 -1 osd.3 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:46:34.996434+0000 (oldest deadline 2019-11-29T03:47:14.996434+0000) 2019-11-29T03:47:21.344 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:21.341+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:21.482 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:21.477+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:21.803 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:21.800+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:21.824 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:21.819+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:21.851 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:21.849+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:22.021 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:22.016+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:22.271 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:22.268+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:22.363 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:22.360+0000 1694c700 -1 osd.3 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:46:34.996434+0000 (oldest deadline 2019-11-29T03:47:14.996434+0000) 2019-11-29T03:47:22.364 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:22.361+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:22.459 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:22.454+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:22.785 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:22.784+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:22.808 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:22.807+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:22.865 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:22.861+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:22.996 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:22.991+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:23.284 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:23.280+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:23.363 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:23.361+0000 1694c700 -1 osd.3 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:46:34.996434+0000 (oldest deadline 2019-11-29T03:47:14.996434+0000) 2019-11-29T03:47:23.363 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:23.362+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:23.483 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:23.478+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:23.752 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:23.750+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:23.811 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:23.809+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:23.898 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:23.893+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:24.039 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:24.034+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:24.271 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:24.269+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:24.360 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:24.356+0000 1694c700 -1 osd.3 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:46:34.996434+0000 (oldest deadline 2019-11-29T03:47:14.996434+0000) 2019-11-29T03:47:24.361 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:24.359+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:24.516 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:24.512+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:24.766 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:24.764+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:24.795 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:24.792+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:24.932 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:24.927+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:24.994 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:24.989+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:25.293 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:25.291+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:25.369 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:25.366+0000 1694c700 -1 osd.3 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:46:34.996434+0000 (oldest deadline 2019-11-29T03:47:14.996434+0000) 2019-11-29T03:47:25.370 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:25.368+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:25.485 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:25.480+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:25.767 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:25.765+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:25.822 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:25.820+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:25.957 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:25.952+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:25.960 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:25.954+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:26.298 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:26.295+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:26.407 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:26.404+0000 1694c700 -1 osd.3 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:46:34.996434+0000 (oldest deadline 2019-11-29T03:47:14.996434+0000) 2019-11-29T03:47:26.407 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:26.405+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:26.483 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:26.478+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:26.795 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:26.792+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:26.861 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:26.859+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:26.939 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:26.934+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:26.971 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:26.966+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:27.134 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:06:01:09.353 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:47:27.143 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:06:01:09.361 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:47:27.149 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:06:01:09.368 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:47:27.154 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:06:01:09.373 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:47:27.159 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:06:01:09.388 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:47:27.167 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:06:01:09.396 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:47:27.212 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:06:01:09.432 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:47:27.218 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:06:01:09.436 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:47:27.231 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:06:01:09.459 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:47:27.282 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:27.280+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:27.433 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:27.431+0000 1694c700 -1 osd.3 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:46:34.996434+0000 (oldest deadline 2019-11-29T03:47:14.996434+0000) 2019-11-29T03:47:27.434 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:27.432+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:27.504 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:27.501+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:27.804 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:27.802+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:27.906 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:27.900+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:27.911 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:27.909+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:27.965 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:27.960+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:28.325 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:28.323+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:28.417 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:28.415+0000 1694c700 -1 osd.3 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:46:34.996434+0000 (oldest deadline 2019-11-29T03:47:14.996434+0000) 2019-11-29T03:47:28.418 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:28.416+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:28.539 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:28.535+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:28.811 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:28.808+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:28.924 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:28.917+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:28.956 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:28.951+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:28.958 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:28.954+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:29.301 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:29.299+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:29.380 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:29.377+0000 1694c700 -1 osd.3 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:46:34.996434+0000 (oldest deadline 2019-11-29T03:47:14.996434+0000) 2019-11-29T03:47:29.380 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:29.379+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:29.554 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:29.550+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:29.854 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:29.852+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:29.920 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:29.913+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:29.936 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:29.934+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:29.965 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:29.960+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:30.312 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:30.309+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:30.366 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:30.362+0000 1694c700 -1 osd.3 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:46:34.996434+0000 (oldest deadline 2019-11-29T03:47:14.996434+0000) 2019-11-29T03:47:30.367 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:30.364+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:30.578 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:30.574+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:30.815 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:30.809+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:30.904 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:30.901+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:30.921 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:30.913+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:30.959 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:30.954+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:31.269 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:31.267+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:31.382 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:31.378+0000 1694c700 -1 osd.3 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:46:34.996434+0000 (oldest deadline 2019-11-29T03:47:14.996434+0000) 2019-11-29T03:47:31.383 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:31.380+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:31.550 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:31.545+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:31.860 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:31.857+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:31.888 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:31.885+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:31.947 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:31.942+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:31.989 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:31.985+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:32.300 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:32.296+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:32.392 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:32.388+0000 1694c700 -1 osd.3 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:46:34.996434+0000 (oldest deadline 2019-11-29T03:47:14.996434+0000) 2019-11-29T03:47:32.396 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:32.392+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:32.509 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:32.505+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:32.854 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:32.849+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:32.855 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:32.851+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:32.913 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:32.908+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:32.958 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:32.953+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:33.291 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:33.287+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:33.352 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:33.347+0000 1694c700 -1 osd.3 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:46:34.996434+0000 (oldest deadline 2019-11-29T03:47:14.996434+0000) 2019-11-29T03:47:33.352 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:33.349+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:33.558 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:33.553+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:33.809 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:33.806+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:33.832 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:33.830+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:33.884 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:33.880+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:33.990 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:33.985+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:34.290 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:34.287+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:34.377 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:34.374+0000 1694c700 -1 osd.3 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:46:34.996434+0000 (oldest deadline 2019-11-29T03:47:14.996434+0000) 2019-11-29T03:47:34.380 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:34.378+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:34.593 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:34.588+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:34.804 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:34.800+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:34.880 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:34.877+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:34.920 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:34.914+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:34.946 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:34.941+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:35.287 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:35.283+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:35.356 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:35.351+0000 1694c700 -1 osd.3 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:46:34.996434+0000 (oldest deadline 2019-11-29T03:47:14.996434+0000) 2019-11-29T03:47:35.357 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:35.353+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:35.619 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:35.611+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:35.820 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:35.817+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:35.863 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:35.859+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:35.949 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:35.943+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:35.999 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:35.994+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:36.276 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:36.273+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:36.399 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:36.395+0000 1694c700 -1 osd.3 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:46:34.996434+0000 (oldest deadline 2019-11-29T03:47:14.996434+0000) 2019-11-29T03:47:36.400 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:36.397+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:36.584 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:36.579+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:36.802 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:36.798+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:36.897 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:36.893+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:36.986 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:36.982+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:36.996 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:36.992+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:37.276 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:37.272+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:37.386 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:37.382+0000 1694c700 -1 osd.3 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:46:34.996434+0000 (oldest deadline 2019-11-29T03:47:14.996434+0000) 2019-11-29T03:47:37.387 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:37.384+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:37.595 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:37.589+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:37.834 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:37.830+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:37.952 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:37.948+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:37.984 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:37.979+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:38.024 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:38.018+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:38.272 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:38.268+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:38.357 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:38.353+0000 1694c700 -1 osd.3 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:46:34.996434+0000 (oldest deadline 2019-11-29T03:47:14.996434+0000) 2019-11-29T03:47:38.358 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:38.355+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:38.605 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:38.598+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:38.808 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:38.805+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:38.935 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:38.931+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:38.941 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:38.936+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:39.042 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:39.037+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:39.267 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:39.264+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:39.373 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:39.369+0000 1694c700 -1 osd.3 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:46:34.996434+0000 (oldest deadline 2019-11-29T03:47:14.996434+0000) 2019-11-29T03:47:39.374 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:39.371+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:39.604 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:39.599+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:39.777 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:39.774+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:39.961 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:39.957+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:39.988 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:39.983+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:40.046 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:40.042+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:40.297 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:40.291+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:40.332 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:40.328+0000 1694c700 -1 osd.3 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:46:34.996434+0000 (oldest deadline 2019-11-29T03:47:14.996434+0000) 2019-11-29T03:47:40.333 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:40.330+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:40.589 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:40.585+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:40.775 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:40.771+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:40.971 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:40.966+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:40.982 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:40.976+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:41.066 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:41.061+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:41.324 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:41.320+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:41.368 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:41.363+0000 1694c700 -1 osd.3 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:46:34.996434+0000 (oldest deadline 2019-11-29T03:47:14.996434+0000) 2019-11-29T03:47:41.369 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:41.365+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:41.558 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:41.552+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:41.736 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:41.732+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:41.860 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:47:41.851+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 48sec e315 v315) 2019-11-29T03:47:42.026 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:42.020+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:42.032 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:42.029+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:42.089 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:42.083+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:42.365 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:42.360+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:42.420 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:42.415+0000 1694c700 -1 osd.3 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:46:34.996434+0000 (oldest deadline 2019-11-29T03:47:14.996434+0000) 2019-11-29T03:47:42.421 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:42.418+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:42.560 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:42.555+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:42.700 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:42.696+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:43.077 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:43.072+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:43.081 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:43.078+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:43.134 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:43.129+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:43.364 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:43.361+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:43.404 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:43.399+0000 1694c700 -1 osd.3 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:46:34.996434+0000 (oldest deadline 2019-11-29T03:47:14.996434+0000) 2019-11-29T03:47:43.404 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:43.401+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:43.584 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:43.579+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:43.750 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:43.747+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:44.084 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:44.080+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:44.120 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:44.113+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:44.169 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:44.164+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:44.378 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:44.374+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:44.380 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:44.376+0000 1694c700 -1 osd.3 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:46:34.996434+0000 (oldest deadline 2019-11-29T03:47:14.996434+0000) 2019-11-29T03:47:44.401 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:44.381+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:44.601 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:44.595+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:44.733 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:44.730+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:45.084 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:45.079+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:45.117 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:45.112+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:45.172 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:45.167+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:45.355 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:45.352+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:45.368 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:45.363+0000 1694c700 -1 osd.3 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:46:34.996434+0000 (oldest deadline 2019-11-29T03:47:14.996434+0000) 2019-11-29T03:47:45.370 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:45.365+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:45.639 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:45.634+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:45.755 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:45.752+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:46.119 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:46.116+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:46.144 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:46.138+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:46.219 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:46.213+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:46.393 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:46.388+0000 1694c700 -1 osd.3 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:46:34.996434+0000 (oldest deadline 2019-11-29T03:47:14.996434+0000) 2019-11-29T03:47:46.394 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:46.390+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:46.401 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:46.397+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:46.687 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:46.682+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:46.746 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:46.737+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:46.876 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:47:46.871+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 48sec e315 v315) 2019-11-29T03:47:47.148 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:47.144+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:47.186 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:47.182+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:47.195 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:47.190+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:47.439 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:47.432+0000 1694c700 -1 osd.3 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:46:34.996434+0000 (oldest deadline 2019-11-29T03:47:14.996434+0000) 2019-11-29T03:47:47.439 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:47.434+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:47.441 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:47.434+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:47.661 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:47.656+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:47.709 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:47.705+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:48.111 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:48.108+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:48.166 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:48.161+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:48.238 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:48.233+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:48.393 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:48.389+0000 1694c700 -1 osd.3 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:46:34.996434+0000 (oldest deadline 2019-11-29T03:47:14.996434+0000) 2019-11-29T03:47:48.394 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:48.390+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:48.430 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:48.422+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:48.677 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:48.673+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:48.757 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:48.753+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:49.156 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:49.152+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:49.202 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:49.197+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:49.287 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:49.281+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:49.386 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:49.381+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:49.399 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:49.395+0000 1694c700 -1 osd.3 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:46:34.996434+0000 (oldest deadline 2019-11-29T03:47:14.996434+0000) 2019-11-29T03:47:49.400 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:49.397+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:49.716 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:49.711+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:49.797 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:49.794+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:50.127 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:50.123+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:50.179 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:50.171+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:50.335 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:50.329+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:50.353 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:50.350+0000 1694c700 -1 osd.3 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:46:34.996434+0000 (oldest deadline 2019-11-29T03:47:14.996434+0000) 2019-11-29T03:47:50.354 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:50.351+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:50.358 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:50.354+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:50.732 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:50.726+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:50.822 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:50.819+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:51.153 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:47:51.149+0000 1694c700 -1 osd.1 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.959393+0000 front 2019-11-29T03:46:23.930492+0000 (oldest deadline 2019-11-29T03:47:07.954752+0000) 2019-11-29T03:47:51.158 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:47:51.151+0000 1694c700 -1 osd.4 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.990079+0000 front 2019-11-29T03:46:22.874845+0000 (oldest deadline 2019-11-29T03:47:04.511662+0000) 2019-11-29T03:47:51.359 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:47:51.353+0000 1694c700 -1 osd.6 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:22.626887+0000 front 2019-11-29T03:46:22.635426+0000 (oldest deadline 2019-11-29T03:47:06.087246+0000) 2019-11-29T03:47:51.361 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:47:51.358+0000 1694c700 -1 osd.2 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:23.170296+0000 front 2019-11-29T03:46:23.292674+0000 (oldest deadline 2019-11-29T03:47:07.659775+0000) 2019-11-29T03:47:51.375 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:51.371+0000 1694c700 -1 osd.3 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:46:34.996434+0000 (oldest deadline 2019-11-29T03:47:14.996434+0000) 2019-11-29T03:47:51.376 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:51.372+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:51.770 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:47:51.764+0000 1694c700 -1 osd.7 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:19.800297+0000 front 2019-11-29T03:46:20.013090+0000 (oldest deadline 2019-11-29T03:47:05.082638+0000) 2019-11-29T03:47:51.805 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:47:51.803+0000 1694c700 -1 osd.0 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:46:21.623409+0000 front 2019-11-29T03:46:19.456729+0000 (oldest deadline 2019-11-29T03:47:04.476487+0000) 2019-11-29T03:47:51.912 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:47:51.905+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 48sec e315 v315) 2019-11-29T03:47:52.351 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:52.347+0000 1694c700 -1 osd.3 315 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:46:34.996434+0000 (oldest deadline 2019-11-29T03:47:14.996434+0000) 2019-11-29T03:47:52.351 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:52.349+0000 1694c700 -1 osd.3 315 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e313) 2019-11-29T03:47:52.995 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:47:52.992+0000 33f88700 -1 osd.3 316 build_incremental_map_msg missing incremental map 315 2019-11-29T03:49:22.361 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:49:22.355+0000 1694c700 -1 osd.4 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:42.113720+0000 front 2019-11-29T03:48:39.191975+0000 (oldest deadline 2019-11-29T03:49:21.862236+0000) 2019-11-29T03:49:23.320 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:49:23.314+0000 1694c700 -1 osd.4 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:42.113720+0000 front 2019-11-29T03:48:39.191975+0000 (oldest deadline 2019-11-29T03:49:21.862236+0000) 2019-11-29T03:49:23.697 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:49:23.693+0000 1694c700 -1 osd.2 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.620736+0000 front 2019-11-29T03:48:37.595970+0000 (oldest deadline 2019-11-29T03:49:22.798161+0000) 2019-11-29T03:49:24.317 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:49:24.310+0000 1694c700 -1 osd.4 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:42.113720+0000 front 2019-11-29T03:48:39.191975+0000 (oldest deadline 2019-11-29T03:49:21.862236+0000) 2019-11-29T03:49:24.461 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:49:24.454+0000 1694c700 -1 osd.5 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.755396+0000 front 2019-11-29T03:48:37.955510+0000 (oldest deadline 2019-11-29T03:49:23.585850+0000) 2019-11-29T03:49:24.737 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:49:24.733+0000 1694c700 -1 osd.2 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.620736+0000 front 2019-11-29T03:48:37.595970+0000 (oldest deadline 2019-11-29T03:49:22.798161+0000) 2019-11-29T03:49:25.094 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:49:25.089+0000 1694c700 -1 osd.1 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.842904+0000 front 2019-11-29T03:48:40.863965+0000 (oldest deadline 2019-11-29T03:49:24.923640+0000) 2019-11-29T03:49:25.353 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:49:25.347+0000 1694c700 -1 osd.4 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:42.113720+0000 front 2019-11-29T03:48:39.191975+0000 (oldest deadline 2019-11-29T03:49:21.862236+0000) 2019-11-29T03:49:25.462 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:49:25.455+0000 1694c700 -1 osd.5 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.755396+0000 front 2019-11-29T03:48:37.955510+0000 (oldest deadline 2019-11-29T03:49:23.585850+0000) 2019-11-29T03:49:25.736 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:49:25.732+0000 1694c700 -1 osd.2 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.620736+0000 front 2019-11-29T03:48:37.595970+0000 (oldest deadline 2019-11-29T03:49:22.798161+0000) 2019-11-29T03:49:25.820 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:49:25.817+0000 1694c700 -1 osd.0 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:39.366935+0000 front 2019-11-29T03:48:39.367856+0000 (oldest deadline 2019-11-29T03:49:25.175046+0000) 2019-11-29T03:49:26.075 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:49:26.071+0000 1694c700 -1 osd.1 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.842904+0000 front 2019-11-29T03:48:40.863965+0000 (oldest deadline 2019-11-29T03:49:24.923640+0000) 2019-11-29T03:49:26.409 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:49:26.400+0000 1694c700 -1 osd.4 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:42.113720+0000 front 2019-11-29T03:48:39.191975+0000 (oldest deadline 2019-11-29T03:49:21.862236+0000) 2019-11-29T03:49:26.461 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:49:26.453+0000 1694c700 -1 osd.5 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.755396+0000 front 2019-11-29T03:48:37.955510+0000 (oldest deadline 2019-11-29T03:49:23.585850+0000) 2019-11-29T03:49:26.718 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:49:26.714+0000 1694c700 -1 osd.2 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.620736+0000 front 2019-11-29T03:48:37.595970+0000 (oldest deadline 2019-11-29T03:49:22.798161+0000) 2019-11-29T03:49:26.731 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:49:26.725+0000 1694c700 -1 osd.6 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.732666+0000 front 2019-11-29T03:48:40.769601+0000 (oldest deadline 2019-11-29T03:49:26.010110+0000) 2019-11-29T03:49:26.827 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:49:26.824+0000 1694c700 -1 osd.0 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:39.366935+0000 front 2019-11-29T03:48:39.367856+0000 (oldest deadline 2019-11-29T03:49:25.175046+0000) 2019-11-29T03:49:27.043 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:49:27.038+0000 1694c700 -1 osd.1 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.842904+0000 front 2019-11-29T03:48:40.863965+0000 (oldest deadline 2019-11-29T03:49:24.923640+0000) 2019-11-29T03:49:27.057 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:49:27.051+0000 1694c700 -1 osd.7 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:41.719384+0000 front 2019-11-29T03:48:41.253023+0000 (oldest deadline 2019-11-29T03:49:26.530650+0000) 2019-11-29T03:49:27.426 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:49:27.420+0000 1694c700 -1 osd.4 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:42.113720+0000 front 2019-11-29T03:48:39.191975+0000 (oldest deadline 2019-11-29T03:49:21.862236+0000) 2019-11-29T03:49:27.434 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:49:27.429+0000 1694c700 -1 osd.5 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.755396+0000 front 2019-11-29T03:48:37.955510+0000 (oldest deadline 2019-11-29T03:49:23.585850+0000) 2019-11-29T03:49:27.705 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:49:27.701+0000 1694c700 -1 osd.2 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.620736+0000 front 2019-11-29T03:48:37.595970+0000 (oldest deadline 2019-11-29T03:49:22.798161+0000) 2019-11-29T03:49:27.735 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:49:27.729+0000 1694c700 -1 osd.6 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.732666+0000 front 2019-11-29T03:48:40.769601+0000 (oldest deadline 2019-11-29T03:49:26.010110+0000) 2019-11-29T03:49:27.829 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:49:27.826+0000 1694c700 -1 osd.0 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:39.366935+0000 front 2019-11-29T03:48:39.367856+0000 (oldest deadline 2019-11-29T03:49:25.175046+0000) 2019-11-29T03:49:28.081 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:49:28.074+0000 1694c700 -1 osd.7 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:41.719384+0000 front 2019-11-29T03:48:41.253023+0000 (oldest deadline 2019-11-29T03:49:26.530650+0000) 2019-11-29T03:49:28.081 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:49:28.078+0000 1694c700 -1 osd.1 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.842904+0000 front 2019-11-29T03:48:40.863965+0000 (oldest deadline 2019-11-29T03:49:24.923640+0000) 2019-11-29T03:49:28.454 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:49:28.447+0000 1694c700 -1 osd.4 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:42.113720+0000 front 2019-11-29T03:48:39.191975+0000 (oldest deadline 2019-11-29T03:49:21.862236+0000) 2019-11-29T03:49:28.475 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:49:28.471+0000 1694c700 -1 osd.5 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.755396+0000 front 2019-11-29T03:48:37.955510+0000 (oldest deadline 2019-11-29T03:49:23.585850+0000) 2019-11-29T03:49:28.677 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:49:28.674+0000 1694c700 -1 osd.2 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.620736+0000 front 2019-11-29T03:48:37.595970+0000 (oldest deadline 2019-11-29T03:49:22.798161+0000) 2019-11-29T03:49:28.698 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:49:28.693+0000 1694c700 -1 osd.6 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.732666+0000 front 2019-11-29T03:48:40.769601+0000 (oldest deadline 2019-11-29T03:49:26.010110+0000) 2019-11-29T03:49:28.808 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:49:28.802+0000 1694c700 -1 osd.0 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:39.366935+0000 front 2019-11-29T03:48:39.367856+0000 (oldest deadline 2019-11-29T03:49:25.175046+0000) 2019-11-29T03:49:29.048 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:49:29.042+0000 1694c700 -1 osd.7 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:41.719384+0000 front 2019-11-29T03:48:41.253023+0000 (oldest deadline 2019-11-29T03:49:26.530650+0000) 2019-11-29T03:49:29.099 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:49:29.096+0000 1694c700 -1 osd.1 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.842904+0000 front 2019-11-29T03:48:40.863965+0000 (oldest deadline 2019-11-29T03:49:24.923640+0000) 2019-11-29T03:49:29.475 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:49:29.470+0000 1694c700 -1 osd.4 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:42.113720+0000 front 2019-11-29T03:48:39.191975+0000 (oldest deadline 2019-11-29T03:49:21.862236+0000) 2019-11-29T03:49:29.482 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:49:29.477+0000 1694c700 -1 osd.5 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.755396+0000 front 2019-11-29T03:48:37.955510+0000 (oldest deadline 2019-11-29T03:49:23.585850+0000) 2019-11-29T03:49:29.655 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:49:29.650+0000 1694c700 -1 osd.6 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.732666+0000 front 2019-11-29T03:48:40.769601+0000 (oldest deadline 2019-11-29T03:49:26.010110+0000) 2019-11-29T03:49:29.669 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:49:29.665+0000 1694c700 -1 osd.2 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.620736+0000 front 2019-11-29T03:48:37.595970+0000 (oldest deadline 2019-11-29T03:49:22.798161+0000) 2019-11-29T03:49:29.776 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:49:29.772+0000 1694c700 -1 osd.0 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:39.366935+0000 front 2019-11-29T03:48:39.367856+0000 (oldest deadline 2019-11-29T03:49:25.175046+0000) 2019-11-29T03:49:30.002 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:49:29.997+0000 1694c700 -1 osd.7 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:41.719384+0000 front 2019-11-29T03:48:41.253023+0000 (oldest deadline 2019-11-29T03:49:26.530650+0000) 2019-11-29T03:49:30.121 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:49:30.118+0000 1694c700 -1 osd.1 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.842904+0000 front 2019-11-29T03:48:40.863965+0000 (oldest deadline 2019-11-29T03:49:24.923640+0000) 2019-11-29T03:49:30.469 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:49:30.464+0000 1694c700 -1 osd.5 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.755396+0000 front 2019-11-29T03:48:37.955510+0000 (oldest deadline 2019-11-29T03:49:23.585850+0000) 2019-11-29T03:49:30.487 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:49:30.482+0000 1694c700 -1 osd.4 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:42.113720+0000 front 2019-11-29T03:48:39.191975+0000 (oldest deadline 2019-11-29T03:49:21.862236+0000) 2019-11-29T03:49:30.644 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:49:30.636+0000 1694c700 -1 osd.6 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.732666+0000 front 2019-11-29T03:48:40.769601+0000 (oldest deadline 2019-11-29T03:49:26.010110+0000) 2019-11-29T03:49:30.705 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:49:30.700+0000 1694c700 -1 osd.2 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.620736+0000 front 2019-11-29T03:48:37.595970+0000 (oldest deadline 2019-11-29T03:49:22.798161+0000) 2019-11-29T03:49:30.793 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:49:30.788+0000 1694c700 -1 osd.0 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:39.366935+0000 front 2019-11-29T03:48:39.367856+0000 (oldest deadline 2019-11-29T03:49:25.175046+0000) 2019-11-29T03:49:31.019 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:49:31.014+0000 1694c700 -1 osd.7 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:41.719384+0000 front 2019-11-29T03:48:41.253023+0000 (oldest deadline 2019-11-29T03:49:26.530650+0000) 2019-11-29T03:49:31.127 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:49:31.123+0000 1694c700 -1 osd.1 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.842904+0000 front 2019-11-29T03:48:40.863965+0000 (oldest deadline 2019-11-29T03:49:24.923640+0000) 2019-11-29T03:49:31.466 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:49:31.460+0000 1694c700 -1 osd.5 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.755396+0000 front 2019-11-29T03:48:37.955510+0000 (oldest deadline 2019-11-29T03:49:23.585850+0000) 2019-11-29T03:49:31.506 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:49:31.500+0000 1694c700 -1 osd.4 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:42.113720+0000 front 2019-11-29T03:48:39.191975+0000 (oldest deadline 2019-11-29T03:49:21.862236+0000) 2019-11-29T03:49:31.645 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:49:31.640+0000 1694c700 -1 osd.6 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.732666+0000 front 2019-11-29T03:48:40.769601+0000 (oldest deadline 2019-11-29T03:49:26.010110+0000) 2019-11-29T03:49:31.703 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:49:31.699+0000 1694c700 -1 osd.2 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.620736+0000 front 2019-11-29T03:48:37.595970+0000 (oldest deadline 2019-11-29T03:49:22.798161+0000) 2019-11-29T03:49:31.852 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:49:31.848+0000 1694c700 -1 osd.0 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:39.366935+0000 front 2019-11-29T03:48:39.367856+0000 (oldest deadline 2019-11-29T03:49:25.175046+0000) 2019-11-29T03:49:32.052 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:49:32.045+0000 1694c700 -1 osd.7 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:41.719384+0000 front 2019-11-29T03:48:41.253023+0000 (oldest deadline 2019-11-29T03:49:26.530650+0000) 2019-11-29T03:49:32.083 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:49:32.080+0000 1694c700 -1 osd.1 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.842904+0000 front 2019-11-29T03:48:40.863965+0000 (oldest deadline 2019-11-29T03:49:24.923640+0000) 2019-11-29T03:49:32.462 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:49:32.455+0000 1694c700 -1 osd.5 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.755396+0000 front 2019-11-29T03:48:37.955510+0000 (oldest deadline 2019-11-29T03:49:23.585850+0000) 2019-11-29T03:49:32.542 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:49:32.537+0000 1694c700 -1 osd.4 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:42.113720+0000 front 2019-11-29T03:48:39.191975+0000 (oldest deadline 2019-11-29T03:49:21.862236+0000) 2019-11-29T03:49:32.626 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:49:32.620+0000 1694c700 -1 osd.6 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.732666+0000 front 2019-11-29T03:48:40.769601+0000 (oldest deadline 2019-11-29T03:49:26.010110+0000) 2019-11-29T03:49:32.685 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:49:32.682+0000 1694c700 -1 osd.2 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.620736+0000 front 2019-11-29T03:48:37.595970+0000 (oldest deadline 2019-11-29T03:49:22.798161+0000) 2019-11-29T03:49:32.874 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:49:32.870+0000 1694c700 -1 osd.0 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:39.366935+0000 front 2019-11-29T03:48:39.367856+0000 (oldest deadline 2019-11-29T03:49:25.175046+0000) 2019-11-29T03:49:33.010 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:49:33.004+0000 1694c700 -1 osd.7 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:41.719384+0000 front 2019-11-29T03:48:41.253023+0000 (oldest deadline 2019-11-29T03:49:26.530650+0000) 2019-11-29T03:49:33.060 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:49:33.056+0000 1694c700 -1 osd.1 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.842904+0000 front 2019-11-29T03:48:40.863965+0000 (oldest deadline 2019-11-29T03:49:24.923640+0000) 2019-11-29T03:49:33.435 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:49:33.429+0000 1694c700 -1 osd.5 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.755396+0000 front 2019-11-29T03:48:37.955510+0000 (oldest deadline 2019-11-29T03:49:23.585850+0000) 2019-11-29T03:49:33.513 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:49:33.507+0000 1694c700 -1 osd.4 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:42.113720+0000 front 2019-11-29T03:48:39.191975+0000 (oldest deadline 2019-11-29T03:49:21.862236+0000) 2019-11-29T03:49:33.589 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:49:33.583+0000 1694c700 -1 osd.6 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.732666+0000 front 2019-11-29T03:48:40.769601+0000 (oldest deadline 2019-11-29T03:49:26.010110+0000) 2019-11-29T03:49:33.729 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:49:33.725+0000 1694c700 -1 osd.2 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.620736+0000 front 2019-11-29T03:48:37.595970+0000 (oldest deadline 2019-11-29T03:49:22.798161+0000) 2019-11-29T03:49:33.895 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:49:33.892+0000 1694c700 -1 osd.0 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:39.366935+0000 front 2019-11-29T03:48:39.367856+0000 (oldest deadline 2019-11-29T03:49:25.175046+0000) 2019-11-29T03:49:34.034 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:49:34.029+0000 1694c700 -1 osd.7 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:41.719384+0000 front 2019-11-29T03:48:41.253023+0000 (oldest deadline 2019-11-29T03:49:26.530650+0000) 2019-11-29T03:49:34.051 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:49:34.049+0000 1694c700 -1 osd.1 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.842904+0000 front 2019-11-29T03:48:40.863965+0000 (oldest deadline 2019-11-29T03:49:24.923640+0000) 2019-11-29T03:49:34.414 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:49:34.408+0000 1694c700 -1 osd.5 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.755396+0000 front 2019-11-29T03:48:37.955510+0000 (oldest deadline 2019-11-29T03:49:23.585850+0000) 2019-11-29T03:49:34.543 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:49:34.537+0000 1694c700 -1 osd.4 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:42.113720+0000 front 2019-11-29T03:48:39.191975+0000 (oldest deadline 2019-11-29T03:49:21.862236+0000) 2019-11-29T03:49:34.593 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:49:34.587+0000 1694c700 -1 osd.6 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.732666+0000 front 2019-11-29T03:48:40.769601+0000 (oldest deadline 2019-11-29T03:49:26.010110+0000) 2019-11-29T03:49:34.724 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:49:34.721+0000 1694c700 -1 osd.2 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.620736+0000 front 2019-11-29T03:48:37.595970+0000 (oldest deadline 2019-11-29T03:49:22.798161+0000) 2019-11-29T03:49:34.898 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:49:34.896+0000 1694c700 -1 osd.0 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:39.366935+0000 front 2019-11-29T03:48:39.367856+0000 (oldest deadline 2019-11-29T03:49:25.175046+0000) 2019-11-29T03:49:34.994 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:49:34.988+0000 1694c700 -1 osd.7 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:41.719384+0000 front 2019-11-29T03:48:41.253023+0000 (oldest deadline 2019-11-29T03:49:26.530650+0000) 2019-11-29T03:49:35.070 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:49:35.067+0000 1694c700 -1 osd.1 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.842904+0000 front 2019-11-29T03:48:40.863965+0000 (oldest deadline 2019-11-29T03:49:24.923640+0000) 2019-11-29T03:49:35.458 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:49:35.452+0000 1694c700 -1 osd.5 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.755396+0000 front 2019-11-29T03:48:37.955510+0000 (oldest deadline 2019-11-29T03:49:23.585850+0000) 2019-11-29T03:49:35.567 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:49:35.561+0000 1694c700 -1 osd.4 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:42.113720+0000 front 2019-11-29T03:48:39.191975+0000 (oldest deadline 2019-11-29T03:49:21.862236+0000) 2019-11-29T03:49:35.594 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:49:35.589+0000 1694c700 -1 osd.6 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.732666+0000 front 2019-11-29T03:48:40.769601+0000 (oldest deadline 2019-11-29T03:49:26.010110+0000) 2019-11-29T03:49:35.747 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:49:35.745+0000 1694c700 -1 osd.2 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.620736+0000 front 2019-11-29T03:48:37.595970+0000 (oldest deadline 2019-11-29T03:49:22.798161+0000) 2019-11-29T03:49:35.946 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:49:35.944+0000 1694c700 -1 osd.0 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:39.366935+0000 front 2019-11-29T03:48:39.367856+0000 (oldest deadline 2019-11-29T03:49:25.175046+0000) 2019-11-29T03:49:36.020 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:49:36.014+0000 1694c700 -1 osd.7 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:41.719384+0000 front 2019-11-29T03:48:41.253023+0000 (oldest deadline 2019-11-29T03:49:26.530650+0000) 2019-11-29T03:49:36.048 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:49:36.046+0000 1694c700 -1 osd.1 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.842904+0000 front 2019-11-29T03:48:40.863965+0000 (oldest deadline 2019-11-29T03:49:24.923640+0000) 2019-11-29T03:49:36.488 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:49:36.482+0000 1694c700 -1 osd.5 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.755396+0000 front 2019-11-29T03:48:37.955510+0000 (oldest deadline 2019-11-29T03:49:23.585850+0000) 2019-11-29T03:49:36.568 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:49:36.562+0000 1694c700 -1 osd.4 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:42.113720+0000 front 2019-11-29T03:48:39.191975+0000 (oldest deadline 2019-11-29T03:49:21.862236+0000) 2019-11-29T03:49:36.591 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:49:36.584+0000 1694c700 -1 osd.6 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.732666+0000 front 2019-11-29T03:48:40.769601+0000 (oldest deadline 2019-11-29T03:49:26.010110+0000) 2019-11-29T03:49:36.770 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:49:36.768+0000 1694c700 -1 osd.2 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.620736+0000 front 2019-11-29T03:48:37.595970+0000 (oldest deadline 2019-11-29T03:49:22.798161+0000) 2019-11-29T03:49:36.908 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:49:36.905+0000 1694c700 -1 osd.0 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:39.366935+0000 front 2019-11-29T03:48:39.367856+0000 (oldest deadline 2019-11-29T03:49:25.175046+0000) 2019-11-29T03:49:36.990 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:49:36.984+0000 1694c700 -1 osd.7 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:41.719384+0000 front 2019-11-29T03:48:41.253023+0000 (oldest deadline 2019-11-29T03:49:26.530650+0000) 2019-11-29T03:49:37.004 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:49:37.001+0000 1694c700 -1 osd.1 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.842904+0000 front 2019-11-29T03:48:40.863965+0000 (oldest deadline 2019-11-29T03:49:24.923640+0000) 2019-11-29T03:49:37.468 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:49:37.462+0000 1694c700 -1 osd.5 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.755396+0000 front 2019-11-29T03:48:37.955510+0000 (oldest deadline 2019-11-29T03:49:23.585850+0000) 2019-11-29T03:49:37.532 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:49:37.527+0000 1694c700 -1 osd.4 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:42.113720+0000 front 2019-11-29T03:48:39.191975+0000 (oldest deadline 2019-11-29T03:49:21.862236+0000) 2019-11-29T03:49:37.635 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:49:37.630+0000 1694c700 -1 osd.6 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.732666+0000 front 2019-11-29T03:48:40.769601+0000 (oldest deadline 2019-11-29T03:49:26.010110+0000) 2019-11-29T03:49:37.726 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:49:37.724+0000 1694c700 -1 osd.2 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.620736+0000 front 2019-11-29T03:48:37.595970+0000 (oldest deadline 2019-11-29T03:49:22.798161+0000) 2019-11-29T03:49:37.874 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:49:37.872+0000 1694c700 -1 osd.0 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:39.366935+0000 front 2019-11-29T03:48:39.367856+0000 (oldest deadline 2019-11-29T03:49:25.175046+0000) 2019-11-29T03:49:37.968 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:49:37.962+0000 1694c700 -1 osd.7 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:41.719384+0000 front 2019-11-29T03:48:41.253023+0000 (oldest deadline 2019-11-29T03:49:26.530650+0000) 2019-11-29T03:49:38.012 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:49:38.006+0000 1694c700 -1 osd.1 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.842904+0000 front 2019-11-29T03:48:40.863965+0000 (oldest deadline 2019-11-29T03:49:24.923640+0000) 2019-11-29T03:49:38.470 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:49:38.464+0000 1694c700 -1 osd.5 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.755396+0000 front 2019-11-29T03:48:37.955510+0000 (oldest deadline 2019-11-29T03:49:23.585850+0000) 2019-11-29T03:49:38.582 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:49:38.577+0000 1694c700 -1 osd.4 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:42.113720+0000 front 2019-11-29T03:48:39.191975+0000 (oldest deadline 2019-11-29T03:49:21.862236+0000) 2019-11-29T03:49:38.604 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:49:38.598+0000 1694c700 -1 osd.6 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.732666+0000 front 2019-11-29T03:48:40.769601+0000 (oldest deadline 2019-11-29T03:49:26.010110+0000) 2019-11-29T03:49:38.738 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:49:38.736+0000 1694c700 -1 osd.2 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.620736+0000 front 2019-11-29T03:48:37.595970+0000 (oldest deadline 2019-11-29T03:49:22.798161+0000) 2019-11-29T03:49:38.847 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:49:38.844+0000 1694c700 -1 osd.0 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:39.366935+0000 front 2019-11-29T03:48:39.367856+0000 (oldest deadline 2019-11-29T03:49:25.175046+0000) 2019-11-29T03:49:38.987 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:49:38.980+0000 1694c700 -1 osd.7 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:41.719384+0000 front 2019-11-29T03:48:41.253023+0000 (oldest deadline 2019-11-29T03:49:26.530650+0000) 2019-11-29T03:49:39.038 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:49:39.034+0000 1694c700 -1 osd.1 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.842904+0000 front 2019-11-29T03:48:40.863965+0000 (oldest deadline 2019-11-29T03:49:24.923640+0000) 2019-11-29T03:49:39.502 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:49:39.496+0000 1694c700 -1 osd.5 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.755396+0000 front 2019-11-29T03:48:37.955510+0000 (oldest deadline 2019-11-29T03:49:23.585850+0000) 2019-11-29T03:49:39.577 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:49:39.572+0000 1694c700 -1 osd.6 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.732666+0000 front 2019-11-29T03:48:40.769601+0000 (oldest deadline 2019-11-29T03:49:26.010110+0000) 2019-11-29T03:49:39.612 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:49:39.606+0000 1694c700 -1 osd.4 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:42.113720+0000 front 2019-11-29T03:48:39.191975+0000 (oldest deadline 2019-11-29T03:49:21.862236+0000) 2019-11-29T03:49:39.720 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:49:39.716+0000 1694c700 -1 osd.2 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.620736+0000 front 2019-11-29T03:48:37.595970+0000 (oldest deadline 2019-11-29T03:49:22.798161+0000) 2019-11-29T03:49:39.861 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:49:39.858+0000 1694c700 -1 osd.0 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:39.366935+0000 front 2019-11-29T03:48:39.367856+0000 (oldest deadline 2019-11-29T03:49:25.175046+0000) 2019-11-29T03:49:40.026 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:49:40.021+0000 1694c700 -1 osd.7 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:41.719384+0000 front 2019-11-29T03:48:41.253023+0000 (oldest deadline 2019-11-29T03:49:26.530650+0000) 2019-11-29T03:49:40.088 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:49:40.086+0000 1694c700 -1 osd.1 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.842904+0000 front 2019-11-29T03:48:40.863965+0000 (oldest deadline 2019-11-29T03:49:24.923640+0000) 2019-11-29T03:49:40.483 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:49:40.477+0000 1694c700 -1 osd.5 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.755396+0000 front 2019-11-29T03:48:37.955510+0000 (oldest deadline 2019-11-29T03:49:23.585850+0000) 2019-11-29T03:49:40.589 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:49:40.583+0000 1694c700 -1 osd.4 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:42.113720+0000 front 2019-11-29T03:48:39.191975+0000 (oldest deadline 2019-11-29T03:49:21.862236+0000) 2019-11-29T03:49:40.616 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:49:40.611+0000 1694c700 -1 osd.6 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.732666+0000 front 2019-11-29T03:48:40.769601+0000 (oldest deadline 2019-11-29T03:49:26.010110+0000) 2019-11-29T03:49:40.729 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:49:40.728+0000 1694c700 -1 osd.2 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.620736+0000 front 2019-11-29T03:48:37.595970+0000 (oldest deadline 2019-11-29T03:49:22.798161+0000) 2019-11-29T03:49:40.830 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:49:40.828+0000 1694c700 -1 osd.0 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:39.366935+0000 front 2019-11-29T03:48:39.367856+0000 (oldest deadline 2019-11-29T03:49:25.175046+0000) 2019-11-29T03:49:40.997 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:49:40.991+0000 1694c700 -1 osd.7 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:41.719384+0000 front 2019-11-29T03:48:41.253023+0000 (oldest deadline 2019-11-29T03:49:26.530650+0000) 2019-11-29T03:49:41.116 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:49:41.113+0000 1694c700 -1 osd.1 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.842904+0000 front 2019-11-29T03:48:40.863965+0000 (oldest deadline 2019-11-29T03:49:24.923640+0000) 2019-11-29T03:49:41.472 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:49:41.467+0000 1694c700 -1 osd.5 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.755396+0000 front 2019-11-29T03:48:37.955510+0000 (oldest deadline 2019-11-29T03:49:23.585850+0000) 2019-11-29T03:49:41.556 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:49:41.549+0000 1694c700 -1 osd.4 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:42.113720+0000 front 2019-11-29T03:48:39.191975+0000 (oldest deadline 2019-11-29T03:49:21.862236+0000) 2019-11-29T03:49:41.634 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:49:41.629+0000 1694c700 -1 osd.6 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.732666+0000 front 2019-11-29T03:48:40.769601+0000 (oldest deadline 2019-11-29T03:49:26.010110+0000) 2019-11-29T03:49:41.767 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:49:41.764+0000 1694c700 -1 osd.2 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.620736+0000 front 2019-11-29T03:48:37.595970+0000 (oldest deadline 2019-11-29T03:49:22.798161+0000) 2019-11-29T03:49:41.855 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:49:41.852+0000 1694c700 -1 osd.0 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:39.366935+0000 front 2019-11-29T03:48:39.367856+0000 (oldest deadline 2019-11-29T03:49:25.175046+0000) 2019-11-29T03:49:42.008 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:49:42.002+0000 1694c700 -1 osd.7 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:41.719384+0000 front 2019-11-29T03:48:41.253023+0000 (oldest deadline 2019-11-29T03:49:26.530650+0000) 2019-11-29T03:49:42.124 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:49:42.121+0000 1694c700 -1 osd.1 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.842904+0000 front 2019-11-29T03:48:40.863965+0000 (oldest deadline 2019-11-29T03:49:24.923640+0000) 2019-11-29T03:49:42.500 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:49:42.491+0000 1694c700 -1 osd.5 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.755396+0000 front 2019-11-29T03:48:37.955510+0000 (oldest deadline 2019-11-29T03:49:23.585850+0000) 2019-11-29T03:49:42.598 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:49:42.592+0000 1694c700 -1 osd.6 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.732666+0000 front 2019-11-29T03:48:40.769601+0000 (oldest deadline 2019-11-29T03:49:26.010110+0000) 2019-11-29T03:49:42.604 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:49:42.599+0000 1694c700 -1 osd.4 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:42.113720+0000 front 2019-11-29T03:48:39.191975+0000 (oldest deadline 2019-11-29T03:49:21.862236+0000) 2019-11-29T03:49:42.797 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:49:42.794+0000 1694c700 -1 osd.2 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.620736+0000 front 2019-11-29T03:48:37.595970+0000 (oldest deadline 2019-11-29T03:49:22.798161+0000) 2019-11-29T03:49:42.871 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:49:42.868+0000 1694c700 -1 osd.0 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:39.366935+0000 front 2019-11-29T03:48:39.367856+0000 (oldest deadline 2019-11-29T03:49:25.175046+0000) 2019-11-29T03:49:42.963 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:49:42.957+0000 1694c700 -1 osd.7 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:41.719384+0000 front 2019-11-29T03:48:41.253023+0000 (oldest deadline 2019-11-29T03:49:26.530650+0000) 2019-11-29T03:49:43.108 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:49:43.106+0000 1694c700 -1 osd.1 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.842904+0000 front 2019-11-29T03:48:40.863965+0000 (oldest deadline 2019-11-29T03:49:24.923640+0000) 2019-11-29T03:49:43.485 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:49:43.479+0000 1694c700 -1 osd.5 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.755396+0000 front 2019-11-29T03:48:37.955510+0000 (oldest deadline 2019-11-29T03:49:23.585850+0000) 2019-11-29T03:49:43.609 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:49:43.603+0000 1694c700 -1 osd.4 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:42.113720+0000 front 2019-11-29T03:48:39.191975+0000 (oldest deadline 2019-11-29T03:49:21.862236+0000) 2019-11-29T03:49:43.650 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:49:43.645+0000 1694c700 -1 osd.6 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.732666+0000 front 2019-11-29T03:48:40.769601+0000 (oldest deadline 2019-11-29T03:49:26.010110+0000) 2019-11-29T03:49:43.783 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:49:43.780+0000 1694c700 -1 osd.2 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.620736+0000 front 2019-11-29T03:48:37.595970+0000 (oldest deadline 2019-11-29T03:49:22.798161+0000) 2019-11-29T03:49:43.909 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:49:43.907+0000 1694c700 -1 osd.0 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:39.366935+0000 front 2019-11-29T03:48:39.367856+0000 (oldest deadline 2019-11-29T03:49:25.175046+0000) 2019-11-29T03:49:43.926 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:49:43.921+0000 1694c700 -1 osd.7 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:41.719384+0000 front 2019-11-29T03:48:41.253023+0000 (oldest deadline 2019-11-29T03:49:26.530650+0000) 2019-11-29T03:49:44.157 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:49:44.154+0000 1694c700 -1 osd.1 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.842904+0000 front 2019-11-29T03:48:40.863965+0000 (oldest deadline 2019-11-29T03:49:24.923640+0000) 2019-11-29T03:49:44.471 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:49:44.463+0000 1694c700 -1 osd.5 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.755396+0000 front 2019-11-29T03:48:37.955510+0000 (oldest deadline 2019-11-29T03:49:23.585850+0000) 2019-11-29T03:49:44.588 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:49:44.583+0000 1694c700 -1 osd.4 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:42.113720+0000 front 2019-11-29T03:48:39.191975+0000 (oldest deadline 2019-11-29T03:49:21.862236+0000) 2019-11-29T03:49:44.632 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:49:44.626+0000 1694c700 -1 osd.6 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.732666+0000 front 2019-11-29T03:48:40.769601+0000 (oldest deadline 2019-11-29T03:49:26.010110+0000) 2019-11-29T03:49:44.766 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:49:44.764+0000 1694c700 -1 osd.2 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.620736+0000 front 2019-11-29T03:48:37.595970+0000 (oldest deadline 2019-11-29T03:49:22.798161+0000) 2019-11-29T03:49:44.911 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:49:44.905+0000 1694c700 -1 osd.7 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:41.719384+0000 front 2019-11-29T03:48:41.253023+0000 (oldest deadline 2019-11-29T03:49:26.530650+0000) 2019-11-29T03:49:44.941 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:49:44.937+0000 1694c700 -1 osd.0 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:39.366935+0000 front 2019-11-29T03:48:39.367856+0000 (oldest deadline 2019-11-29T03:49:25.175046+0000) 2019-11-29T03:49:45.145 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:49:45.142+0000 1694c700 -1 osd.1 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.842904+0000 front 2019-11-29T03:48:40.863965+0000 (oldest deadline 2019-11-29T03:49:24.923640+0000) 2019-11-29T03:49:45.485 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:49:45.480+0000 1694c700 -1 osd.5 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.755396+0000 front 2019-11-29T03:48:37.955510+0000 (oldest deadline 2019-11-29T03:49:23.585850+0000) 2019-11-29T03:49:45.607 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:49:45.602+0000 1694c700 -1 osd.6 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.732666+0000 front 2019-11-29T03:48:40.769601+0000 (oldest deadline 2019-11-29T03:49:26.010110+0000) 2019-11-29T03:49:45.628 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:49:45.623+0000 1694c700 -1 osd.4 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:42.113720+0000 front 2019-11-29T03:48:39.191975+0000 (oldest deadline 2019-11-29T03:49:21.862236+0000) 2019-11-29T03:49:45.740 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:49:45.738+0000 1694c700 -1 osd.2 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.620736+0000 front 2019-11-29T03:48:37.595970+0000 (oldest deadline 2019-11-29T03:49:22.798161+0000) 2019-11-29T03:49:45.952 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:49:45.946+0000 1694c700 -1 osd.7 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:41.719384+0000 front 2019-11-29T03:48:41.253023+0000 (oldest deadline 2019-11-29T03:49:26.530650+0000) 2019-11-29T03:49:45.967 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:49:45.965+0000 1694c700 -1 osd.0 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:39.366935+0000 front 2019-11-29T03:48:39.367856+0000 (oldest deadline 2019-11-29T03:49:25.175046+0000) 2019-11-29T03:49:46.104 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:49:46.102+0000 1694c700 -1 osd.1 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.842904+0000 front 2019-11-29T03:48:40.863965+0000 (oldest deadline 2019-11-29T03:49:24.923640+0000) 2019-11-29T03:49:46.461 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:49:46.454+0000 1694c700 -1 osd.5 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.755396+0000 front 2019-11-29T03:48:37.955510+0000 (oldest deadline 2019-11-29T03:49:23.585850+0000) 2019-11-29T03:49:46.600 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:49:46.594+0000 1694c700 -1 osd.6 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.732666+0000 front 2019-11-29T03:48:40.769601+0000 (oldest deadline 2019-11-29T03:49:26.010110+0000) 2019-11-29T03:49:46.638 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:49:46.633+0000 1694c700 -1 osd.4 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:42.113720+0000 front 2019-11-29T03:48:39.191975+0000 (oldest deadline 2019-11-29T03:49:21.862236+0000) 2019-11-29T03:49:46.778 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:49:46.775+0000 1694c700 -1 osd.2 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.620736+0000 front 2019-11-29T03:48:37.595970+0000 (oldest deadline 2019-11-29T03:49:22.798161+0000) 2019-11-29T03:49:46.988 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:49:46.985+0000 1694c700 -1 osd.0 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:39.366935+0000 front 2019-11-29T03:48:39.367856+0000 (oldest deadline 2019-11-29T03:49:25.175046+0000) 2019-11-29T03:49:46.998 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:49:46.992+0000 1694c700 -1 osd.7 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:41.719384+0000 front 2019-11-29T03:48:41.253023+0000 (oldest deadline 2019-11-29T03:49:26.530650+0000) 2019-11-29T03:49:47.099 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:49:47.095+0000 1694c700 -1 osd.1 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.842904+0000 front 2019-11-29T03:48:40.863965+0000 (oldest deadline 2019-11-29T03:49:24.923640+0000) 2019-11-29T03:49:47.495 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:49:47.490+0000 1694c700 -1 osd.5 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.755396+0000 front 2019-11-29T03:48:37.955510+0000 (oldest deadline 2019-11-29T03:49:23.585850+0000) 2019-11-29T03:49:47.559 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:49:47.553+0000 1694c700 -1 osd.6 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.732666+0000 front 2019-11-29T03:48:40.769601+0000 (oldest deadline 2019-11-29T03:49:26.010110+0000) 2019-11-29T03:49:47.601 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:49:47.596+0000 1694c700 -1 osd.4 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:42.113720+0000 front 2019-11-29T03:48:39.191975+0000 (oldest deadline 2019-11-29T03:49:21.862236+0000) 2019-11-29T03:49:47.816 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:49:47.812+0000 1694c700 -1 osd.2 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.620736+0000 front 2019-11-29T03:48:37.595970+0000 (oldest deadline 2019-11-29T03:49:22.798161+0000) 2019-11-29T03:49:47.978 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:49:47.974+0000 1694c700 -1 osd.0 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:39.366935+0000 front 2019-11-29T03:48:39.367856+0000 (oldest deadline 2019-11-29T03:49:25.175046+0000) 2019-11-29T03:49:47.979 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:49:47.972+0000 1694c700 -1 osd.7 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:41.719384+0000 front 2019-11-29T03:48:41.253023+0000 (oldest deadline 2019-11-29T03:49:26.530650+0000) 2019-11-29T03:49:48.073 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:49:48.067+0000 1694c700 -1 osd.1 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.842904+0000 front 2019-11-29T03:48:40.863965+0000 (oldest deadline 2019-11-29T03:49:24.923640+0000) 2019-11-29T03:49:48.468 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:49:48.462+0000 1694c700 -1 osd.5 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.755396+0000 front 2019-11-29T03:48:37.955510+0000 (oldest deadline 2019-11-29T03:49:23.585850+0000) 2019-11-29T03:49:48.577 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:49:48.571+0000 1694c700 -1 osd.4 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:42.113720+0000 front 2019-11-29T03:48:39.191975+0000 (oldest deadline 2019-11-29T03:49:21.862236+0000) 2019-11-29T03:49:48.587 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:49:48.581+0000 1694c700 -1 osd.6 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.732666+0000 front 2019-11-29T03:48:40.769601+0000 (oldest deadline 2019-11-29T03:49:26.010110+0000) 2019-11-29T03:49:48.827 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:49:48.824+0000 1694c700 -1 osd.2 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.620736+0000 front 2019-11-29T03:48:37.595970+0000 (oldest deadline 2019-11-29T03:49:22.798161+0000) 2019-11-29T03:49:48.969 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:49:48.964+0000 1694c700 -1 osd.7 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:41.719384+0000 front 2019-11-29T03:48:41.253023+0000 (oldest deadline 2019-11-29T03:49:26.530650+0000) 2019-11-29T03:49:49.007 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:49:49.003+0000 1694c700 -1 osd.0 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:39.366935+0000 front 2019-11-29T03:48:39.367856+0000 (oldest deadline 2019-11-29T03:49:25.175046+0000) 2019-11-29T03:49:49.032 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:49:49.029+0000 1694c700 -1 osd.1 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.842904+0000 front 2019-11-29T03:48:40.863965+0000 (oldest deadline 2019-11-29T03:49:24.923640+0000) 2019-11-29T03:49:49.495 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:49:49.489+0000 1694c700 -1 osd.5 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.755396+0000 front 2019-11-29T03:48:37.955510+0000 (oldest deadline 2019-11-29T03:49:23.585850+0000) 2019-11-29T03:49:49.559 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:49:49.553+0000 1694c700 -1 osd.6 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.732666+0000 front 2019-11-29T03:48:40.769601+0000 (oldest deadline 2019-11-29T03:49:26.010110+0000) 2019-11-29T03:49:49.589 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:49:49.585+0000 1694c700 -1 osd.4 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:42.113720+0000 front 2019-11-29T03:48:39.191975+0000 (oldest deadline 2019-11-29T03:49:21.862236+0000) 2019-11-29T03:49:49.795 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:49:49.792+0000 1694c700 -1 osd.2 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.620736+0000 front 2019-11-29T03:48:37.595970+0000 (oldest deadline 2019-11-29T03:49:22.798161+0000) 2019-11-29T03:49:49.971 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:49:49.967+0000 1694c700 -1 osd.0 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:39.366935+0000 front 2019-11-29T03:48:39.367856+0000 (oldest deadline 2019-11-29T03:49:25.175046+0000) 2019-11-29T03:49:50.021 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:49:50.015+0000 1694c700 -1 osd.7 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:41.719384+0000 front 2019-11-29T03:48:41.253023+0000 (oldest deadline 2019-11-29T03:49:26.530650+0000) 2019-11-29T03:49:50.057 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:49:50.054+0000 1694c700 -1 osd.1 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.842904+0000 front 2019-11-29T03:48:40.863965+0000 (oldest deadline 2019-11-29T03:49:24.923640+0000) 2019-11-29T03:49:50.538 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:49:50.532+0000 1694c700 -1 osd.5 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.755396+0000 front 2019-11-29T03:48:37.955510+0000 (oldest deadline 2019-11-29T03:49:23.585850+0000) 2019-11-29T03:49:50.569 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:49:50.562+0000 1694c700 -1 osd.6 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.732666+0000 front 2019-11-29T03:48:40.769601+0000 (oldest deadline 2019-11-29T03:49:26.010110+0000) 2019-11-29T03:49:50.601 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:49:50.596+0000 1694c700 -1 osd.4 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:42.113720+0000 front 2019-11-29T03:48:39.191975+0000 (oldest deadline 2019-11-29T03:49:21.862236+0000) 2019-11-29T03:49:50.801 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:49:50.797+0000 1694c700 -1 osd.2 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.620736+0000 front 2019-11-29T03:48:37.595970+0000 (oldest deadline 2019-11-29T03:49:22.798161+0000) 2019-11-29T03:49:50.986 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:49:50.982+0000 1694c700 -1 osd.0 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:39.366935+0000 front 2019-11-29T03:48:39.367856+0000 (oldest deadline 2019-11-29T03:49:25.175046+0000) 2019-11-29T03:49:51.047 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:49:51.042+0000 1694c700 -1 osd.7 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:41.719384+0000 front 2019-11-29T03:48:41.253023+0000 (oldest deadline 2019-11-29T03:49:26.530650+0000) 2019-11-29T03:49:51.094 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:49:51.090+0000 1694c700 -1 osd.1 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.842904+0000 front 2019-11-29T03:48:40.863965+0000 (oldest deadline 2019-11-29T03:49:24.923640+0000) 2019-11-29T03:49:51.580 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:49:51.574+0000 1694c700 -1 osd.5 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.755396+0000 front 2019-11-29T03:48:37.955510+0000 (oldest deadline 2019-11-29T03:49:23.585850+0000) 2019-11-29T03:49:51.585 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:49:51.578+0000 1694c700 -1 osd.4 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:42.113720+0000 front 2019-11-29T03:48:39.191975+0000 (oldest deadline 2019-11-29T03:49:21.862236+0000) 2019-11-29T03:49:51.621 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:49:51.616+0000 1694c700 -1 osd.6 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.732666+0000 front 2019-11-29T03:48:40.769601+0000 (oldest deadline 2019-11-29T03:49:26.010110+0000) 2019-11-29T03:49:51.759 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:49:51.756+0000 1694c700 -1 osd.2 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.620736+0000 front 2019-11-29T03:48:37.595970+0000 (oldest deadline 2019-11-29T03:49:22.798161+0000) 2019-11-29T03:49:52.068 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:49:51.967+0000 1694c700 -1 osd.0 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:39.366935+0000 front 2019-11-29T03:48:39.367856+0000 (oldest deadline 2019-11-29T03:49:25.175046+0000) 2019-11-29T03:49:52.071 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:49:52.047+0000 1694c700 -1 osd.1 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.842904+0000 front 2019-11-29T03:48:40.863965+0000 (oldest deadline 2019-11-29T03:49:24.923640+0000) 2019-11-29T03:49:52.091 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:49:52.085+0000 1694c700 -1 osd.7 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:41.719384+0000 front 2019-11-29T03:48:41.253023+0000 (oldest deadline 2019-11-29T03:49:26.530650+0000) 2019-11-29T03:49:52.604 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:49:52.598+0000 1694c700 -1 osd.4 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:42.113720+0000 front 2019-11-29T03:48:39.191975+0000 (oldest deadline 2019-11-29T03:49:21.862236+0000) 2019-11-29T03:49:52.617 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:49:52.611+0000 1694c700 -1 osd.5 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.755396+0000 front 2019-11-29T03:48:37.955510+0000 (oldest deadline 2019-11-29T03:49:23.585850+0000) 2019-11-29T03:49:52.619 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:49:52.614+0000 1694c700 -1 osd.6 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.732666+0000 front 2019-11-29T03:48:40.769601+0000 (oldest deadline 2019-11-29T03:49:26.010110+0000) 2019-11-29T03:49:52.763 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:49:52.760+0000 1694c700 -1 osd.2 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.620736+0000 front 2019-11-29T03:48:37.595970+0000 (oldest deadline 2019-11-29T03:49:22.798161+0000) 2019-11-29T03:49:52.995 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:49:52.991+0000 1694c700 -1 osd.0 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:39.366935+0000 front 2019-11-29T03:48:39.367856+0000 (oldest deadline 2019-11-29T03:49:25.175046+0000) 2019-11-29T03:49:53.041 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:49:53.037+0000 1694c700 -1 osd.1 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.842904+0000 front 2019-11-29T03:48:40.863965+0000 (oldest deadline 2019-11-29T03:49:24.923640+0000) 2019-11-29T03:49:53.107 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:49:53.102+0000 1694c700 -1 osd.7 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:41.719384+0000 front 2019-11-29T03:48:41.253023+0000 (oldest deadline 2019-11-29T03:49:26.530650+0000) 2019-11-29T03:49:53.611 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:49:53.606+0000 1694c700 -1 osd.5 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.755396+0000 front 2019-11-29T03:48:37.955510+0000 (oldest deadline 2019-11-29T03:49:23.585850+0000) 2019-11-29T03:49:53.631 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:49:53.625+0000 1694c700 -1 osd.4 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:42.113720+0000 front 2019-11-29T03:48:39.191975+0000 (oldest deadline 2019-11-29T03:49:21.862236+0000) 2019-11-29T03:49:53.675 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:49:53.670+0000 1694c700 -1 osd.6 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.732666+0000 front 2019-11-29T03:48:40.769601+0000 (oldest deadline 2019-11-29T03:49:26.010110+0000) 2019-11-29T03:49:53.789 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:49:53.786+0000 1694c700 -1 osd.2 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.620736+0000 front 2019-11-29T03:48:37.595970+0000 (oldest deadline 2019-11-29T03:49:22.798161+0000) 2019-11-29T03:49:54.031 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:49:54.028+0000 1694c700 -1 osd.0 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:39.366935+0000 front 2019-11-29T03:48:39.367856+0000 (oldest deadline 2019-11-29T03:49:25.175046+0000) 2019-11-29T03:49:54.069 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:49:54.066+0000 1694c700 -1 osd.1 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.842904+0000 front 2019-11-29T03:48:40.863965+0000 (oldest deadline 2019-11-29T03:49:24.923640+0000) 2019-11-29T03:49:54.144 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:49:54.138+0000 1694c700 -1 osd.7 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:41.719384+0000 front 2019-11-29T03:48:41.253023+0000 (oldest deadline 2019-11-29T03:49:26.530650+0000) 2019-11-29T03:49:54.598 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:49:54.592+0000 1694c700 -1 osd.4 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:42.113720+0000 front 2019-11-29T03:48:39.191975+0000 (oldest deadline 2019-11-29T03:49:21.862236+0000) 2019-11-29T03:49:54.659 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:49:54.654+0000 1694c700 -1 osd.5 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.755396+0000 front 2019-11-29T03:48:37.955510+0000 (oldest deadline 2019-11-29T03:49:23.585850+0000) 2019-11-29T03:49:54.692 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:49:54.686+0000 1694c700 -1 osd.6 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.732666+0000 front 2019-11-29T03:48:40.769601+0000 (oldest deadline 2019-11-29T03:49:26.010110+0000) 2019-11-29T03:49:54.779 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:49:54.776+0000 1694c700 -1 osd.2 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.620736+0000 front 2019-11-29T03:48:37.595970+0000 (oldest deadline 2019-11-29T03:49:22.798161+0000) 2019-11-29T03:49:55.034 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:49:55.030+0000 1694c700 -1 osd.0 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:39.366935+0000 front 2019-11-29T03:48:39.367856+0000 (oldest deadline 2019-11-29T03:49:25.175046+0000) 2019-11-29T03:49:55.108 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:49:55.103+0000 1694c700 -1 osd.1 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.842904+0000 front 2019-11-29T03:48:40.863965+0000 (oldest deadline 2019-11-29T03:49:24.923640+0000) 2019-11-29T03:49:55.170 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:49:55.164+0000 1694c700 -1 osd.7 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:41.719384+0000 front 2019-11-29T03:48:41.253023+0000 (oldest deadline 2019-11-29T03:49:26.530650+0000) 2019-11-29T03:49:55.564 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:49:55.558+0000 1694c700 -1 osd.4 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:42.113720+0000 front 2019-11-29T03:48:39.191975+0000 (oldest deadline 2019-11-29T03:49:21.862236+0000) 2019-11-29T03:49:55.671 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:49:55.665+0000 1694c700 -1 osd.5 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.755396+0000 front 2019-11-29T03:48:37.955510+0000 (oldest deadline 2019-11-29T03:49:23.585850+0000) 2019-11-29T03:49:55.716 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:49:55.710+0000 1694c700 -1 osd.6 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.732666+0000 front 2019-11-29T03:48:40.769601+0000 (oldest deadline 2019-11-29T03:49:26.010110+0000) 2019-11-29T03:49:55.797 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:49:55.792+0000 1694c700 -1 osd.2 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.620736+0000 front 2019-11-29T03:48:37.595970+0000 (oldest deadline 2019-11-29T03:49:22.798161+0000) 2019-11-29T03:49:56.072 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:49:56.068+0000 1694c700 -1 osd.0 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:39.366935+0000 front 2019-11-29T03:48:39.367856+0000 (oldest deadline 2019-11-29T03:49:25.175046+0000) 2019-11-29T03:49:56.098 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:49:56.094+0000 1694c700 -1 osd.1 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.842904+0000 front 2019-11-29T03:48:40.863965+0000 (oldest deadline 2019-11-29T03:49:24.923640+0000) 2019-11-29T03:49:56.209 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:49:56.203+0000 1694c700 -1 osd.7 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:41.719384+0000 front 2019-11-29T03:48:41.253023+0000 (oldest deadline 2019-11-29T03:49:26.530650+0000) 2019-11-29T03:49:56.558 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:49:56.552+0000 1694c700 -1 osd.4 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:42.113720+0000 front 2019-11-29T03:48:39.191975+0000 (oldest deadline 2019-11-29T03:49:21.862236+0000) 2019-11-29T03:49:56.677 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:49:56.671+0000 1694c700 -1 osd.6 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.732666+0000 front 2019-11-29T03:48:40.769601+0000 (oldest deadline 2019-11-29T03:49:26.010110+0000) 2019-11-29T03:49:56.696 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:49:56.691+0000 1694c700 -1 osd.5 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.755396+0000 front 2019-11-29T03:48:37.955510+0000 (oldest deadline 2019-11-29T03:49:23.585850+0000) 2019-11-29T03:49:56.756 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:49:56.751+0000 1694c700 -1 osd.2 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:37.620736+0000 front 2019-11-29T03:48:37.595970+0000 (oldest deadline 2019-11-29T03:49:22.798161+0000) 2019-11-29T03:49:57.073 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:49:57.069+0000 1694c700 -1 osd.1 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:40.842904+0000 front 2019-11-29T03:48:40.863965+0000 (oldest deadline 2019-11-29T03:49:24.923640+0000) 2019-11-29T03:49:57.079 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:49:57.076+0000 1694c700 -1 osd.0 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:39.366935+0000 front 2019-11-29T03:48:39.367856+0000 (oldest deadline 2019-11-29T03:49:25.175046+0000) 2019-11-29T03:49:57.179 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:49:57.171+0000 1694c700 -1 osd.7 321 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:48:41.719384+0000 front 2019-11-29T03:48:41.253023+0000 (oldest deadline 2019-11-29T03:49:26.530650+0000) 2019-11-29T03:49:57.280 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:49:57.275+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.74:6802/10096,v1:172.21.15.74:6803/10096] for 48sec e321 v321) 2019-11-29T03:50:27.479 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:50:27.473+0000 35f8c700 -1 osd.0 325 build_incremental_map_msg missing incremental map 325 2019-11-29T03:50:27.753 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:50:27.659+0000 33787700 -1 osd.0 325 build_incremental_map_msg missing incremental map 325 2019-11-29T03:50:27.996 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:50:27.824+0000 38791700 -1 osd.0 325 build_incremental_map_msg missing incremental map 325 2019-11-29T03:50:28.267 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:50:28.166+0000 33f88700 -1 osd.5 325 build_incremental_map_msg missing incremental map 325 2019-11-29T03:50:29.144 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:50:29.140+0000 33787700 -1 osd.0 326 build_incremental_map_msg missing incremental map 325 2019-11-29T03:50:30.809 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:50:30.749+0000 114ab700 -1 osd.3 327 build_incremental_map_msg missing incremental map 327 2019-11-29T03:50:30.814 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:50:30.764+0000 32785700 -1 osd.3 327 build_incremental_map_msg missing incremental map 327 2019-11-29T03:50:30.817 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:50:30.814+0000 31f84700 -1 osd.3 327 build_incremental_map_msg missing incremental map 327 2019-11-29T03:50:30.903 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:50:30.894+0000 32785700 -1 osd.3 327 build_incremental_map_msg missing incremental map 327 2019-11-29T03:50:31.007 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:50:30.992+0000 35f8c700 -1 osd.3 327 build_incremental_map_msg missing incremental map 327 2019-11-29T03:50:31.264 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:50:31.155+0000 38791700 -1 osd.3 327 build_incremental_map_msg missing incremental map 327 2019-11-29T03:50:31.405 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:50:31.286+0000 38791700 -1 osd.3 327 build_incremental_map_msg missing incremental map 327 2019-11-29T03:50:31.806 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:50:31.753+0000 37f90700 -1 osd.3 327 build_incremental_map_msg missing incremental map 327 2019-11-29T03:50:33.053 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:50:33.051+0000 33f88700 -1 osd.3 327 build_incremental_map_msg missing incremental map 327 2019-11-29T03:50:53.566 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:50:53.562+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:50:54.310 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:50:54.305+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:50:54.588 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:50:54.584+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:50:55.285 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:50:55.280+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:50:55.285 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:50:55.281+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:50:55.520 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:50:55.516+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:50:55.619 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:50:55.615+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:50:56.251 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:50:56.246+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:50:56.277 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:50:56.272+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:50:56.292 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:50:56.286+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:50:56.501 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:50:56.498+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:50:56.603 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:50:56.598+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:50:57.272 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:50:57.267+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:50:57.286 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:50:57.282+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:50:57.324 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:50:57.319+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:50:57.457 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:50:57.453+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:50:57.547 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:50:57.544+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:50:57.600 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:50:57.597+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:50:58.299 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:50:58.292+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:50:58.340 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:50:58.332+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:50:58.343 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:50:58.337+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:50:58.464 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:50:58.460+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:50:58.534 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:50:58.531+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:50:58.645 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:50:58.642+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:50:59.265 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:50:59.259+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:50:59.314 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:50:59.308+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:50:59.361 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:50:59.354+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:50:59.508 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:50:59.504+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:50:59.525 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:50:59.522+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:50:59.656 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:50:59.653+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:51:00.240 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:51:00.234+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:51:00.315 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:51:00.309+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:51:00.386 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:51:00.379+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:51:00.518 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:51:00.512+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:51:00.556 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:51:00.553+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:51:00.639 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:51:00.637+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:51:00.831 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:00.828+0000 1694c700 -1 osd.3 327 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T03:51:01.209 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:51:01.203+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:51:01.274 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:51:01.269+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:51:01.358 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:51:01.354+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:51:01.533 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:51:01.529+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:51:01.590 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:51:01.587+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:51:01.672 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:51:01.668+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:51:01.807 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:01.803+0000 1694c700 -1 osd.3 327 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T03:51:02.230 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:51:02.225+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:51:02.302 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:51:02.294+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:51:02.322 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:51:02.317+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:51:02.490 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:51:02.487+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:51:02.623 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:51:02.620+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:51:02.682 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:51:02.678+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:51:02.817 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:02.813+0000 1694c700 -1 osd.3 327 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T03:51:03.228 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:51:03.223+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:51:03.254 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:51:03.249+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:51:03.316 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:51:03.310+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:51:03.537 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:51:03.533+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:51:03.618 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:51:03.614+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:51:03.727 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:51:03.723+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:51:03.834 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:03.832+0000 1694c700 -1 osd.3 327 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T03:51:04.252 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:51:04.247+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:51:04.256 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:51:04.251+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:51:04.287 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:51:04.282+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:51:04.495 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:51:04.493+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:51:04.577 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:51:04.575+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:51:04.750 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:51:04.748+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:51:04.796 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:04.792+0000 1694c700 -1 osd.3 327 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T03:51:05.267 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:51:05.262+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:51:05.273 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:51:05.268+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:51:05.280 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:51:05.276+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:51:05.452 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:51:05.450+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:51:05.571 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:51:05.567+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:51:05.710 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:51:05.707+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:51:05.841 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:05.837+0000 1694c700 -1 osd.3 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:50:25.068689+0000 (oldest deadline 2019-11-29T03:51:05.068689+0000) 2019-11-29T03:51:05.842 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:05.839+0000 1694c700 -1 osd.3 327 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T03:51:06.244 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:51:06.238+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:51:06.247 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:51:06.242+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:51:06.292 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:51:06.287+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:51:06.473 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:51:06.469+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:51:06.574 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:51:06.572+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:51:06.756 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:51:06.752+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:51:06.839 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:06.836+0000 1694c700 -1 osd.3 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:50:25.068689+0000 (oldest deadline 2019-11-29T03:51:05.068689+0000) 2019-11-29T03:51:06.840 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:06.837+0000 1694c700 -1 osd.3 327 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T03:51:07.203 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:51:07.199+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:51:07.212 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:51:07.208+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:51:07.306 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:51:07.301+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:51:07.474 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:51:07.472+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:51:07.531 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:51:07.528+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:51:07.802 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:51:07.800+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:51:07.887 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:07.883+0000 1694c700 -1 osd.3 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:50:25.068689+0000 (oldest deadline 2019-11-29T03:51:05.068689+0000) 2019-11-29T03:51:07.887 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:07.885+0000 1694c700 -1 osd.3 327 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T03:51:08.165 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:51:08.161+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:51:08.216 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:51:08.211+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:51:08.280 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:51:08.275+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:51:08.483 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:51:08.480+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:51:08.503 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:51:08.500+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:51:08.785 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:51:08.782+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:51:08.893 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:08.889+0000 1694c700 -1 osd.3 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:50:25.068689+0000 (oldest deadline 2019-11-29T03:51:05.068689+0000) 2019-11-29T03:51:08.893 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:08.891+0000 1694c700 -1 osd.3 327 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T03:51:09.189 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:51:09.184+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:51:09.249 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:51:09.244+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:51:09.328 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:51:09.323+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:51:09.458 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:51:09.455+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:51:09.535 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:51:09.533+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:51:09.827 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:51:09.825+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:51:09.908 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:09.905+0000 1694c700 -1 osd.3 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:50:25.068689+0000 (oldest deadline 2019-11-29T03:51:05.068689+0000) 2019-11-29T03:51:09.908 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:09.907+0000 1694c700 -1 osd.3 327 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T03:51:10.169 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:51:10.164+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:51:10.268 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:51:10.263+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:51:10.299 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:51:10.295+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:51:10.482 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:51:10.480+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:51:10.510 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:51:10.507+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:51:10.875 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:51:10.871+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:51:10.949 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:10.944+0000 1694c700 -1 osd.3 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:50:25.068689+0000 (oldest deadline 2019-11-29T03:51:05.068689+0000) 2019-11-29T03:51:10.952 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:10.950+0000 1694c700 -1 osd.3 327 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T03:51:11.179 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:51:11.174+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:51:11.263 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:51:11.258+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:51:11.278 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:51:11.273+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:51:11.506 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:51:11.502+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:51:11.532 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:51:11.529+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:51:11.833 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:51:11.831+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:51:11.943 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:11.941+0000 1694c700 -1 osd.3 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:50:25.068689+0000 (oldest deadline 2019-11-29T03:51:05.068689+0000) 2019-11-29T03:51:11.945 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:11.944+0000 1694c700 -1 osd.3 327 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T03:51:12.150 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:51:12.145+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:51:12.234 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:51:12.229+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:51:12.313 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:51:12.308+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:51:12.526 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:51:12.523+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:51:12.529 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:51:12.526+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:51:12.838 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:51:12.836+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:51:12.943 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:12.939+0000 1694c700 -1 osd.3 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:50:25.068689+0000 (oldest deadline 2019-11-29T03:51:05.068689+0000) 2019-11-29T03:51:12.944 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:12.941+0000 1694c700 -1 osd.3 327 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T03:51:13.140 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:51:13.135+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:51:13.201 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:51:13.197+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:51:13.297 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:51:13.291+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:51:13.485 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:51:13.483+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:51:13.566 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:51:13.563+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:51:13.880 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:51:13.878+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:51:13.911 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:13.908+0000 1694c700 -1 osd.3 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:50:25.068689+0000 (oldest deadline 2019-11-29T03:51:05.068689+0000) 2019-11-29T03:51:13.911 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:13.909+0000 1694c700 -1 osd.3 327 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T03:51:14.093 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:51:14.089+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:51:14.243 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:51:14.238+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:51:14.321 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:51:14.316+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:51:14.539 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:51:14.536+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:51:14.569 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:51:14.566+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:51:14.838 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:51:14.835+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:51:14.952 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:14.950+0000 1694c700 -1 osd.3 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:50:25.068689+0000 (oldest deadline 2019-11-29T03:51:05.068689+0000) 2019-11-29T03:51:14.952 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:14.951+0000 1694c700 -1 osd.3 327 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T03:51:15.095 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:51:15.090+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:51:15.223 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:51:15.218+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:51:15.346 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:51:15.341+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:51:15.493 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:51:15.491+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:51:15.571 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:51:15.568+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:51:15.795 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:51:15.791+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:51:15.935 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:15.934+0000 1694c700 -1 osd.3 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:50:25.068689+0000 (oldest deadline 2019-11-29T03:51:05.068689+0000) 2019-11-29T03:51:15.937 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:15.936+0000 1694c700 -1 osd.3 327 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T03:51:16.108 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:51:16.103+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:51:16.260 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:51:16.255+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:51:16.327 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:51:16.321+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:51:16.496 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:51:16.494+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:51:16.560 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:51:16.559+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:51:16.839 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:51:16.836+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:51:16.928 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:16.925+0000 1694c700 -1 osd.3 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:50:25.068689+0000 (oldest deadline 2019-11-29T03:51:05.068689+0000) 2019-11-29T03:51:16.930 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:16.928+0000 1694c700 -1 osd.3 327 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T03:51:17.129 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:51:17.125+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:51:17.292 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:51:17.288+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:51:17.330 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:51:17.325+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:51:17.454 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:51:17.450+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:51:17.562 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:51:17.559+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:51:17.805 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:51:17.800+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:51:17.893 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:17.889+0000 1694c700 -1 osd.3 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:50:25.068689+0000 (oldest deadline 2019-11-29T03:51:05.068689+0000) 2019-11-29T03:51:17.894 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:17.890+0000 1694c700 -1 osd.3 327 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T03:51:18.097 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:51:18.092+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:51:18.340 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:51:18.335+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:51:18.358 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:51:18.353+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:51:18.453 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:51:18.450+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:51:18.547 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:51:18.544+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:51:18.839 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:51:18.835+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:51:18.881 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:18.877+0000 1694c700 -1 osd.3 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:50:25.068689+0000 (oldest deadline 2019-11-29T03:51:05.068689+0000) 2019-11-29T03:51:18.882 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:18.879+0000 1694c700 -1 osd.3 327 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T03:51:19.056 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:51:19.051+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:51:19.323 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:51:19.318+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:51:19.411 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:51:19.406+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:51:19.507 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:51:19.503+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:51:19.565 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:51:19.561+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:51:19.887 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:51:19.883+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:51:19.920 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:19.914+0000 1694c700 -1 osd.3 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:50:25.068689+0000 (oldest deadline 2019-11-29T03:51:05.068689+0000) 2019-11-29T03:51:19.920 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:19.915+0000 1694c700 -1 osd.3 327 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T03:51:20.028 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:51:20.023+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:51:20.382 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:51:20.371+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:51:20.462 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:51:20.459+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:51:20.467 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:51:20.462+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:51:20.608 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:51:20.605+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:51:20.915 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:51:20.912+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:51:20.929 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:20.926+0000 1694c700 -1 osd.3 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:50:25.068689+0000 (oldest deadline 2019-11-29T03:51:05.068689+0000) 2019-11-29T03:51:20.930 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:20.927+0000 1694c700 -1 osd.3 327 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T03:51:21.012 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:51:21.007+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:51:21.389 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:51:21.384+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:51:21.437 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:51:21.434+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:51:21.519 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:51:21.514+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:51:21.637 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:51:21.633+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:51:21.898 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:21.894+0000 1694c700 -1 osd.3 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:50:25.068689+0000 (oldest deadline 2019-11-29T03:51:05.068689+0000) 2019-11-29T03:51:21.899 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:21.896+0000 1694c700 -1 osd.3 327 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T03:51:21.928 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:51:21.925+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:51:22.029 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:51:22.024+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:51:22.397 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:51:22.393+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:51:22.429 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:51:22.426+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:51:22.527 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:51:22.522+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:51:22.612 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:51:22.609+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:51:22.938 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:22.936+0000 1694c700 -1 osd.3 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:50:25.068689+0000 (oldest deadline 2019-11-29T03:51:05.068689+0000) 2019-11-29T03:51:22.940 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:22.937+0000 1694c700 -1 osd.3 327 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T03:51:22.957 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:51:22.954+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:51:23.085 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:51:23.080+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:51:23.383 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:51:23.380+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:51:23.392 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:51:23.386+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:51:23.490 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:51:23.486+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:51:23.662 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:51:23.659+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:51:23.916 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:51:23.913+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:51:23.965 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:23.961+0000 1694c700 -1 osd.3 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:50:25.068689+0000 (oldest deadline 2019-11-29T03:51:05.068689+0000) 2019-11-29T03:51:23.966 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:23.962+0000 1694c700 -1 osd.3 327 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T03:51:24.080 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:51:24.076+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:51:24.372 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:51:24.367+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:51:24.399 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:51:24.395+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:51:24.524 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:51:24.517+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:51:24.647 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:51:24.644+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:51:24.947 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:51:24.943+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:51:24.991 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:24.987+0000 1694c700 -1 osd.3 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:50:25.068689+0000 (oldest deadline 2019-11-29T03:51:05.068689+0000) 2019-11-29T03:51:24.992 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:24.989+0000 1694c700 -1 osd.3 327 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T03:51:25.058 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:51:25.053+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:51:25.098 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:06:05:07.317 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:51:25.115 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:06:05:07.333 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:51:25.116 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:06:05:07.336 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:51:25.120 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:06:05:07.349 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:51:25.122 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:06:05:07.342 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:51:25.124 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:06:05:07.352 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:51:25.337 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:51:25.333+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:51:25.375 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:06:05:07.604 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:51:25.383 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:06:05:07.601 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:51:25.388 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:51:25.385+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:51:25.420 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:06:05:07.639 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:51:25.539 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:51:25.533+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:51:25.685 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:51:25.682+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:51:25.913 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:51:25.910+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:51:26.007 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:26.004+0000 1694c700 -1 osd.3 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:50:25.068689+0000 (oldest deadline 2019-11-29T03:51:05.068689+0000) 2019-11-29T03:51:26.009 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:26.006+0000 1694c700 -1 osd.3 327 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T03:51:26.053 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:51:26.048+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:51:26.376 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:51:26.373+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:51:26.437 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:51:26.434+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:51:26.509 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:51:26.504+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:51:26.641 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:51:26.637+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:51:26.912 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:51:26.908+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:51:27.007 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:27.002+0000 1694c700 -1 osd.3 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:50:25.068689+0000 (oldest deadline 2019-11-29T03:51:05.068689+0000) 2019-11-29T03:51:27.008 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:27.005+0000 1694c700 -1 osd.3 327 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T03:51:27.054 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:51:27.049+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:51:27.367 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:51:27.362+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:51:27.435 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:51:27.431+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:51:27.509 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:51:27.502+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 44sec e327 v327) 2019-11-29T03:51:27.515 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:51:27.509+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:51:27.645 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:51:27.643+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:51:27.872 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:51:27.868+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:51:28.050 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:28.046+0000 1694c700 -1 osd.3 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:50:25.068689+0000 (oldest deadline 2019-11-29T03:51:05.068689+0000) 2019-11-29T03:51:28.050 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:28.047+0000 1694c700 -1 osd.3 327 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T03:51:28.097 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:51:28.093+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:51:28.380 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:51:28.375+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:51:28.407 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:51:28.403+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:51:28.480 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:51:28.475+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:51:28.608 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:51:28.604+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:51:28.849 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:51:28.845+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:51:29.054 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:29.049+0000 1694c700 -1 osd.3 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:50:25.068689+0000 (oldest deadline 2019-11-29T03:51:05.068689+0000) 2019-11-29T03:51:29.056 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:29.052+0000 1694c700 -1 osd.3 327 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T03:51:29.136 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:51:29.131+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:51:29.399 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:51:29.396+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:51:29.423 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:51:29.419+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:51:29.490 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:51:29.485+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:51:29.604 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:51:29.601+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:51:29.804 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:51:29.800+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:51:30.041 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:30.037+0000 1694c700 -1 osd.3 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:50:25.068689+0000 (oldest deadline 2019-11-29T03:51:05.068689+0000) 2019-11-29T03:51:30.042 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:30.039+0000 1694c700 -1 osd.3 327 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T03:51:30.114 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:51:30.108+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:51:30.409 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:51:30.401+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:51:30.439 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:51:30.436+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:51:30.447 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:51:30.442+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:51:30.571 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:51:30.568+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:51:30.834 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:51:30.830+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:51:31.050 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:31.045+0000 1694c700 -1 osd.3 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:50:25.068689+0000 (oldest deadline 2019-11-29T03:51:05.068689+0000) 2019-11-29T03:51:31.050 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:31.047+0000 1694c700 -1 osd.3 327 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T03:51:31.079 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:51:31.074+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:51:31.395 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:51:31.391+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:51:31.434 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:51:31.429+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:51:31.464 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:51:31.461+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:51:31.535 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:51:31.532+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:51:31.835 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:51:31.832+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:51:32.034 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:51:32.028+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:51:32.043 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:32.040+0000 1694c700 -1 osd.3 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:50:25.068689+0000 (oldest deadline 2019-11-29T03:51:05.068689+0000) 2019-11-29T03:51:32.046 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:32.044+0000 1694c700 -1 osd.3 327 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T03:51:32.421 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:51:32.409+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:51:32.441 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:51:32.438+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:51:32.469 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:51:32.464+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:51:32.497 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:51:32.494+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:51:32.524 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:51:32.519+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 44sec e327 v327) 2019-11-29T03:51:32.848 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:51:32.844+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:51:33.001 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:51:32.997+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:51:33.043 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:33.039+0000 1694c700 -1 osd.3 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:50:25.068689+0000 (oldest deadline 2019-11-29T03:51:05.068689+0000) 2019-11-29T03:51:33.044 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:33.040+0000 1694c700 -1 osd.3 327 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T03:51:33.449 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:51:33.444+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:51:33.468 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:51:33.465+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:51:33.508 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:51:33.502+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:51:33.538 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:51:33.535+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:51:33.809 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:51:33.803+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:51:34.016 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:51:34.011+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:51:34.045 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:34.042+0000 1694c700 -1 osd.3 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:50:25.068689+0000 (oldest deadline 2019-11-29T03:51:05.068689+0000) 2019-11-29T03:51:34.046 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:34.043+0000 1694c700 -1 osd.3 327 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T03:51:34.417 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:51:34.411+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:51:34.433 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:51:34.430+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:51:34.517 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:51:34.512+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:51:34.575 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:51:34.572+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:51:34.784 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:51:34.782+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:51:35.000 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:51:34.995+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:51:35.068 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:35.062+0000 1694c700 -1 osd.3 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:50:25.068689+0000 (oldest deadline 2019-11-29T03:51:05.068689+0000) 2019-11-29T03:51:35.068 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:35.064+0000 1694c700 -1 osd.3 327 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T03:51:35.402 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:51:35.399+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:51:35.442 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:51:35.436+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:51:35.493 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:51:35.487+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:51:35.628 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:51:35.623+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:51:35.801 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:51:35.798+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:51:36.033 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:51:36.029+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:51:36.072 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:36.069+0000 1694c700 -1 osd.3 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:50:25.068689+0000 (oldest deadline 2019-11-29T03:51:05.068689+0000) 2019-11-29T03:51:36.073 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:36.070+0000 1694c700 -1 osd.3 327 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T03:51:36.380 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:51:36.377+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:51:36.492 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:51:36.487+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:51:36.535 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:51:36.530+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:51:36.671 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:51:36.667+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:51:36.784 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:51:36.781+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:51:37.076 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:51:37.071+0000 1694c700 -1 osd.4 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.975527+0000 front 2019-11-29T03:50:11.992062+0000 (oldest deadline 2019-11-29T03:50:55.252499+0000) 2019-11-29T03:51:37.101 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:37.098+0000 1694c700 -1 osd.3 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:50:25.068689+0000 (oldest deadline 2019-11-29T03:51:05.068689+0000) 2019-11-29T03:51:37.104 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:51:37.102+0000 1694c700 -1 osd.3 327 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T03:51:37.384 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:51:37.380+0000 1694c700 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.583023+0000 front 2019-11-29T03:50:10.581964+0000 (oldest deadline 2019-11-29T03:50:55.101546+0000) 2019-11-29T03:51:37.525 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:51:37.519+0000 1694c700 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:09.705437+0000 front 2019-11-29T03:50:09.719548+0000 (oldest deadline 2019-11-29T03:50:54.179431+0000) 2019-11-29T03:51:37.544 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:51:37.539+0000 1694c700 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:11.960060+0000 front 2019-11-29T03:50:12.036022+0000 (oldest deadline 2019-11-29T03:50:56.006236+0000) 2019-11-29T03:51:37.587 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:51:37.578+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 44sec e327 v327) 2019-11-29T03:51:37.723 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:51:37.720+0000 1694c700 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:10.871924+0000 front 2019-11-29T03:50:11.125455+0000 (oldest deadline 2019-11-29T03:50:56.767046+0000) 2019-11-29T03:51:37.833 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:51:37.830+0000 1694c700 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:50:13.979697+0000 front 2019-11-29T03:50:11.485030+0000 (oldest deadline 2019-11-29T03:50:53.485531+0000) 2019-11-29T03:52:08.374 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:52:08.342+0000 33787700 -1 osd.5 327 build_incremental_map_msg missing incremental map 325 2019-11-29T03:53:13.756 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:53:13.749+0000 1694c700 -1 osd.4 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.555879+0000 front 2019-11-29T03:52:29.092838+0000 (oldest deadline 2019-11-29T03:53:13.672369+0000) 2019-11-29T03:53:14.793 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:53:14.787+0000 1694c700 -1 osd.4 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.555879+0000 front 2019-11-29T03:52:29.092838+0000 (oldest deadline 2019-11-29T03:53:13.672369+0000) 2019-11-29T03:53:15.226 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:53:15.223+0000 1694c700 -1 osd.1 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.556557+0000 front 2019-11-29T03:52:29.719455+0000 (oldest deadline 2019-11-29T03:53:14.196110+0000) 2019-11-29T03:53:15.749 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:53:15.745+0000 1694c700 -1 osd.0 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.986428+0000 front 2019-11-29T03:52:30.836770+0000 (oldest deadline 2019-11-29T03:53:15.505554+0000) 2019-11-29T03:53:15.785 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:53:15.779+0000 1694c700 -1 osd.4 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.555879+0000 front 2019-11-29T03:52:29.092838+0000 (oldest deadline 2019-11-29T03:53:13.672369+0000) 2019-11-29T03:53:16.116 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:53:16.111+0000 1694c700 -1 osd.5 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.731604+0000 front 2019-11-29T03:52:30.784988+0000 (oldest deadline 2019-11-29T03:53:16.005015+0000) 2019-11-29T03:53:16.191 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:53:16.188+0000 1694c700 -1 osd.1 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.556557+0000 front 2019-11-29T03:52:29.719455+0000 (oldest deadline 2019-11-29T03:53:14.196110+0000) 2019-11-29T03:53:16.649 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:53:16.643+0000 1694c700 -1 osd.7 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.696495+0000 front 2019-11-29T03:52:30.752286+0000 (oldest deadline 2019-11-29T03:53:16.566970+0000) 2019-11-29T03:53:16.728 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:53:16.724+0000 1694c700 -1 osd.0 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.986428+0000 front 2019-11-29T03:52:30.836770+0000 (oldest deadline 2019-11-29T03:53:15.505554+0000) 2019-11-29T03:53:16.751 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:53:16.745+0000 1694c700 -1 osd.4 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.555879+0000 front 2019-11-29T03:52:29.092838+0000 (oldest deadline 2019-11-29T03:53:13.672369+0000) 2019-11-29T03:53:17.113 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:53:17.107+0000 1694c700 -1 osd.5 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.731604+0000 front 2019-11-29T03:52:30.784988+0000 (oldest deadline 2019-11-29T03:53:16.005015+0000) 2019-11-29T03:53:17.242 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:53:17.237+0000 1694c700 -1 osd.1 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.556557+0000 front 2019-11-29T03:52:29.719455+0000 (oldest deadline 2019-11-29T03:53:14.196110+0000) 2019-11-29T03:53:17.284 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:53:17.278+0000 1694c700 -1 osd.6 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:31.677057+0000 front 2019-11-29T03:52:31.410367+0000 (oldest deadline 2019-11-29T03:53:16.685788+0000) 2019-11-29T03:53:17.663 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:53:17.657+0000 1694c700 -1 osd.7 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.696495+0000 front 2019-11-29T03:52:30.752286+0000 (oldest deadline 2019-11-29T03:53:16.566970+0000) 2019-11-29T03:53:17.690 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:53:17.686+0000 1694c700 -1 osd.0 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.986428+0000 front 2019-11-29T03:52:30.836770+0000 (oldest deadline 2019-11-29T03:53:15.505554+0000) 2019-11-29T03:53:17.755 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:53:17.750+0000 1694c700 -1 osd.4 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.555879+0000 front 2019-11-29T03:52:29.092838+0000 (oldest deadline 2019-11-29T03:53:13.672369+0000) 2019-11-29T03:53:18.146 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:53:18.141+0000 1694c700 -1 osd.5 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.731604+0000 front 2019-11-29T03:52:30.784988+0000 (oldest deadline 2019-11-29T03:53:16.005015+0000) 2019-11-29T03:53:18.217 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:53:18.212+0000 1694c700 -1 osd.1 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.556557+0000 front 2019-11-29T03:52:29.719455+0000 (oldest deadline 2019-11-29T03:53:14.196110+0000) 2019-11-29T03:53:18.282 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:53:18.276+0000 1694c700 -1 osd.6 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:31.677057+0000 front 2019-11-29T03:52:31.410367+0000 (oldest deadline 2019-11-29T03:53:16.685788+0000) 2019-11-29T03:53:18.692 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:53:18.687+0000 1694c700 -1 osd.7 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.696495+0000 front 2019-11-29T03:52:30.752286+0000 (oldest deadline 2019-11-29T03:53:16.566970+0000) 2019-11-29T03:53:18.737 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:53:18.734+0000 1694c700 -1 osd.0 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.986428+0000 front 2019-11-29T03:52:30.836770+0000 (oldest deadline 2019-11-29T03:53:15.505554+0000) 2019-11-29T03:53:18.785 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:53:18.780+0000 1694c700 -1 osd.4 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.555879+0000 front 2019-11-29T03:52:29.092838+0000 (oldest deadline 2019-11-29T03:53:13.672369+0000) 2019-11-29T03:53:19.169 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:53:19.164+0000 1694c700 -1 osd.5 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.731604+0000 front 2019-11-29T03:52:30.784988+0000 (oldest deadline 2019-11-29T03:53:16.005015+0000) 2019-11-29T03:53:19.207 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:53:19.203+0000 1694c700 -1 osd.1 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.556557+0000 front 2019-11-29T03:52:29.719455+0000 (oldest deadline 2019-11-29T03:53:14.196110+0000) 2019-11-29T03:53:19.329 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:53:19.324+0000 1694c700 -1 osd.6 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:31.677057+0000 front 2019-11-29T03:52:31.410367+0000 (oldest deadline 2019-11-29T03:53:16.685788+0000) 2019-11-29T03:53:19.698 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:53:19.692+0000 1694c700 -1 osd.7 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.696495+0000 front 2019-11-29T03:52:30.752286+0000 (oldest deadline 2019-11-29T03:53:16.566970+0000) 2019-11-29T03:53:19.776 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:53:19.774+0000 1694c700 -1 osd.0 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.986428+0000 front 2019-11-29T03:52:30.836770+0000 (oldest deadline 2019-11-29T03:53:15.505554+0000) 2019-11-29T03:53:19.787 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:53:19.781+0000 1694c700 -1 osd.4 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.555879+0000 front 2019-11-29T03:52:29.092838+0000 (oldest deadline 2019-11-29T03:53:13.672369+0000) 2019-11-29T03:53:20.198 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:53:20.192+0000 1694c700 -1 osd.5 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.731604+0000 front 2019-11-29T03:52:30.784988+0000 (oldest deadline 2019-11-29T03:53:16.005015+0000) 2019-11-29T03:53:20.218 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:53:20.217+0000 1694c700 -1 osd.1 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.556557+0000 front 2019-11-29T03:52:29.719455+0000 (oldest deadline 2019-11-29T03:53:14.196110+0000) 2019-11-29T03:53:20.339 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:53:20.333+0000 1694c700 -1 osd.6 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:31.677057+0000 front 2019-11-29T03:52:31.410367+0000 (oldest deadline 2019-11-29T03:53:16.685788+0000) 2019-11-29T03:53:20.680 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:53:20.674+0000 1694c700 -1 osd.7 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.696495+0000 front 2019-11-29T03:52:30.752286+0000 (oldest deadline 2019-11-29T03:53:16.566970+0000) 2019-11-29T03:53:20.740 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:53:20.738+0000 1694c700 -1 osd.0 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.986428+0000 front 2019-11-29T03:52:30.836770+0000 (oldest deadline 2019-11-29T03:53:15.505554+0000) 2019-11-29T03:53:20.830 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:53:20.824+0000 1694c700 -1 osd.4 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.555879+0000 front 2019-11-29T03:52:29.092838+0000 (oldest deadline 2019-11-29T03:53:13.672369+0000) 2019-11-29T03:53:21.205 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:53:21.203+0000 1694c700 -1 osd.1 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.556557+0000 front 2019-11-29T03:52:29.719455+0000 (oldest deadline 2019-11-29T03:53:14.196110+0000) 2019-11-29T03:53:21.256 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:53:21.242+0000 1694c700 -1 osd.5 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.731604+0000 front 2019-11-29T03:52:30.784988+0000 (oldest deadline 2019-11-29T03:53:16.005015+0000) 2019-11-29T03:53:21.388 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:53:21.381+0000 1694c700 -1 osd.6 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:31.677057+0000 front 2019-11-29T03:52:31.410367+0000 (oldest deadline 2019-11-29T03:53:16.685788+0000) 2019-11-29T03:53:21.656 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:53:21.650+0000 1694c700 -1 osd.7 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.696495+0000 front 2019-11-29T03:52:30.752286+0000 (oldest deadline 2019-11-29T03:53:16.566970+0000) 2019-11-29T03:53:21.731 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:53:21.727+0000 1694c700 -1 osd.0 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.986428+0000 front 2019-11-29T03:52:30.836770+0000 (oldest deadline 2019-11-29T03:53:15.505554+0000) 2019-11-29T03:53:21.797 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:53:21.790+0000 1694c700 -1 osd.4 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.555879+0000 front 2019-11-29T03:52:29.092838+0000 (oldest deadline 2019-11-29T03:53:13.672369+0000) 2019-11-29T03:53:22.225 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:53:22.222+0000 1694c700 -1 osd.1 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.556557+0000 front 2019-11-29T03:52:29.719455+0000 (oldest deadline 2019-11-29T03:53:14.196110+0000) 2019-11-29T03:53:22.254 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:53:22.247+0000 1694c700 -1 osd.5 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.731604+0000 front 2019-11-29T03:52:30.784988+0000 (oldest deadline 2019-11-29T03:53:16.005015+0000) 2019-11-29T03:53:22.421 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:53:22.414+0000 1694c700 -1 osd.6 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:31.677057+0000 front 2019-11-29T03:52:31.410367+0000 (oldest deadline 2019-11-29T03:53:16.685788+0000) 2019-11-29T03:53:22.651 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:53:22.645+0000 1694c700 -1 osd.7 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.696495+0000 front 2019-11-29T03:52:30.752286+0000 (oldest deadline 2019-11-29T03:53:16.566970+0000) 2019-11-29T03:53:22.778 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:53:22.775+0000 1694c700 -1 osd.0 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.986428+0000 front 2019-11-29T03:52:30.836770+0000 (oldest deadline 2019-11-29T03:53:15.505554+0000) 2019-11-29T03:53:22.826 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:53:22.820+0000 1694c700 -1 osd.4 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.555879+0000 front 2019-11-29T03:52:29.092838+0000 (oldest deadline 2019-11-29T03:53:13.672369+0000) 2019-11-29T03:53:23.276 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:53:23.272+0000 1694c700 -1 osd.1 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.556557+0000 front 2019-11-29T03:52:29.719455+0000 (oldest deadline 2019-11-29T03:53:14.196110+0000) 2019-11-29T03:53:23.288 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:53:23.282+0000 1694c700 -1 osd.5 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.731604+0000 front 2019-11-29T03:52:30.784988+0000 (oldest deadline 2019-11-29T03:53:16.005015+0000) 2019-11-29T03:53:23.451 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:53:23.449+0000 1694c700 -1 osd.2 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:32.790475+0000 front 2019-11-29T03:52:32.788454+0000 (oldest deadline 2019-11-29T03:53:22.563931+0000) 2019-11-29T03:53:23.466 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:53:23.460+0000 1694c700 -1 osd.6 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:31.677057+0000 front 2019-11-29T03:52:31.410367+0000 (oldest deadline 2019-11-29T03:53:16.685788+0000) 2019-11-29T03:53:23.641 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:53:23.635+0000 1694c700 -1 osd.7 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.696495+0000 front 2019-11-29T03:52:30.752286+0000 (oldest deadline 2019-11-29T03:53:16.566970+0000) 2019-11-29T03:53:23.796 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:53:23.790+0000 1694c700 -1 osd.4 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.555879+0000 front 2019-11-29T03:52:29.092838+0000 (oldest deadline 2019-11-29T03:53:13.672369+0000) 2019-11-29T03:53:23.799 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:53:23.797+0000 1694c700 -1 osd.0 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.986428+0000 front 2019-11-29T03:52:30.836770+0000 (oldest deadline 2019-11-29T03:53:15.505554+0000) 2019-11-29T03:53:24.241 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:53:24.238+0000 1694c700 -1 osd.1 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.556557+0000 front 2019-11-29T03:52:29.719455+0000 (oldest deadline 2019-11-29T03:53:14.196110+0000) 2019-11-29T03:53:24.292 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:53:24.286+0000 1694c700 -1 osd.5 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.731604+0000 front 2019-11-29T03:52:30.784988+0000 (oldest deadline 2019-11-29T03:53:16.005015+0000) 2019-11-29T03:53:24.451 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:53:24.449+0000 1694c700 -1 osd.2 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:32.790475+0000 front 2019-11-29T03:52:32.788454+0000 (oldest deadline 2019-11-29T03:53:22.563931+0000) 2019-11-29T03:53:24.505 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:53:24.499+0000 1694c700 -1 osd.6 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:31.677057+0000 front 2019-11-29T03:52:31.410367+0000 (oldest deadline 2019-11-29T03:53:16.685788+0000) 2019-11-29T03:53:24.648 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:53:24.640+0000 1694c700 -1 osd.7 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.696495+0000 front 2019-11-29T03:52:30.752286+0000 (oldest deadline 2019-11-29T03:53:16.566970+0000) 2019-11-29T03:53:24.780 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:53:24.773+0000 1694c700 -1 osd.4 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.555879+0000 front 2019-11-29T03:52:29.092838+0000 (oldest deadline 2019-11-29T03:53:13.672369+0000) 2019-11-29T03:53:24.788 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:53:24.786+0000 1694c700 -1 osd.0 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.986428+0000 front 2019-11-29T03:52:30.836770+0000 (oldest deadline 2019-11-29T03:53:15.505554+0000) 2019-11-29T03:53:25.246 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:53:25.243+0000 1694c700 -1 osd.1 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.556557+0000 front 2019-11-29T03:52:29.719455+0000 (oldest deadline 2019-11-29T03:53:14.196110+0000) 2019-11-29T03:53:25.276 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:53:25.271+0000 1694c700 -1 osd.5 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.731604+0000 front 2019-11-29T03:52:30.784988+0000 (oldest deadline 2019-11-29T03:53:16.005015+0000) 2019-11-29T03:53:25.463 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:53:25.460+0000 1694c700 -1 osd.2 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:32.790475+0000 front 2019-11-29T03:52:32.788454+0000 (oldest deadline 2019-11-29T03:53:22.563931+0000) 2019-11-29T03:53:25.487 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:53:25.482+0000 1694c700 -1 osd.6 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:31.677057+0000 front 2019-11-29T03:52:31.410367+0000 (oldest deadline 2019-11-29T03:53:16.685788+0000) 2019-11-29T03:53:25.605 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:53:25.599+0000 1694c700 -1 osd.7 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.696495+0000 front 2019-11-29T03:52:30.752286+0000 (oldest deadline 2019-11-29T03:53:16.566970+0000) 2019-11-29T03:53:25.764 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:53:25.758+0000 1694c700 -1 osd.4 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.555879+0000 front 2019-11-29T03:52:29.092838+0000 (oldest deadline 2019-11-29T03:53:13.672369+0000) 2019-11-29T03:53:25.831 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:53:25.828+0000 1694c700 -1 osd.0 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.986428+0000 front 2019-11-29T03:52:30.836770+0000 (oldest deadline 2019-11-29T03:53:15.505554+0000) 2019-11-29T03:53:26.238 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:53:26.236+0000 1694c700 -1 osd.1 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.556557+0000 front 2019-11-29T03:52:29.719455+0000 (oldest deadline 2019-11-29T03:53:14.196110+0000) 2019-11-29T03:53:26.265 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:53:26.260+0000 1694c700 -1 osd.5 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.731604+0000 front 2019-11-29T03:52:30.784988+0000 (oldest deadline 2019-11-29T03:53:16.005015+0000) 2019-11-29T03:53:26.456 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:53:26.451+0000 1694c700 -1 osd.2 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:32.790475+0000 front 2019-11-29T03:52:32.788454+0000 (oldest deadline 2019-11-29T03:53:22.563931+0000) 2019-11-29T03:53:26.485 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:53:26.480+0000 1694c700 -1 osd.6 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:31.677057+0000 front 2019-11-29T03:52:31.410367+0000 (oldest deadline 2019-11-29T03:53:16.685788+0000) 2019-11-29T03:53:26.619 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:53:26.614+0000 1694c700 -1 osd.7 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.696495+0000 front 2019-11-29T03:52:30.752286+0000 (oldest deadline 2019-11-29T03:53:16.566970+0000) 2019-11-29T03:53:26.730 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:53:26.725+0000 1694c700 -1 osd.4 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.555879+0000 front 2019-11-29T03:52:29.092838+0000 (oldest deadline 2019-11-29T03:53:13.672369+0000) 2019-11-29T03:53:26.786 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:53:26.783+0000 1694c700 -1 osd.0 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.986428+0000 front 2019-11-29T03:52:30.836770+0000 (oldest deadline 2019-11-29T03:53:15.505554+0000) 2019-11-29T03:53:27.228 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:53:27.225+0000 1694c700 -1 osd.1 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.556557+0000 front 2019-11-29T03:52:29.719455+0000 (oldest deadline 2019-11-29T03:53:14.196110+0000) 2019-11-29T03:53:27.319 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:53:27.313+0000 1694c700 -1 osd.5 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.731604+0000 front 2019-11-29T03:52:30.784988+0000 (oldest deadline 2019-11-29T03:53:16.005015+0000) 2019-11-29T03:53:27.412 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:53:27.408+0000 1694c700 -1 osd.2 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:32.790475+0000 front 2019-11-29T03:52:32.788454+0000 (oldest deadline 2019-11-29T03:53:22.563931+0000) 2019-11-29T03:53:27.445 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:53:27.439+0000 1694c700 -1 osd.6 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:31.677057+0000 front 2019-11-29T03:52:31.410367+0000 (oldest deadline 2019-11-29T03:53:16.685788+0000) 2019-11-29T03:53:27.663 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:53:27.658+0000 1694c700 -1 osd.7 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.696495+0000 front 2019-11-29T03:52:30.752286+0000 (oldest deadline 2019-11-29T03:53:16.566970+0000) 2019-11-29T03:53:27.710 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:53:27.704+0000 1694c700 -1 osd.4 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.555879+0000 front 2019-11-29T03:52:29.092838+0000 (oldest deadline 2019-11-29T03:53:13.672369+0000) 2019-11-29T03:53:27.814 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:53:27.811+0000 1694c700 -1 osd.0 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.986428+0000 front 2019-11-29T03:52:30.836770+0000 (oldest deadline 2019-11-29T03:53:15.505554+0000) 2019-11-29T03:53:28.272 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:53:28.269+0000 1694c700 -1 osd.1 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.556557+0000 front 2019-11-29T03:52:29.719455+0000 (oldest deadline 2019-11-29T03:53:14.196110+0000) 2019-11-29T03:53:28.273 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:53:28.268+0000 1694c700 -1 osd.5 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.731604+0000 front 2019-11-29T03:52:30.784988+0000 (oldest deadline 2019-11-29T03:53:16.005015+0000) 2019-11-29T03:53:28.447 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:53:28.442+0000 1694c700 -1 osd.6 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:31.677057+0000 front 2019-11-29T03:52:31.410367+0000 (oldest deadline 2019-11-29T03:53:16.685788+0000) 2019-11-29T03:53:28.458 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:53:28.456+0000 1694c700 -1 osd.2 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:32.790475+0000 front 2019-11-29T03:52:32.788454+0000 (oldest deadline 2019-11-29T03:53:22.563931+0000) 2019-11-29T03:53:28.638 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:53:28.632+0000 1694c700 -1 osd.7 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.696495+0000 front 2019-11-29T03:52:30.752286+0000 (oldest deadline 2019-11-29T03:53:16.566970+0000) 2019-11-29T03:53:28.667 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:53:28.661+0000 1694c700 -1 osd.4 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.555879+0000 front 2019-11-29T03:52:29.092838+0000 (oldest deadline 2019-11-29T03:53:13.672369+0000) 2019-11-29T03:53:28.861 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:53:28.859+0000 1694c700 -1 osd.0 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.986428+0000 front 2019-11-29T03:52:30.836770+0000 (oldest deadline 2019-11-29T03:53:15.505554+0000) 2019-11-29T03:53:29.324 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:53:29.318+0000 1694c700 -1 osd.5 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.731604+0000 front 2019-11-29T03:52:30.784988+0000 (oldest deadline 2019-11-29T03:53:16.005015+0000) 2019-11-29T03:53:29.324 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:53:29.313+0000 1694c700 -1 osd.1 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.556557+0000 front 2019-11-29T03:52:29.719455+0000 (oldest deadline 2019-11-29T03:53:14.196110+0000) 2019-11-29T03:53:29.414 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:53:29.412+0000 1694c700 -1 osd.2 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:32.790475+0000 front 2019-11-29T03:52:32.788454+0000 (oldest deadline 2019-11-29T03:53:22.563931+0000) 2019-11-29T03:53:29.425 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:53:29.419+0000 1694c700 -1 osd.6 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:31.677057+0000 front 2019-11-29T03:52:31.410367+0000 (oldest deadline 2019-11-29T03:53:16.685788+0000) 2019-11-29T03:53:29.623 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:53:29.618+0000 1694c700 -1 osd.7 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.696495+0000 front 2019-11-29T03:52:30.752286+0000 (oldest deadline 2019-11-29T03:53:16.566970+0000) 2019-11-29T03:53:29.700 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:53:29.694+0000 1694c700 -1 osd.4 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.555879+0000 front 2019-11-29T03:52:29.092838+0000 (oldest deadline 2019-11-29T03:53:13.672369+0000) 2019-11-29T03:53:29.864 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:53:29.862+0000 1694c700 -1 osd.0 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.986428+0000 front 2019-11-29T03:52:30.836770+0000 (oldest deadline 2019-11-29T03:53:15.505554+0000) 2019-11-29T03:53:30.302 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:53:30.296+0000 1694c700 -1 osd.5 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.731604+0000 front 2019-11-29T03:52:30.784988+0000 (oldest deadline 2019-11-29T03:53:16.005015+0000) 2019-11-29T03:53:30.319 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:53:30.318+0000 1694c700 -1 osd.1 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.556557+0000 front 2019-11-29T03:52:29.719455+0000 (oldest deadline 2019-11-29T03:53:14.196110+0000) 2019-11-29T03:53:30.385 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:53:30.384+0000 1694c700 -1 osd.2 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:32.790475+0000 front 2019-11-29T03:52:32.788454+0000 (oldest deadline 2019-11-29T03:53:22.563931+0000) 2019-11-29T03:53:30.471 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:53:30.465+0000 1694c700 -1 osd.6 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:31.677057+0000 front 2019-11-29T03:52:31.410367+0000 (oldest deadline 2019-11-29T03:53:16.685788+0000) 2019-11-29T03:53:30.617 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:53:30.611+0000 1694c700 -1 osd.7 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.696495+0000 front 2019-11-29T03:52:30.752286+0000 (oldest deadline 2019-11-29T03:53:16.566970+0000) 2019-11-29T03:53:30.667 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:53:30.660+0000 1694c700 -1 osd.4 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.555879+0000 front 2019-11-29T03:52:29.092838+0000 (oldest deadline 2019-11-29T03:53:13.672369+0000) 2019-11-29T03:53:30.838 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:53:30.837+0000 1694c700 -1 osd.0 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.986428+0000 front 2019-11-29T03:52:30.836770+0000 (oldest deadline 2019-11-29T03:53:15.505554+0000) 2019-11-29T03:53:31.257 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:53:31.251+0000 1694c700 -1 osd.5 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.731604+0000 front 2019-11-29T03:52:30.784988+0000 (oldest deadline 2019-11-29T03:53:16.005015+0000) 2019-11-29T03:53:31.345 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:53:31.342+0000 1694c700 -1 osd.1 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.556557+0000 front 2019-11-29T03:52:29.719455+0000 (oldest deadline 2019-11-29T03:53:14.196110+0000) 2019-11-29T03:53:31.431 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:53:31.427+0000 1694c700 -1 osd.2 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:32.790475+0000 front 2019-11-29T03:52:32.788454+0000 (oldest deadline 2019-11-29T03:53:22.563931+0000) 2019-11-29T03:53:31.445 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:53:31.439+0000 1694c700 -1 osd.6 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:31.677057+0000 front 2019-11-29T03:52:31.410367+0000 (oldest deadline 2019-11-29T03:53:16.685788+0000) 2019-11-29T03:53:31.635 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:53:31.629+0000 1694c700 -1 osd.4 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.555879+0000 front 2019-11-29T03:52:29.092838+0000 (oldest deadline 2019-11-29T03:53:13.672369+0000) 2019-11-29T03:53:31.649 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:53:31.643+0000 1694c700 -1 osd.7 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.696495+0000 front 2019-11-29T03:52:30.752286+0000 (oldest deadline 2019-11-29T03:53:16.566970+0000) 2019-11-29T03:53:31.864 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:53:31.862+0000 1694c700 -1 osd.0 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.986428+0000 front 2019-11-29T03:52:30.836770+0000 (oldest deadline 2019-11-29T03:53:15.505554+0000) 2019-11-29T03:53:32.259 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:53:32.253+0000 1694c700 -1 osd.5 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.731604+0000 front 2019-11-29T03:52:30.784988+0000 (oldest deadline 2019-11-29T03:53:16.005015+0000) 2019-11-29T03:53:32.372 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:53:32.370+0000 1694c700 -1 osd.1 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.556557+0000 front 2019-11-29T03:52:29.719455+0000 (oldest deadline 2019-11-29T03:53:14.196110+0000) 2019-11-29T03:53:32.439 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:53:32.436+0000 1694c700 -1 osd.2 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:32.790475+0000 front 2019-11-29T03:52:32.788454+0000 (oldest deadline 2019-11-29T03:53:22.563931+0000) 2019-11-29T03:53:32.457 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:53:32.451+0000 1694c700 -1 osd.6 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:31.677057+0000 front 2019-11-29T03:52:31.410367+0000 (oldest deadline 2019-11-29T03:53:16.685788+0000) 2019-11-29T03:53:32.590 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:53:32.585+0000 1694c700 -1 osd.4 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.555879+0000 front 2019-11-29T03:52:29.092838+0000 (oldest deadline 2019-11-29T03:53:13.672369+0000) 2019-11-29T03:53:32.656 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:53:32.650+0000 1694c700 -1 osd.7 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.696495+0000 front 2019-11-29T03:52:30.752286+0000 (oldest deadline 2019-11-29T03:53:16.566970+0000) 2019-11-29T03:53:32.900 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:53:32.895+0000 1694c700 -1 osd.0 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.986428+0000 front 2019-11-29T03:52:30.836770+0000 (oldest deadline 2019-11-29T03:53:15.505554+0000) 2019-11-29T03:53:33.235 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:53:33.229+0000 1694c700 -1 osd.5 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.731604+0000 front 2019-11-29T03:52:30.784988+0000 (oldest deadline 2019-11-29T03:53:16.005015+0000) 2019-11-29T03:53:33.342 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:53:33.339+0000 1694c700 -1 osd.1 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.556557+0000 front 2019-11-29T03:52:29.719455+0000 (oldest deadline 2019-11-29T03:53:14.196110+0000) 2019-11-29T03:53:33.431 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:53:33.428+0000 1694c700 -1 osd.2 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:32.790475+0000 front 2019-11-29T03:52:32.788454+0000 (oldest deadline 2019-11-29T03:53:22.563931+0000) 2019-11-29T03:53:33.447 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:53:33.442+0000 1694c700 -1 osd.6 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:31.677057+0000 front 2019-11-29T03:52:31.410367+0000 (oldest deadline 2019-11-29T03:53:16.685788+0000) 2019-11-29T03:53:33.597 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:53:33.591+0000 1694c700 -1 osd.4 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.555879+0000 front 2019-11-29T03:52:29.092838+0000 (oldest deadline 2019-11-29T03:53:13.672369+0000) 2019-11-29T03:53:33.633 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:53:33.628+0000 1694c700 -1 osd.7 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.696495+0000 front 2019-11-29T03:52:30.752286+0000 (oldest deadline 2019-11-29T03:53:16.566970+0000) 2019-11-29T03:53:33.873 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:53:33.870+0000 1694c700 -1 osd.0 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.986428+0000 front 2019-11-29T03:52:30.836770+0000 (oldest deadline 2019-11-29T03:53:15.505554+0000) 2019-11-29T03:53:34.239 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:53:34.233+0000 1694c700 -1 osd.5 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.731604+0000 front 2019-11-29T03:52:30.784988+0000 (oldest deadline 2019-11-29T03:53:16.005015+0000) 2019-11-29T03:53:34.301 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:53:34.298+0000 1694c700 -1 osd.1 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.556557+0000 front 2019-11-29T03:52:29.719455+0000 (oldest deadline 2019-11-29T03:53:14.196110+0000) 2019-11-29T03:53:34.415 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:53:34.407+0000 1694c700 -1 osd.6 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:31.677057+0000 front 2019-11-29T03:52:31.410367+0000 (oldest deadline 2019-11-29T03:53:16.685788+0000) 2019-11-29T03:53:34.455 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:53:34.451+0000 1694c700 -1 osd.2 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:32.790475+0000 front 2019-11-29T03:52:32.788454+0000 (oldest deadline 2019-11-29T03:53:22.563931+0000) 2019-11-29T03:53:34.607 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:53:34.601+0000 1694c700 -1 osd.4 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.555879+0000 front 2019-11-29T03:52:29.092838+0000 (oldest deadline 2019-11-29T03:53:13.672369+0000) 2019-11-29T03:53:34.686 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:53:34.680+0000 1694c700 -1 osd.7 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.696495+0000 front 2019-11-29T03:52:30.752286+0000 (oldest deadline 2019-11-29T03:53:16.566970+0000) 2019-11-29T03:53:34.896 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:53:34.892+0000 1694c700 -1 osd.0 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.986428+0000 front 2019-11-29T03:52:30.836770+0000 (oldest deadline 2019-11-29T03:53:15.505554+0000) 2019-11-29T03:53:35.194 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:53:35.188+0000 1694c700 -1 osd.5 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.731604+0000 front 2019-11-29T03:52:30.784988+0000 (oldest deadline 2019-11-29T03:53:16.005015+0000) 2019-11-29T03:53:35.348 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:53:35.345+0000 1694c700 -1 osd.1 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.556557+0000 front 2019-11-29T03:52:29.719455+0000 (oldest deadline 2019-11-29T03:53:14.196110+0000) 2019-11-29T03:53:35.413 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:53:35.409+0000 1694c700 -1 osd.6 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:31.677057+0000 front 2019-11-29T03:52:31.410367+0000 (oldest deadline 2019-11-29T03:53:16.685788+0000) 2019-11-29T03:53:35.414 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:53:35.411+0000 1694c700 -1 osd.2 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:32.790475+0000 front 2019-11-29T03:52:32.788454+0000 (oldest deadline 2019-11-29T03:53:22.563931+0000) 2019-11-29T03:53:35.585 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:53:35.579+0000 1694c700 -1 osd.4 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.555879+0000 front 2019-11-29T03:52:29.092838+0000 (oldest deadline 2019-11-29T03:53:13.672369+0000) 2019-11-29T03:53:35.727 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:53:35.722+0000 1694c700 -1 osd.7 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.696495+0000 front 2019-11-29T03:52:30.752286+0000 (oldest deadline 2019-11-29T03:53:16.566970+0000) 2019-11-29T03:53:35.905 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:53:35.901+0000 1694c700 -1 osd.0 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.986428+0000 front 2019-11-29T03:52:30.836770+0000 (oldest deadline 2019-11-29T03:53:15.505554+0000) 2019-11-29T03:53:36.184 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:53:36.180+0000 1694c700 -1 osd.5 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.731604+0000 front 2019-11-29T03:52:30.784988+0000 (oldest deadline 2019-11-29T03:53:16.005015+0000) 2019-11-29T03:53:36.308 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:53:36.305+0000 1694c700 -1 osd.1 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.556557+0000 front 2019-11-29T03:52:29.719455+0000 (oldest deadline 2019-11-29T03:53:14.196110+0000) 2019-11-29T03:53:36.414 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:53:36.411+0000 1694c700 -1 osd.2 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:32.790475+0000 front 2019-11-29T03:52:32.788454+0000 (oldest deadline 2019-11-29T03:53:22.563931+0000) 2019-11-29T03:53:36.445 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:53:36.439+0000 1694c700 -1 osd.6 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:31.677057+0000 front 2019-11-29T03:52:31.410367+0000 (oldest deadline 2019-11-29T03:53:16.685788+0000) 2019-11-29T03:53:36.628 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:53:36.622+0000 1694c700 -1 osd.4 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.555879+0000 front 2019-11-29T03:52:29.092838+0000 (oldest deadline 2019-11-29T03:53:13.672369+0000) 2019-11-29T03:53:36.721 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:53:36.715+0000 1694c700 -1 osd.7 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.696495+0000 front 2019-11-29T03:52:30.752286+0000 (oldest deadline 2019-11-29T03:53:16.566970+0000) 2019-11-29T03:53:36.957 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:53:36.954+0000 1694c700 -1 osd.0 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.986428+0000 front 2019-11-29T03:52:30.836770+0000 (oldest deadline 2019-11-29T03:53:15.505554+0000) 2019-11-29T03:53:37.184 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:53:37.178+0000 1694c700 -1 osd.5 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.731604+0000 front 2019-11-29T03:52:30.784988+0000 (oldest deadline 2019-11-29T03:53:16.005015+0000) 2019-11-29T03:53:37.315 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:53:37.311+0000 1694c700 -1 osd.1 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.556557+0000 front 2019-11-29T03:52:29.719455+0000 (oldest deadline 2019-11-29T03:53:14.196110+0000) 2019-11-29T03:53:37.406 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:53:37.403+0000 1694c700 -1 osd.2 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:32.790475+0000 front 2019-11-29T03:52:32.788454+0000 (oldest deadline 2019-11-29T03:53:22.563931+0000) 2019-11-29T03:53:37.450 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:53:37.445+0000 1694c700 -1 osd.6 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:31.677057+0000 front 2019-11-29T03:52:31.410367+0000 (oldest deadline 2019-11-29T03:53:16.685788+0000) 2019-11-29T03:53:37.612 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:53:37.600+0000 1694c700 -1 osd.4 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.555879+0000 front 2019-11-29T03:52:29.092838+0000 (oldest deadline 2019-11-29T03:53:13.672369+0000) 2019-11-29T03:53:37.732 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:53:37.728+0000 1694c700 -1 osd.7 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.696495+0000 front 2019-11-29T03:52:30.752286+0000 (oldest deadline 2019-11-29T03:53:16.566970+0000) 2019-11-29T03:53:37.939 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:53:37.936+0000 1694c700 -1 osd.0 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.986428+0000 front 2019-11-29T03:52:30.836770+0000 (oldest deadline 2019-11-29T03:53:15.505554+0000) 2019-11-29T03:53:38.232 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:53:38.226+0000 1694c700 -1 osd.5 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.731604+0000 front 2019-11-29T03:52:30.784988+0000 (oldest deadline 2019-11-29T03:53:16.005015+0000) 2019-11-29T03:53:38.355 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:53:38.351+0000 1694c700 -1 osd.1 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.556557+0000 front 2019-11-29T03:52:29.719455+0000 (oldest deadline 2019-11-29T03:53:14.196110+0000) 2019-11-29T03:53:38.419 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:53:38.413+0000 1694c700 -1 osd.6 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:31.677057+0000 front 2019-11-29T03:52:31.410367+0000 (oldest deadline 2019-11-29T03:53:16.685788+0000) 2019-11-29T03:53:38.421 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:53:38.417+0000 1694c700 -1 osd.2 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:32.790475+0000 front 2019-11-29T03:52:32.788454+0000 (oldest deadline 2019-11-29T03:53:22.563931+0000) 2019-11-29T03:53:38.623 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:53:38.617+0000 1694c700 -1 osd.4 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.555879+0000 front 2019-11-29T03:52:29.092838+0000 (oldest deadline 2019-11-29T03:53:13.672369+0000) 2019-11-29T03:53:38.756 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:53:38.751+0000 1694c700 -1 osd.7 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.696495+0000 front 2019-11-29T03:52:30.752286+0000 (oldest deadline 2019-11-29T03:53:16.566970+0000) 2019-11-29T03:53:38.939 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:53:38.935+0000 1694c700 -1 osd.0 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.986428+0000 front 2019-11-29T03:52:30.836770+0000 (oldest deadline 2019-11-29T03:53:15.505554+0000) 2019-11-29T03:53:39.253 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:53:39.248+0000 1694c700 -1 osd.5 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.731604+0000 front 2019-11-29T03:52:30.784988+0000 (oldest deadline 2019-11-29T03:53:16.005015+0000) 2019-11-29T03:53:39.370 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:53:39.365+0000 1694c700 -1 osd.1 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.556557+0000 front 2019-11-29T03:52:29.719455+0000 (oldest deadline 2019-11-29T03:53:14.196110+0000) 2019-11-29T03:53:39.400 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:53:39.394+0000 1694c700 -1 osd.6 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:31.677057+0000 front 2019-11-29T03:52:31.410367+0000 (oldest deadline 2019-11-29T03:53:16.685788+0000) 2019-11-29T03:53:39.402 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:53:39.398+0000 1694c700 -1 osd.2 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:32.790475+0000 front 2019-11-29T03:52:32.788454+0000 (oldest deadline 2019-11-29T03:53:22.563931+0000) 2019-11-29T03:53:39.602 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:53:39.597+0000 1694c700 -1 osd.4 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.555879+0000 front 2019-11-29T03:52:29.092838+0000 (oldest deadline 2019-11-29T03:53:13.672369+0000) 2019-11-29T03:53:39.808 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:53:39.802+0000 1694c700 -1 osd.7 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.696495+0000 front 2019-11-29T03:52:30.752286+0000 (oldest deadline 2019-11-29T03:53:16.566970+0000) 2019-11-29T03:53:39.900 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:53:39.896+0000 1694c700 -1 osd.0 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.986428+0000 front 2019-11-29T03:52:30.836770+0000 (oldest deadline 2019-11-29T03:53:15.505554+0000) 2019-11-29T03:53:40.305 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:53:40.299+0000 1694c700 -1 osd.5 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.731604+0000 front 2019-11-29T03:52:30.784988+0000 (oldest deadline 2019-11-29T03:53:16.005015+0000) 2019-11-29T03:53:40.384 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:53:40.381+0000 1694c700 -1 osd.2 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:32.790475+0000 front 2019-11-29T03:52:32.788454+0000 (oldest deadline 2019-11-29T03:53:22.563931+0000) 2019-11-29T03:53:40.399 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:53:40.395+0000 1694c700 -1 osd.1 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.556557+0000 front 2019-11-29T03:52:29.719455+0000 (oldest deadline 2019-11-29T03:53:14.196110+0000) 2019-11-29T03:53:40.455 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:53:40.445+0000 1694c700 -1 osd.6 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:31.677057+0000 front 2019-11-29T03:52:31.410367+0000 (oldest deadline 2019-11-29T03:53:16.685788+0000) 2019-11-29T03:53:40.641 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:53:40.635+0000 1694c700 -1 osd.4 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.555879+0000 front 2019-11-29T03:52:29.092838+0000 (oldest deadline 2019-11-29T03:53:13.672369+0000) 2019-11-29T03:53:40.798 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:53:40.793+0000 1694c700 -1 osd.7 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.696495+0000 front 2019-11-29T03:52:30.752286+0000 (oldest deadline 2019-11-29T03:53:16.566970+0000) 2019-11-29T03:53:40.916 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:53:40.911+0000 1694c700 -1 osd.0 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.986428+0000 front 2019-11-29T03:52:30.836770+0000 (oldest deadline 2019-11-29T03:53:15.505554+0000) 2019-11-29T03:53:41.278 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:53:41.273+0000 1694c700 -1 osd.5 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.731604+0000 front 2019-11-29T03:52:30.784988+0000 (oldest deadline 2019-11-29T03:53:16.005015+0000) 2019-11-29T03:53:41.367 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:53:41.364+0000 1694c700 -1 osd.1 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.556557+0000 front 2019-11-29T03:52:29.719455+0000 (oldest deadline 2019-11-29T03:53:14.196110+0000) 2019-11-29T03:53:41.398 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:53:41.394+0000 1694c700 -1 osd.2 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:32.790475+0000 front 2019-11-29T03:52:32.788454+0000 (oldest deadline 2019-11-29T03:53:22.563931+0000) 2019-11-29T03:53:41.431 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:53:41.424+0000 1694c700 -1 osd.6 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:31.677057+0000 front 2019-11-29T03:52:31.410367+0000 (oldest deadline 2019-11-29T03:53:16.685788+0000) 2019-11-29T03:53:41.671 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:53:41.666+0000 1694c700 -1 osd.4 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.555879+0000 front 2019-11-29T03:52:29.092838+0000 (oldest deadline 2019-11-29T03:53:13.672369+0000) 2019-11-29T03:53:41.800 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:53:41.793+0000 1694c700 -1 osd.7 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.696495+0000 front 2019-11-29T03:52:30.752286+0000 (oldest deadline 2019-11-29T03:53:16.566970+0000) 2019-11-29T03:53:41.925 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:53:41.923+0000 1694c700 -1 osd.0 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.986428+0000 front 2019-11-29T03:52:30.836770+0000 (oldest deadline 2019-11-29T03:53:15.505554+0000) 2019-11-29T03:53:42.266 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:53:42.261+0000 1694c700 -1 osd.5 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.731604+0000 front 2019-11-29T03:52:30.784988+0000 (oldest deadline 2019-11-29T03:53:16.005015+0000) 2019-11-29T03:53:42.368 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:53:42.365+0000 1694c700 -1 osd.2 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:32.790475+0000 front 2019-11-29T03:52:32.788454+0000 (oldest deadline 2019-11-29T03:53:22.563931+0000) 2019-11-29T03:53:42.373 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:53:42.370+0000 1694c700 -1 osd.1 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.556557+0000 front 2019-11-29T03:52:29.719455+0000 (oldest deadline 2019-11-29T03:53:14.196110+0000) 2019-11-29T03:53:42.463 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:53:42.457+0000 1694c700 -1 osd.6 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:31.677057+0000 front 2019-11-29T03:52:31.410367+0000 (oldest deadline 2019-11-29T03:53:16.685788+0000) 2019-11-29T03:53:42.687 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:53:42.682+0000 1694c700 -1 osd.4 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.555879+0000 front 2019-11-29T03:52:29.092838+0000 (oldest deadline 2019-11-29T03:53:13.672369+0000) 2019-11-29T03:53:42.829 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:53:42.824+0000 1694c700 -1 osd.7 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.696495+0000 front 2019-11-29T03:52:30.752286+0000 (oldest deadline 2019-11-29T03:53:16.566970+0000) 2019-11-29T03:53:42.895 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:53:42.891+0000 1694c700 -1 osd.0 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.986428+0000 front 2019-11-29T03:52:30.836770+0000 (oldest deadline 2019-11-29T03:53:15.505554+0000) 2019-11-29T03:53:43.251 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:53:43.246+0000 1694c700 -1 osd.5 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.731604+0000 front 2019-11-29T03:52:30.784988+0000 (oldest deadline 2019-11-29T03:53:16.005015+0000) 2019-11-29T03:53:43.335 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:53:43.330+0000 1694c700 -1 osd.1 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.556557+0000 front 2019-11-29T03:52:29.719455+0000 (oldest deadline 2019-11-29T03:53:14.196110+0000) 2019-11-29T03:53:43.369 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:53:43.365+0000 1694c700 -1 osd.2 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:32.790475+0000 front 2019-11-29T03:52:32.788454+0000 (oldest deadline 2019-11-29T03:53:22.563931+0000) 2019-11-29T03:53:43.433 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:53:43.428+0000 1694c700 -1 osd.6 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:31.677057+0000 front 2019-11-29T03:52:31.410367+0000 (oldest deadline 2019-11-29T03:53:16.685788+0000) 2019-11-29T03:53:43.665 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:53:43.660+0000 1694c700 -1 osd.4 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.555879+0000 front 2019-11-29T03:52:29.092838+0000 (oldest deadline 2019-11-29T03:53:13.672369+0000) 2019-11-29T03:53:43.799 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:53:43.794+0000 1694c700 -1 osd.7 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.696495+0000 front 2019-11-29T03:52:30.752286+0000 (oldest deadline 2019-11-29T03:53:16.566970+0000) 2019-11-29T03:53:43.944 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:53:43.940+0000 1694c700 -1 osd.0 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.986428+0000 front 2019-11-29T03:52:30.836770+0000 (oldest deadline 2019-11-29T03:53:15.505554+0000) 2019-11-29T03:53:44.212 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:53:44.208+0000 1694c700 -1 osd.5 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.731604+0000 front 2019-11-29T03:52:30.784988+0000 (oldest deadline 2019-11-29T03:53:16.005015+0000) 2019-11-29T03:53:44.337 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:53:44.333+0000 1694c700 -1 osd.1 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.556557+0000 front 2019-11-29T03:52:29.719455+0000 (oldest deadline 2019-11-29T03:53:14.196110+0000) 2019-11-29T03:53:44.388 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:53:44.385+0000 1694c700 -1 osd.2 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:32.790475+0000 front 2019-11-29T03:52:32.788454+0000 (oldest deadline 2019-11-29T03:53:22.563931+0000) 2019-11-29T03:53:44.460 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:53:44.454+0000 1694c700 -1 osd.6 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:31.677057+0000 front 2019-11-29T03:52:31.410367+0000 (oldest deadline 2019-11-29T03:53:16.685788+0000) 2019-11-29T03:53:44.669 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:53:44.663+0000 1694c700 -1 osd.4 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.555879+0000 front 2019-11-29T03:52:29.092838+0000 (oldest deadline 2019-11-29T03:53:13.672369+0000) 2019-11-29T03:53:44.795 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:53:44.790+0000 1694c700 -1 osd.7 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.696495+0000 front 2019-11-29T03:52:30.752286+0000 (oldest deadline 2019-11-29T03:53:16.566970+0000) 2019-11-29T03:53:44.931 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:53:44.927+0000 1694c700 -1 osd.0 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.986428+0000 front 2019-11-29T03:52:30.836770+0000 (oldest deadline 2019-11-29T03:53:15.505554+0000) 2019-11-29T03:53:45.254 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:53:45.248+0000 1694c700 -1 osd.5 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.731604+0000 front 2019-11-29T03:52:30.784988+0000 (oldest deadline 2019-11-29T03:53:16.005015+0000) 2019-11-29T03:53:45.327 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:53:45.324+0000 1694c700 -1 osd.1 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.556557+0000 front 2019-11-29T03:52:29.719455+0000 (oldest deadline 2019-11-29T03:53:14.196110+0000) 2019-11-29T03:53:45.395 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:53:45.392+0000 1694c700 -1 osd.2 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:32.790475+0000 front 2019-11-29T03:52:32.788454+0000 (oldest deadline 2019-11-29T03:53:22.563931+0000) 2019-11-29T03:53:45.420 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:53:45.415+0000 1694c700 -1 osd.6 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:31.677057+0000 front 2019-11-29T03:52:31.410367+0000 (oldest deadline 2019-11-29T03:53:16.685788+0000) 2019-11-29T03:53:45.656 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:53:45.651+0000 1694c700 -1 osd.4 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.555879+0000 front 2019-11-29T03:52:29.092838+0000 (oldest deadline 2019-11-29T03:53:13.672369+0000) 2019-11-29T03:53:45.791 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:53:45.785+0000 1694c700 -1 osd.7 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.696495+0000 front 2019-11-29T03:52:30.752286+0000 (oldest deadline 2019-11-29T03:53:16.566970+0000) 2019-11-29T03:53:45.949 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:53:45.944+0000 1694c700 -1 osd.0 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.986428+0000 front 2019-11-29T03:52:30.836770+0000 (oldest deadline 2019-11-29T03:53:15.505554+0000) 2019-11-29T03:53:46.227 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:53:46.221+0000 1694c700 -1 osd.5 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.731604+0000 front 2019-11-29T03:52:30.784988+0000 (oldest deadline 2019-11-29T03:53:16.005015+0000) 2019-11-29T03:53:46.286 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:53:46.282+0000 1694c700 -1 osd.1 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.556557+0000 front 2019-11-29T03:52:29.719455+0000 (oldest deadline 2019-11-29T03:53:14.196110+0000) 2019-11-29T03:53:46.394 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:53:46.390+0000 1694c700 -1 osd.2 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:32.790475+0000 front 2019-11-29T03:52:32.788454+0000 (oldest deadline 2019-11-29T03:53:22.563931+0000) 2019-11-29T03:53:46.460 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:53:46.455+0000 1694c700 -1 osd.6 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:31.677057+0000 front 2019-11-29T03:52:31.410367+0000 (oldest deadline 2019-11-29T03:53:16.685788+0000) 2019-11-29T03:53:46.689 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:53:46.683+0000 1694c700 -1 osd.4 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.555879+0000 front 2019-11-29T03:52:29.092838+0000 (oldest deadline 2019-11-29T03:53:13.672369+0000) 2019-11-29T03:53:46.791 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:53:46.785+0000 1694c700 -1 osd.7 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.696495+0000 front 2019-11-29T03:52:30.752286+0000 (oldest deadline 2019-11-29T03:53:16.566970+0000) 2019-11-29T03:53:46.930 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:53:46.926+0000 1694c700 -1 osd.0 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.986428+0000 front 2019-11-29T03:52:30.836770+0000 (oldest deadline 2019-11-29T03:53:15.505554+0000) 2019-11-29T03:53:47.185 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:53:47.179+0000 1694c700 -1 osd.5 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.731604+0000 front 2019-11-29T03:52:30.784988+0000 (oldest deadline 2019-11-29T03:53:16.005015+0000) 2019-11-29T03:53:47.316 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:53:47.312+0000 1694c700 -1 osd.1 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.556557+0000 front 2019-11-29T03:52:29.719455+0000 (oldest deadline 2019-11-29T03:53:14.196110+0000) 2019-11-29T03:53:47.400 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:53:47.397+0000 1694c700 -1 osd.2 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:32.790475+0000 front 2019-11-29T03:52:32.788454+0000 (oldest deadline 2019-11-29T03:53:22.563931+0000) 2019-11-29T03:53:47.465 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:53:47.460+0000 1694c700 -1 osd.6 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:31.677057+0000 front 2019-11-29T03:52:31.410367+0000 (oldest deadline 2019-11-29T03:53:16.685788+0000) 2019-11-29T03:53:47.702 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:53:47.697+0000 1694c700 -1 osd.4 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:29.555879+0000 front 2019-11-29T03:52:29.092838+0000 (oldest deadline 2019-11-29T03:53:13.672369+0000) 2019-11-29T03:53:47.836 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:53:47.830+0000 1694c700 -1 osd.7 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.696495+0000 front 2019-11-29T03:52:30.752286+0000 (oldest deadline 2019-11-29T03:53:16.566970+0000) 2019-11-29T03:53:47.968 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:53:47.964+0000 1694c700 -1 osd.0 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.986428+0000 front 2019-11-29T03:52:30.836770+0000 (oldest deadline 2019-11-29T03:53:15.505554+0000) 2019-11-29T03:53:48.039 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:53:48.033+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.74:6802/10096,v1:172.21.15.74:6803/10096] for 44sec e333 v333) 2019-11-29T03:53:48.171 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:53:48.166+0000 1694c700 -1 osd.5 333 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:52:30.731604+0000 front 2019-11-29T03:52:30.784988+0000 (oldest deadline 2019-11-29T03:53:16.005015+0000) 2019-11-29T03:54:19.971 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:54:19.966+0000 124ad700 -1 osd.0 337 build_incremental_map_msg missing incremental map 337 2019-11-29T03:54:20.009 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:54:19.989+0000 31f84700 -1 osd.0 337 build_incremental_map_msg missing incremental map 337 2019-11-29T03:54:20.234 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:54:20.195+0000 34789700 -1 osd.0 337 build_incremental_map_msg missing incremental map 337 2019-11-29T03:54:20.239 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:54:20.226+0000 34789700 -1 osd.0 337 build_incremental_map_msg missing incremental map 337 2019-11-29T03:54:20.502 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:54:20.487+0000 37f90700 -1 osd.5 337 build_incremental_map_msg missing incremental map 337 2019-11-29T03:54:22.064 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:54:22.053+0000 33787700 -1 osd.0 338 build_incremental_map_msg missing incremental map 337 2019-11-29T03:54:43.384 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:54:43.378+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:54:44.205 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:54:44.199+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:54:44.338 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:54:44.334+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:54:45.161 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:54:45.156+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:54:45.312 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:54:45.305+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:54:45.786 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:54:45.783+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:54:46.141 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:54:46.136+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:54:46.270 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:54:46.264+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:54:46.791 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:54:46.787+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:54:46.883 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:54:46.879+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:54:47.138 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:54:47.131+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:54:47.218 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:54:47.213+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:54:47.289 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:54:47.284+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:54:47.825 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:54:47.820+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:54:47.924 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:54:47.921+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:54:48.166 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:54:48.162+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:54:48.231 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:54:48.226+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:54:48.299 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:54:48.295+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:54:48.782 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:54:48.778+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:54:48.902 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:54:48.899+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:54:49.195 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:54:49.190+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:54:49.274 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:54:49.270+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:54:49.350 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:54:49.345+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:54:49.763 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:54:49.759+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:54:49.873 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:54:49.869+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:54:50.206 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:54:50.201+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:54:50.263 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:54:50.258+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:54:50.399 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:54:50.394+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:54:50.803 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:54:50.801+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:54:50.833 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:54:50.829+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:54:51.210 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:54:51.204+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:54:51.251 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:54:51.245+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:54:51.443 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:54:51.438+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:54:51.800 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:54:51.797+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:54:51.837 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:54:51.834+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:54:52.223 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:54:52.217+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:54:52.280 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:54:52.275+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:54:52.286 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:54:52.284+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:54:52.419 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:54:52.414+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:54:52.847 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:54:52.844+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:54:52.850 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:54:52.848+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:54:53.241 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:54:53.236+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:54:53.267 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:54:53.262+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:54:53.329 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:54:53.327+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:54:53.438 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:54:53.433+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:54:53.820 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:54:53.817+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:54:53.893 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:54:53.890+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:54:54.269 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:54:54.264+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:54:54.283 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:54:54.277+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:54:54.332 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:54:54.331+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:54:54.394 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:54:54.387+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:54:54.823 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:54:54.820+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:54:54.859 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:54:54.857+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:54:55.245 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:54:55.239+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:54:55.270 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:54:55.264+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:54:55.310 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:54:55.308+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:54:55.390 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:54:55.384+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:54:55.788 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:54:55.785+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:54:55.833 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:54:55.831+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:54:55.924 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:54:55.922+0000 1694c700 -1 osd.1 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589794+0000 front 2019-11-29T03:54:02.223481+0000 (oldest deadline 2019-11-29T03:54:55.415371+0000) 2019-11-29T03:54:56.213 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:54:56.208+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:54:56.238 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:54:56.233+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:54:56.339 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:54:56.337+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:54:56.372 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:54:56.365+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:54:56.767 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:54:56.764+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:54:56.821 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:54:56.819+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:54:56.912 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:54:56.910+0000 1694c700 -1 osd.1 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589794+0000 front 2019-11-29T03:54:02.223481+0000 (oldest deadline 2019-11-29T03:54:55.415371+0000) 2019-11-29T03:54:57.206 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:54:57.201+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:54:57.274 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:54:57.269+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:54:57.369 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:54:57.364+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:54:57.374 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:54:57.373+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:54:57.759 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:54:57.755+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:54:57.862 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:54:57.860+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:54:57.957 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:54:57.954+0000 1694c700 -1 osd.1 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589794+0000 front 2019-11-29T03:54:02.223481+0000 (oldest deadline 2019-11-29T03:54:55.415371+0000) 2019-11-29T03:54:58.174 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:54:58.169+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:54:58.251 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:54:58.244+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:54:58.336 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:54:58.335+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:54:58.373 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:54:58.369+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:54:58.742 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:54:58.739+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:54:58.839 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:54:58.836+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:54:58.937 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:54:58.934+0000 1694c700 -1 osd.1 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589794+0000 front 2019-11-29T03:54:02.223481+0000 (oldest deadline 2019-11-29T03:54:55.415371+0000) 2019-11-29T03:54:59.167 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:54:59.161+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:54:59.303 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:54:59.298+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:54:59.372 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:54:59.367+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:54:59.384 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:54:59.379+0000 1694c700 -1 osd.3 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:54:18.475919+0000 (oldest deadline 2019-11-29T03:54:58.475919+0000) 2019-11-29T03:54:59.389 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:54:59.386+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:54:59.789 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:54:59.787+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:54:59.836 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:54:59.834+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:54:59.956 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:54:59.955+0000 1694c700 -1 osd.1 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589794+0000 front 2019-11-29T03:54:02.223481+0000 (oldest deadline 2019-11-29T03:54:55.415371+0000) 2019-11-29T03:55:00.135 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:55:00.130+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:55:00.313 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:55:00.308+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:55:00.365 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:00.360+0000 1694c700 -1 osd.3 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:54:18.475919+0000 (oldest deadline 2019-11-29T03:54:58.475919+0000) 2019-11-29T03:55:00.366 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:00.364+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:55:00.393 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:55:00.388+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:55:00.787 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:55:00.784+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:55:00.822 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:55:00.820+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:55:00.954 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:55:00.951+0000 1694c700 -1 osd.1 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589794+0000 front 2019-11-29T03:54:02.223481+0000 (oldest deadline 2019-11-29T03:54:55.415371+0000) 2019-11-29T03:55:01.178 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:55:01.173+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:55:01.284 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:55:01.279+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:55:01.351 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:55:01.346+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:55:01.398 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:01.396+0000 1694c700 -1 osd.3 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:54:18.475919+0000 (oldest deadline 2019-11-29T03:54:58.475919+0000) 2019-11-29T03:55:01.401 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:01.400+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:55:01.743 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:55:01.740+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:55:01.848 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:55:01.845+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:55:01.960 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:55:01.957+0000 1694c700 -1 osd.1 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589794+0000 front 2019-11-29T03:54:02.223481+0000 (oldest deadline 2019-11-29T03:54:55.415371+0000) 2019-11-29T03:55:02.176 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:55:02.171+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:55:02.248 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:55:02.243+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:55:02.385 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:55:02.379+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:55:02.386 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:02.382+0000 1694c700 -1 osd.3 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:54:18.475919+0000 (oldest deadline 2019-11-29T03:54:58.475919+0000) 2019-11-29T03:55:02.386 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:02.385+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:55:02.785 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:55:02.782+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:55:02.893 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:55:02.891+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:55:02.959 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:55:02.956+0000 1694c700 -1 osd.1 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589794+0000 front 2019-11-29T03:54:02.223481+0000 (oldest deadline 2019-11-29T03:54:55.415371+0000) 2019-11-29T03:55:03.144 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:55:03.139+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:55:03.253 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:55:03.248+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:55:03.348 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:55:03.344+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:55:03.429 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:03.425+0000 1694c700 -1 osd.3 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:54:18.475919+0000 (oldest deadline 2019-11-29T03:54:58.475919+0000) 2019-11-29T03:55:03.429 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:03.427+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:55:03.817 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:55:03.814+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:55:03.919 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:55:03.916+0000 1694c700 -1 osd.1 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589794+0000 front 2019-11-29T03:54:02.223481+0000 (oldest deadline 2019-11-29T03:54:55.415371+0000) 2019-11-29T03:55:03.927 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:55:03.924+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:55:04.111 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:55:04.107+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:55:04.270 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:55:04.265+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:55:04.370 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:55:04.365+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:55:04.403 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:04.400+0000 1694c700 -1 osd.3 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:54:18.475919+0000 (oldest deadline 2019-11-29T03:54:58.475919+0000) 2019-11-29T03:55:04.404 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:04.401+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:55:04.839 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:55:04.836+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:55:04.912 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:55:04.908+0000 1694c700 -1 osd.1 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589794+0000 front 2019-11-29T03:54:02.223481+0000 (oldest deadline 2019-11-29T03:54:55.415371+0000) 2019-11-29T03:55:04.924 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:55:04.921+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:55:05.165 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:55:05.161+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:55:05.251 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:55:05.245+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:55:05.408 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:05.405+0000 1694c700 -1 osd.3 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:54:18.475919+0000 (oldest deadline 2019-11-29T03:54:58.475919+0000) 2019-11-29T03:55:05.412 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:05.406+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:55:05.414 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:55:05.406+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:55:05.827 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:55:05.823+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:55:05.930 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:55:05.926+0000 1694c700 -1 osd.1 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589794+0000 front 2019-11-29T03:54:02.223481+0000 (oldest deadline 2019-11-29T03:54:55.415371+0000) 2019-11-29T03:55:05.947 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:55:05.944+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:55:06.207 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:55:06.202+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:55:06.305 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:55:06.300+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:55:06.410 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:55:06.404+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:55:06.461 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:06.456+0000 1694c700 -1 osd.3 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:54:18.475919+0000 (oldest deadline 2019-11-29T03:54:58.475919+0000) 2019-11-29T03:55:06.462 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:06.458+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:55:06.804 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:55:06.800+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:55:06.928 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:55:06.925+0000 1694c700 -1 osd.1 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589794+0000 front 2019-11-29T03:54:02.223481+0000 (oldest deadline 2019-11-29T03:54:55.415371+0000) 2019-11-29T03:55:06.988 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:55:06.984+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:55:07.201 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:55:07.196+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:55:07.319 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:55:07.313+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:55:07.440 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:07.435+0000 1694c700 -1 osd.3 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:54:18.475919+0000 (oldest deadline 2019-11-29T03:54:58.475919+0000) 2019-11-29T03:55:07.440 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:07.437+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:55:07.442 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:55:07.436+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:55:07.855 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:55:07.853+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:55:07.969 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:55:07.965+0000 1694c700 -1 osd.1 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589794+0000 front 2019-11-29T03:54:02.223481+0000 (oldest deadline 2019-11-29T03:54:55.415371+0000) 2019-11-29T03:55:07.988 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:55:07.986+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:55:08.235 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:55:08.230+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:55:08.358 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:55:08.353+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:55:08.394 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:06:08:50.612 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:55:08.451 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:06:08:50.669 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:55:08.465 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:06:08:50.685 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:55:08.468 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:06:08:50.696 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:55:08.471 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:08.469+0000 1694c700 -1 osd.3 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:54:18.475919+0000 (oldest deadline 2019-11-29T03:54:58.475919+0000) 2019-11-29T03:55:08.473 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:08.471+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:55:08.476 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:06:08:50.705 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:55:08.478 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:06:08:50.698 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:55:08.503 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:55:08.491+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:55:08.658 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:06:08:50.877 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:55:08.696 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:06:08:50.914 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:55:08.719 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:06:08:50.948 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:55:08.865 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:55:08.843+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:55:08.943 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:55:08.940+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:55:09.011 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:55:09.009+0000 1694c700 -1 osd.1 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589794+0000 front 2019-11-29T03:54:02.223481+0000 (oldest deadline 2019-11-29T03:54:55.415371+0000) 2019-11-29T03:55:09.192 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:55:09.187+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:55:09.321 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:55:09.317+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:55:09.477 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:09.473+0000 1694c700 -1 osd.3 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:54:18.475919+0000 (oldest deadline 2019-11-29T03:54:58.475919+0000) 2019-11-29T03:55:09.477 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:09.474+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:55:09.527 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:55:09.522+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:55:09.883 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:55:09.879+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:55:09.990 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:55:09.986+0000 1694c700 -1 osd.1 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589794+0000 front 2019-11-29T03:54:02.223481+0000 (oldest deadline 2019-11-29T03:54:55.415371+0000) 2019-11-29T03:55:09.996 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:55:09.993+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:55:10.170 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:55:10.166+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:55:10.338 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:55:10.334+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:55:10.440 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:10.436+0000 1694c700 -1 osd.3 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:54:18.475919+0000 (oldest deadline 2019-11-29T03:54:58.475919+0000) 2019-11-29T03:55:10.442 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:10.439+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:55:10.564 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:55:10.558+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:55:10.884 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:55:10.880+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:55:11.011 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:55:11.007+0000 1694c700 -1 osd.1 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589794+0000 front 2019-11-29T03:54:02.223481+0000 (oldest deadline 2019-11-29T03:54:55.415371+0000) 2019-11-29T03:55:11.019 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:55:11.014+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:55:11.168 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:55:11.163+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:55:11.353 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:55:11.348+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:55:11.446 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:11.443+0000 1694c700 -1 osd.3 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:54:18.475919+0000 (oldest deadline 2019-11-29T03:54:58.475919+0000) 2019-11-29T03:55:11.449 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:11.446+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:55:11.527 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:55:11.522+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:55:11.866 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:55:11.862+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:55:11.999 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:55:11.997+0000 1694c700 -1 osd.1 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589794+0000 front 2019-11-29T03:54:02.223481+0000 (oldest deadline 2019-11-29T03:54:55.415371+0000) 2019-11-29T03:55:12.045 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:55:12.043+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:55:12.221 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:55:12.216+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:55:12.406 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:55:12.400+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:55:12.408 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:12.403+0000 1694c700 -1 osd.3 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:54:18.475919+0000 (oldest deadline 2019-11-29T03:54:58.475919+0000) 2019-11-29T03:55:12.409 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:12.404+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:55:12.519 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:55:12.513+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:55:12.894 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:55:12.891+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:55:13.037 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:55:13.034+0000 1694c700 -1 osd.1 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589794+0000 front 2019-11-29T03:54:02.223481+0000 (oldest deadline 2019-11-29T03:54:55.415371+0000) 2019-11-29T03:55:13.089 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:55:13.086+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:55:13.223 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:55:13.218+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:55:13.362 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:55:13.357+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:55:13.462 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:13.456+0000 1694c700 -1 osd.3 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:54:18.475919+0000 (oldest deadline 2019-11-29T03:54:58.475919+0000) 2019-11-29T03:55:13.463 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:13.459+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:55:13.484 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:55:13.479+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:55:13.917 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:55:13.914+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:55:13.995 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:55:13.988+0000 1694c700 -1 osd.1 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589794+0000 front 2019-11-29T03:54:02.223481+0000 (oldest deadline 2019-11-29T03:54:55.415371+0000) 2019-11-29T03:55:14.110 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:55:14.106+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:55:14.190 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:55:14.186+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:55:14.371 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:55:14.366+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:55:14.484 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:55:14.479+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:55:14.504 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:14.501+0000 1694c700 -1 osd.3 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:54:18.475919+0000 (oldest deadline 2019-11-29T03:54:58.475919+0000) 2019-11-29T03:55:14.507 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:14.505+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:55:14.970 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:55:14.965+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:55:15.023 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:55:15.019+0000 1694c700 -1 osd.1 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589794+0000 front 2019-11-29T03:54:02.223481+0000 (oldest deadline 2019-11-29T03:54:55.415371+0000) 2019-11-29T03:55:15.164 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:55:15.160+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:55:15.207 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:55:15.202+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:55:15.426 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:55:15.420+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:55:15.467 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:55:15.461+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:55:15.530 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:15.525+0000 1694c700 -1 osd.3 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:54:18.475919+0000 (oldest deadline 2019-11-29T03:54:58.475919+0000) 2019-11-29T03:55:15.530 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:15.526+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:55:15.922 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:55:15.919+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:55:16.005 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:55:16.001+0000 1694c700 -1 osd.1 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589794+0000 front 2019-11-29T03:54:02.223481+0000 (oldest deadline 2019-11-29T03:54:55.415371+0000) 2019-11-29T03:55:16.142 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:55:16.139+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:55:16.246 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:55:16.241+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:55:16.465 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:55:16.460+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:55:16.503 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:55:16.498+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:55:16.547 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:16.542+0000 1694c700 -1 osd.3 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:54:18.475919+0000 (oldest deadline 2019-11-29T03:54:58.475919+0000) 2019-11-29T03:55:16.547 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:16.544+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:55:16.914 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:55:16.910+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:55:16.964 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:55:16.959+0000 1694c700 -1 osd.1 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589794+0000 front 2019-11-29T03:54:02.223481+0000 (oldest deadline 2019-11-29T03:54:55.415371+0000) 2019-11-29T03:55:17.149 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:55:17.144+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:55:17.209 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:55:17.203+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:55:17.464 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:55:17.459+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:55:17.505 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:55:17.501+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:55:17.542 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:17.540+0000 1694c700 -1 osd.3 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:54:18.475919+0000 (oldest deadline 2019-11-29T03:54:58.475919+0000) 2019-11-29T03:55:17.545 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:17.542+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:55:17.950 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:55:17.946+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:55:17.999 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:55:17.996+0000 1694c700 -1 osd.1 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589794+0000 front 2019-11-29T03:54:02.223481+0000 (oldest deadline 2019-11-29T03:54:55.415371+0000) 2019-11-29T03:55:18.125 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:55:18.122+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:55:18.161 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:55:18.157+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:55:18.412 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:55:18.408+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 46sec e338 v338) 2019-11-29T03:55:18.423 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:55:18.418+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:55:18.474 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:55:18.467+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:55:18.552 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:06:09:00.770 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:55:18.557 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:06:09:00.776 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:55:18.561 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:06:09:00.781 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:55:18.565 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:06:09:00.794 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:55:18.567 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:06:09:00.796 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:55:18.567 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:06:09:00.787 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:55:18.571 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:18.568+0000 1694c700 -1 osd.3 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:54:18.475919+0000 (oldest deadline 2019-11-29T03:54:58.475919+0000) 2019-11-29T03:55:18.573 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:18.570+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:55:18.602 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:06:09:00.821 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:55:18.602 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:06:09:00.820 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:55:18.624 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:06:09:00.852 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:55:18.914 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:55:18.911+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:55:19.039 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:55:19.037+0000 1694c700 -1 osd.1 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589794+0000 front 2019-11-29T03:54:02.223481+0000 (oldest deadline 2019-11-29T03:54:55.415371+0000) 2019-11-29T03:55:19.129 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:55:19.126+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:55:19.210 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:55:19.205+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:55:19.377 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:55:19.373+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:55:19.510 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:55:19.505+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:55:19.563 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:19.560+0000 1694c700 -1 osd.3 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:54:18.475919+0000 (oldest deadline 2019-11-29T03:54:58.475919+0000) 2019-11-29T03:55:19.563 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:19.561+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:55:19.924 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:55:19.921+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:55:20.074 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:55:20.071+0000 1694c700 -1 osd.1 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589794+0000 front 2019-11-29T03:54:02.223481+0000 (oldest deadline 2019-11-29T03:54:55.415371+0000) 2019-11-29T03:55:20.120 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:55:20.117+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:55:20.240 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:55:20.236+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:55:20.362 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:55:20.356+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:55:20.491 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:55:20.486+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:55:20.554 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:20.550+0000 1694c700 -1 osd.3 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:54:18.475919+0000 (oldest deadline 2019-11-29T03:54:58.475919+0000) 2019-11-29T03:55:20.557 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:20.554+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:55:20.937 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:55:20.933+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:55:21.104 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:55:21.100+0000 1694c700 -1 osd.1 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589794+0000 front 2019-11-29T03:54:02.223481+0000 (oldest deadline 2019-11-29T03:54:55.415371+0000) 2019-11-29T03:55:21.164 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:55:21.160+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:55:21.224 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:55:21.220+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:55:21.381 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:55:21.376+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:55:21.509 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:55:21.504+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:55:21.512 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:21.507+0000 1694c700 -1 osd.3 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:54:18.475919+0000 (oldest deadline 2019-11-29T03:54:58.475919+0000) 2019-11-29T03:55:21.513 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:21.509+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:55:21.911 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:55:21.908+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:55:22.123 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:55:22.119+0000 1694c700 -1 osd.1 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589794+0000 front 2019-11-29T03:54:02.223481+0000 (oldest deadline 2019-11-29T03:54:55.415371+0000) 2019-11-29T03:55:22.187 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:55:22.183+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:55:22.244 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:55:22.240+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:55:22.348 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:55:22.343+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:55:22.474 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:22.469+0000 1694c700 -1 osd.3 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:54:18.475919+0000 (oldest deadline 2019-11-29T03:54:58.475919+0000) 2019-11-29T03:55:22.474 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:22.470+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:55:22.535 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:55:22.529+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:55:22.910 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:55:22.907+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:55:23.126 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:55:23.122+0000 1694c700 -1 osd.1 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589794+0000 front 2019-11-29T03:54:02.223481+0000 (oldest deadline 2019-11-29T03:54:55.415371+0000) 2019-11-29T03:55:23.153 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:55:23.150+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:55:23.278 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:55:23.273+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:55:23.384 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:55:23.380+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:55:23.425 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:55:23.420+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 46sec e338 v338) 2019-11-29T03:55:23.505 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:23.502+0000 1694c700 -1 osd.3 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:54:18.475919+0000 (oldest deadline 2019-11-29T03:54:58.475919+0000) 2019-11-29T03:55:23.507 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:23.505+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:55:23.575 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:55:23.570+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:55:23.884 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:55:23.881+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:55:24.108 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:55:24.103+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:55:24.146 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:55:24.142+0000 1694c700 -1 osd.1 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589794+0000 front 2019-11-29T03:54:02.223481+0000 (oldest deadline 2019-11-29T03:54:55.415371+0000) 2019-11-29T03:55:24.300 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:55:24.295+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:55:24.425 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:55:24.420+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:55:24.471 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:24.466+0000 1694c700 -1 osd.3 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:54:18.475919+0000 (oldest deadline 2019-11-29T03:54:58.475919+0000) 2019-11-29T03:55:24.472 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:24.468+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:55:24.597 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:55:24.593+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:55:24.920 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:55:24.917+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:55:25.100 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:55:25.097+0000 1694c700 -1 osd.1 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589794+0000 front 2019-11-29T03:54:02.223481+0000 (oldest deadline 2019-11-29T03:54:55.415371+0000) 2019-11-29T03:55:25.102 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:55:25.098+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:55:25.283 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:55:25.277+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:55:25.467 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:55:25.463+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:55:25.502 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:25.499+0000 1694c700 -1 osd.3 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:54:18.475919+0000 (oldest deadline 2019-11-29T03:54:58.475919+0000) 2019-11-29T03:55:25.503 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:25.500+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:55:25.647 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:55:25.641+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:55:25.960 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:55:25.957+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:55:26.096 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:55:26.092+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:55:26.120 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:55:26.116+0000 1694c700 -1 osd.1 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589794+0000 front 2019-11-29T03:54:02.223481+0000 (oldest deadline 2019-11-29T03:54:55.415371+0000) 2019-11-29T03:55:26.265 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:55:26.261+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:55:26.470 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:55:26.465+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:55:26.519 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:26.515+0000 1694c700 -1 osd.3 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:54:18.475919+0000 (oldest deadline 2019-11-29T03:54:58.475919+0000) 2019-11-29T03:55:26.520 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:26.517+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:55:26.669 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:55:26.662+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:55:26.917 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:55:26.914+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:55:27.075 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:55:27.071+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:55:27.156 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:55:27.152+0000 1694c700 -1 osd.1 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589794+0000 front 2019-11-29T03:54:02.223481+0000 (oldest deadline 2019-11-29T03:54:55.415371+0000) 2019-11-29T03:55:27.237 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:55:27.233+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:55:27.499 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:55:27.495+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:55:27.560 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:27.557+0000 1694c700 -1 osd.3 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:54:18.475919+0000 (oldest deadline 2019-11-29T03:54:58.475919+0000) 2019-11-29T03:55:27.563 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:27.558+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:55:27.700 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:55:27.696+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:55:27.901 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:55:27.896+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:55:28.076 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:55:28.073+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:55:28.155 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:55:28.151+0000 1694c700 -1 osd.1 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589794+0000 front 2019-11-29T03:54:02.223481+0000 (oldest deadline 2019-11-29T03:54:55.415371+0000) 2019-11-29T03:55:28.281 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:55:28.275+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:55:28.436 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:55:28.434+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 46sec e338 v338) 2019-11-29T03:55:28.547 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:55:28.542+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:55:28.588 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:28.586+0000 1694c700 -1 osd.3 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:54:18.475919+0000 (oldest deadline 2019-11-29T03:54:58.475919+0000) 2019-11-29T03:55:28.589 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:28.587+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:55:28.746 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:55:28.741+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:55:28.918 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:55:28.914+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:55:29.118 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:55:29.114+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:55:29.137 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:55:29.134+0000 1694c700 -1 osd.1 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589794+0000 front 2019-11-29T03:54:02.223481+0000 (oldest deadline 2019-11-29T03:54:55.415371+0000) 2019-11-29T03:55:29.327 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:55:29.322+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:55:29.574 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:55:29.569+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:55:29.594 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:29.590+0000 1694c700 -1 osd.3 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:54:18.475919+0000 (oldest deadline 2019-11-29T03:54:58.475919+0000) 2019-11-29T03:55:29.598 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:29.596+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:55:29.776 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:55:29.772+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:55:29.889 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:55:29.886+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:55:30.111 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:55:30.108+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:55:30.143 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:55:30.141+0000 1694c700 -1 osd.1 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589794+0000 front 2019-11-29T03:54:02.223481+0000 (oldest deadline 2019-11-29T03:54:55.415371+0000) 2019-11-29T03:55:30.373 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:55:30.368+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:55:30.537 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:55:30.533+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:55:30.619 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:30.614+0000 1694c700 -1 osd.3 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:54:18.475919+0000 (oldest deadline 2019-11-29T03:54:58.475919+0000) 2019-11-29T03:55:30.620 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:30.616+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:55:30.769 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:55:30.763+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:55:30.883 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:55:30.879+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:55:31.080 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:55:31.076+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:55:31.197 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:55:31.193+0000 1694c700 -1 osd.1 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589794+0000 front 2019-11-29T03:54:02.223481+0000 (oldest deadline 2019-11-29T03:54:55.415371+0000) 2019-11-29T03:55:31.403 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:55:31.396+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:55:31.579 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:55:31.575+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:55:31.647 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:31.642+0000 1694c700 -1 osd.3 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:54:18.475919+0000 (oldest deadline 2019-11-29T03:54:58.475919+0000) 2019-11-29T03:55:31.648 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:31.644+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:55:31.822 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:55:31.817+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:55:31.867 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:55:31.863+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:55:32.087 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:55:32.084+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:55:32.154 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:55:32.151+0000 1694c700 -1 osd.1 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589794+0000 front 2019-11-29T03:54:02.223481+0000 (oldest deadline 2019-11-29T03:54:55.415371+0000) 2019-11-29T03:55:32.433 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:55:32.429+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:55:32.577 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:55:32.571+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:55:32.619 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:32.616+0000 1694c700 -1 osd.3 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:54:18.475919+0000 (oldest deadline 2019-11-29T03:54:58.475919+0000) 2019-11-29T03:55:32.622 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:32.620+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:55:32.806 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:55:32.802+0000 1694c700 -1 osd.6 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.246764+0000 front 2019-11-29T03:53:59.697941+0000 (oldest deadline 2019-11-29T03:54:43.750136+0000) 2019-11-29T03:55:32.826 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:55:32.823+0000 1694c700 -1 osd.0 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589998+0000 front 2019-11-29T03:54:02.253776+0000 (oldest deadline 2019-11-29T03:54:45.544902+0000) 2019-11-29T03:55:33.132 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:55:33.128+0000 1694c700 -1 osd.2 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.523398+0000 front 2019-11-29T03:54:00.617398+0000 (oldest deadline 2019-11-29T03:54:46.455761+0000) 2019-11-29T03:55:33.158 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:55:33.154+0000 1694c700 -1 osd.1 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.589794+0000 front 2019-11-29T03:54:02.223481+0000 (oldest deadline 2019-11-29T03:54:55.415371+0000) 2019-11-29T03:55:33.472 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:55:33.468+0000 1694c700 -1 osd.7 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:02.554619+0000 front 2019-11-29T03:54:02.569795+0000 (oldest deadline 2019-11-29T03:54:46.452563+0000) 2019-11-29T03:55:33.499 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:55:33.493+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.141:6806/9905,v1:172.21.15.141:6808/9905] for 46sec e338 v338) 2019-11-29T03:55:33.539 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:55:33.534+0000 1694c700 -1 osd.4 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 since back 2019-11-29T03:54:05.244885+0000 front 2019-11-29T03:54:00.200891+0000 (oldest deadline 2019-11-29T03:54:43.088963+0000) 2019-11-29T03:55:33.699 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:33.669+0000 1694c700 -1 osd.3 338 heartbeat_check: no reply from 172.21.15.141:6812 osd.5 ever on either front or back, first ping sent 2019-11-29T03:54:18.475919+0000 (oldest deadline 2019-11-29T03:54:58.475919+0000) 2019-11-29T03:55:33.700 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:55:33.671+0000 1694c700 -1 osd.3 338 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4322.0:86378 7.5 7.81f96ad5 (undecoded) ondisk+retry+read+known_if_redirected e337) 2019-11-29T03:56:00.862 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:56:00.852+0000 3778f700 -1 osd.5 338 build_incremental_map_msg missing incremental map 337 2019-11-29T03:56:05.554 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:56:05.510+0000 114ab700 -1 osd.5 343 build_incremental_map_msg missing incremental map 343 2019-11-29T03:56:05.564 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:56:05.531+0000 30f82700 -1 osd.5 343 build_incremental_map_msg missing incremental map 343 2019-11-29T03:56:05.594 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:56:05.586+0000 11cac700 -1 osd.5 343 build_incremental_map_msg missing incremental map 343 2019-11-29T03:56:05.685 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:56:05.679+0000 31783700 -1 osd.5 343 build_incremental_map_msg missing incremental map 343 2019-11-29T03:56:06.597 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:56:06.565+0000 124ad700 -1 osd.5 344 build_incremental_map_msg missing incremental map 344 2019-11-29T03:56:06.664 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:56:06.624+0000 30f82700 -1 osd.5 344 build_incremental_map_msg missing incremental map 344 2019-11-29T03:56:07.120 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:56:07.061+0000 33787700 -1 osd.5 344 build_incremental_map_msg missing incremental map 344 2019-11-29T03:56:18.897 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:06:10:01.116 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:56:18.937 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:06:10:01.155 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:56:18.967 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:06:10:01.186 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:56:18.980 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:06:10:01.200 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:56:19.018 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:06:10:01.247 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:56:19.026 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:06:10:01.254 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:56:19.029 INFO:tasks.ceph.mon.a.smithi074.stderr:==00:06:10:01.248 9121== Warning: unimplemented fcntl command: 1036 2019-11-29T03:56:19.071 INFO:tasks.ceph.mon.c.smithi074.stderr:==00:06:10:01.290 9123== Warning: unimplemented fcntl command: 1036 2019-11-29T03:56:19.181 INFO:tasks.ceph.mon.b.smithi141.stderr:==00:06:10:01.409 8591== Warning: unimplemented fcntl command: 1036 2019-11-29T03:57:06.685 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:57:06.683+0000 1694c700 -1 osd.0 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:22.469652+0000 front 2019-11-29T03:56:22.521639+0000 (oldest deadline 2019-11-29T03:57:06.501778+0000) 2019-11-29T03:57:06.749 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:57:06.744+0000 1694c700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.034577+0000 front 2019-11-29T03:56:23.962213+0000 (oldest deadline 2019-11-29T03:57:06.162261+0000) 2019-11-29T03:57:06.774 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:57:06.766+0000 1694c700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:20.904245+0000 front 2019-11-29T03:56:20.988912+0000 (oldest deadline 2019-11-29T03:57:06.313109+0000) 2019-11-29T03:57:07.643 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:57:07.641+0000 1694c700 -1 osd.0 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:22.469652+0000 front 2019-11-29T03:56:22.521639+0000 (oldest deadline 2019-11-29T03:57:06.501778+0000) 2019-11-29T03:57:07.709 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:57:07.703+0000 1694c700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.034577+0000 front 2019-11-29T03:56:23.962213+0000 (oldest deadline 2019-11-29T03:57:06.162261+0000) 2019-11-29T03:57:07.798 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:57:07.792+0000 1694c700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:20.904245+0000 front 2019-11-29T03:56:20.988912+0000 (oldest deadline 2019-11-29T03:57:06.313109+0000) 2019-11-29T03:57:07.921 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:57:07.915+0000 1694c700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.873737+0000 front 2019-11-29T03:56:23.733075+0000 (oldest deadline 2019-11-29T03:57:07.210784+0000) 2019-11-29T03:57:08.675 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:57:08.673+0000 1694c700 -1 osd.0 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:22.469652+0000 front 2019-11-29T03:56:22.521639+0000 (oldest deadline 2019-11-29T03:57:06.501778+0000) 2019-11-29T03:57:08.740 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:57:08.734+0000 1694c700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.034577+0000 front 2019-11-29T03:56:23.962213+0000 (oldest deadline 2019-11-29T03:57:06.162261+0000) 2019-11-29T03:57:08.766 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:57:08.761+0000 1694c700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:20.904245+0000 front 2019-11-29T03:56:20.988912+0000 (oldest deadline 2019-11-29T03:57:06.313109+0000) 2019-11-29T03:57:08.883 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:57:08.878+0000 1694c700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.873737+0000 front 2019-11-29T03:56:23.733075+0000 (oldest deadline 2019-11-29T03:57:07.210784+0000) 2019-11-29T03:57:08.944 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:57:08.942+0000 1694c700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.444176+0000 front 2019-11-29T03:56:24.302480+0000 (oldest deadline 2019-11-29T03:57:08.385877+0000) 2019-11-29T03:57:09.560 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:57:09.554+0000 1694c700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.633702+0000 front 2019-11-29T03:56:24.788265+0000 (oldest deadline 2019-11-29T03:57:09.154270+0000) 2019-11-29T03:57:09.699 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:57:09.695+0000 1694c700 -1 osd.0 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:22.469652+0000 front 2019-11-29T03:56:22.521639+0000 (oldest deadline 2019-11-29T03:57:06.501778+0000) 2019-11-29T03:57:09.756 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:57:09.749+0000 1694c700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.034577+0000 front 2019-11-29T03:56:23.962213+0000 (oldest deadline 2019-11-29T03:57:06.162261+0000) 2019-11-29T03:57:09.788 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:57:09.783+0000 1694c700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:20.904245+0000 front 2019-11-29T03:56:20.988912+0000 (oldest deadline 2019-11-29T03:57:06.313109+0000) 2019-11-29T03:57:09.895 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:57:09.888+0000 1694c700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.873737+0000 front 2019-11-29T03:56:23.733075+0000 (oldest deadline 2019-11-29T03:57:07.210784+0000) 2019-11-29T03:57:09.918 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:57:09.916+0000 1694c700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.444176+0000 front 2019-11-29T03:56:24.302480+0000 (oldest deadline 2019-11-29T03:57:08.385877+0000) 2019-11-29T03:57:10.517 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:57:10.511+0000 1694c700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.633702+0000 front 2019-11-29T03:56:24.788265+0000 (oldest deadline 2019-11-29T03:57:09.154270+0000) 2019-11-29T03:57:10.664 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:57:10.661+0000 1694c700 -1 osd.0 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:22.469652+0000 front 2019-11-29T03:56:22.521639+0000 (oldest deadline 2019-11-29T03:57:06.501778+0000) 2019-11-29T03:57:10.746 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:57:10.740+0000 1694c700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.034577+0000 front 2019-11-29T03:56:23.962213+0000 (oldest deadline 2019-11-29T03:57:06.162261+0000) 2019-11-29T03:57:10.774 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:57:10.773+0000 1694c700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.912114+0000 front 2019-11-29T03:56:24.036329+0000 (oldest deadline 2019-11-29T03:57:09.749701+0000) 2019-11-29T03:57:10.841 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:57:10.835+0000 1694c700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:20.904245+0000 front 2019-11-29T03:56:20.988912+0000 (oldest deadline 2019-11-29T03:57:06.313109+0000) 2019-11-29T03:57:10.891 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:57:10.886+0000 1694c700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.873737+0000 front 2019-11-29T03:56:23.733075+0000 (oldest deadline 2019-11-29T03:57:07.210784+0000) 2019-11-29T03:57:10.912 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:57:10.909+0000 1694c700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.444176+0000 front 2019-11-29T03:56:24.302480+0000 (oldest deadline 2019-11-29T03:57:08.385877+0000) 2019-11-29T03:57:11.498 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:57:11.493+0000 1694c700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.633702+0000 front 2019-11-29T03:56:24.788265+0000 (oldest deadline 2019-11-29T03:57:09.154270+0000) 2019-11-29T03:57:11.650 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:57:11.648+0000 1694c700 -1 osd.0 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:22.469652+0000 front 2019-11-29T03:56:22.521639+0000 (oldest deadline 2019-11-29T03:57:06.501778+0000) 2019-11-29T03:57:11.762 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:57:11.756+0000 1694c700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.034577+0000 front 2019-11-29T03:56:23.962213+0000 (oldest deadline 2019-11-29T03:57:06.162261+0000) 2019-11-29T03:57:11.783 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:57:11.781+0000 1694c700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.912114+0000 front 2019-11-29T03:56:24.036329+0000 (oldest deadline 2019-11-29T03:57:09.749701+0000) 2019-11-29T03:57:11.827 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:57:11.822+0000 1694c700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:20.904245+0000 front 2019-11-29T03:56:20.988912+0000 (oldest deadline 2019-11-29T03:57:06.313109+0000) 2019-11-29T03:57:11.849 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:57:11.844+0000 1694c700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.873737+0000 front 2019-11-29T03:56:23.733075+0000 (oldest deadline 2019-11-29T03:57:07.210784+0000) 2019-11-29T03:57:11.889 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:57:11.886+0000 1694c700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.444176+0000 front 2019-11-29T03:56:24.302480+0000 (oldest deadline 2019-11-29T03:57:08.385877+0000) 2019-11-29T03:57:12.546 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:57:12.541+0000 1694c700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.633702+0000 front 2019-11-29T03:56:24.788265+0000 (oldest deadline 2019-11-29T03:57:09.154270+0000) 2019-11-29T03:57:12.663 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:57:12.661+0000 1694c700 -1 osd.0 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:22.469652+0000 front 2019-11-29T03:56:22.521639+0000 (oldest deadline 2019-11-29T03:57:06.501778+0000) 2019-11-29T03:57:12.747 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:57:12.741+0000 1694c700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.034577+0000 front 2019-11-29T03:56:23.962213+0000 (oldest deadline 2019-11-29T03:57:06.162261+0000) 2019-11-29T03:57:12.752 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:57:12.749+0000 1694c700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.912114+0000 front 2019-11-29T03:56:24.036329+0000 (oldest deadline 2019-11-29T03:57:09.749701+0000) 2019-11-29T03:57:12.814 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:57:12.808+0000 1694c700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:20.904245+0000 front 2019-11-29T03:56:20.988912+0000 (oldest deadline 2019-11-29T03:57:06.313109+0000) 2019-11-29T03:57:12.859 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:57:12.854+0000 1694c700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.873737+0000 front 2019-11-29T03:56:23.733075+0000 (oldest deadline 2019-11-29T03:57:07.210784+0000) 2019-11-29T03:57:12.876 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:57:12.873+0000 1694c700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.444176+0000 front 2019-11-29T03:56:24.302480+0000 (oldest deadline 2019-11-29T03:57:08.385877+0000) 2019-11-29T03:57:13.528 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:57:13.523+0000 1694c700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.633702+0000 front 2019-11-29T03:56:24.788265+0000 (oldest deadline 2019-11-29T03:57:09.154270+0000) 2019-11-29T03:57:13.620 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:57:13.617+0000 1694c700 -1 osd.0 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:22.469652+0000 front 2019-11-29T03:56:22.521639+0000 (oldest deadline 2019-11-29T03:57:06.501778+0000) 2019-11-29T03:57:13.767 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:57:13.761+0000 1694c700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.034577+0000 front 2019-11-29T03:56:23.962213+0000 (oldest deadline 2019-11-29T03:57:06.162261+0000) 2019-11-29T03:57:13.779 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:57:13.776+0000 1694c700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.912114+0000 front 2019-11-29T03:56:24.036329+0000 (oldest deadline 2019-11-29T03:57:09.749701+0000) 2019-11-29T03:57:13.863 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:57:13.857+0000 1694c700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:20.904245+0000 front 2019-11-29T03:56:20.988912+0000 (oldest deadline 2019-11-29T03:57:06.313109+0000) 2019-11-29T03:57:13.867 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:57:13.861+0000 1694c700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.873737+0000 front 2019-11-29T03:56:23.733075+0000 (oldest deadline 2019-11-29T03:57:07.210784+0000) 2019-11-29T03:57:13.928 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:57:13.925+0000 1694c700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.444176+0000 front 2019-11-29T03:56:24.302480+0000 (oldest deadline 2019-11-29T03:57:08.385877+0000) 2019-11-29T03:57:14.504 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:57:14.498+0000 1694c700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.633702+0000 front 2019-11-29T03:56:24.788265+0000 (oldest deadline 2019-11-29T03:57:09.154270+0000) 2019-11-29T03:57:14.599 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:57:14.596+0000 1694c700 -1 osd.0 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:22.469652+0000 front 2019-11-29T03:56:22.521639+0000 (oldest deadline 2019-11-29T03:57:06.501778+0000) 2019-11-29T03:57:14.745 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:57:14.742+0000 1694c700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.912114+0000 front 2019-11-29T03:56:24.036329+0000 (oldest deadline 2019-11-29T03:57:09.749701+0000) 2019-11-29T03:57:14.786 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:57:14.781+0000 1694c700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.034577+0000 front 2019-11-29T03:56:23.962213+0000 (oldest deadline 2019-11-29T03:57:06.162261+0000) 2019-11-29T03:57:14.875 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:57:14.869+0000 1694c700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:20.904245+0000 front 2019-11-29T03:56:20.988912+0000 (oldest deadline 2019-11-29T03:57:06.313109+0000) 2019-11-29T03:57:14.896 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:57:14.890+0000 1694c700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.873737+0000 front 2019-11-29T03:56:23.733075+0000 (oldest deadline 2019-11-29T03:57:07.210784+0000) 2019-11-29T03:57:14.953 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:57:14.950+0000 1694c700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.444176+0000 front 2019-11-29T03:56:24.302480+0000 (oldest deadline 2019-11-29T03:57:08.385877+0000) 2019-11-29T03:57:15.497 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:57:15.490+0000 1694c700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.633702+0000 front 2019-11-29T03:56:24.788265+0000 (oldest deadline 2019-11-29T03:57:09.154270+0000) 2019-11-29T03:57:15.651 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:57:15.649+0000 1694c700 -1 osd.0 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:22.469652+0000 front 2019-11-29T03:56:22.521639+0000 (oldest deadline 2019-11-29T03:57:06.501778+0000) 2019-11-29T03:57:15.729 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:57:15.725+0000 1694c700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.912114+0000 front 2019-11-29T03:56:24.036329+0000 (oldest deadline 2019-11-29T03:57:09.749701+0000) 2019-11-29T03:57:15.795 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:57:15.788+0000 1694c700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.034577+0000 front 2019-11-29T03:56:23.962213+0000 (oldest deadline 2019-11-29T03:57:06.162261+0000) 2019-11-29T03:57:15.868 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:57:15.862+0000 1694c700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:20.904245+0000 front 2019-11-29T03:56:20.988912+0000 (oldest deadline 2019-11-29T03:57:06.313109+0000) 2019-11-29T03:57:15.884 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:57:15.877+0000 1694c700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.873737+0000 front 2019-11-29T03:56:23.733075+0000 (oldest deadline 2019-11-29T03:57:07.210784+0000) 2019-11-29T03:57:15.981 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:57:15.979+0000 1694c700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.444176+0000 front 2019-11-29T03:56:24.302480+0000 (oldest deadline 2019-11-29T03:57:08.385877+0000) 2019-11-29T03:57:16.494 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:57:16.487+0000 1694c700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.633702+0000 front 2019-11-29T03:56:24.788265+0000 (oldest deadline 2019-11-29T03:57:09.154270+0000) 2019-11-29T03:57:16.701 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:57:16.698+0000 1694c700 -1 osd.0 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:22.469652+0000 front 2019-11-29T03:56:22.521639+0000 (oldest deadline 2019-11-29T03:57:06.501778+0000) 2019-11-29T03:57:16.736 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:57:16.733+0000 1694c700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.912114+0000 front 2019-11-29T03:56:24.036329+0000 (oldest deadline 2019-11-29T03:57:09.749701+0000) 2019-11-29T03:57:16.814 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:57:16.807+0000 1694c700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.034577+0000 front 2019-11-29T03:56:23.962213+0000 (oldest deadline 2019-11-29T03:57:06.162261+0000) 2019-11-29T03:57:16.844 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:57:16.837+0000 1694c700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:20.904245+0000 front 2019-11-29T03:56:20.988912+0000 (oldest deadline 2019-11-29T03:57:06.313109+0000) 2019-11-29T03:57:16.917 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:57:16.910+0000 1694c700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.873737+0000 front 2019-11-29T03:56:23.733075+0000 (oldest deadline 2019-11-29T03:57:07.210784+0000) 2019-11-29T03:57:17.005 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:57:17.003+0000 1694c700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.444176+0000 front 2019-11-29T03:56:24.302480+0000 (oldest deadline 2019-11-29T03:57:08.385877+0000) 2019-11-29T03:57:17.468 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:57:17.461+0000 1694c700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.633702+0000 front 2019-11-29T03:56:24.788265+0000 (oldest deadline 2019-11-29T03:57:09.154270+0000) 2019-11-29T03:57:17.709 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:57:17.707+0000 1694c700 -1 osd.0 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:22.469652+0000 front 2019-11-29T03:56:22.521639+0000 (oldest deadline 2019-11-29T03:57:06.501778+0000) 2019-11-29T03:57:17.778 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:57:17.776+0000 1694c700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.912114+0000 front 2019-11-29T03:56:24.036329+0000 (oldest deadline 2019-11-29T03:57:09.749701+0000) 2019-11-29T03:57:17.804 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:57:17.797+0000 1694c700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:20.904245+0000 front 2019-11-29T03:56:20.988912+0000 (oldest deadline 2019-11-29T03:57:06.313109+0000) 2019-11-29T03:57:17.863 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:57:17.857+0000 1694c700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.034577+0000 front 2019-11-29T03:56:23.962213+0000 (oldest deadline 2019-11-29T03:57:06.162261+0000) 2019-11-29T03:57:17.964 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:57:17.958+0000 1694c700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.873737+0000 front 2019-11-29T03:56:23.733075+0000 (oldest deadline 2019-11-29T03:57:07.210784+0000) 2019-11-29T03:57:17.992 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:57:17.990+0000 1694c700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.444176+0000 front 2019-11-29T03:56:24.302480+0000 (oldest deadline 2019-11-29T03:57:08.385877+0000) 2019-11-29T03:57:18.443 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:57:18.437+0000 1694c700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.633702+0000 front 2019-11-29T03:56:24.788265+0000 (oldest deadline 2019-11-29T03:57:09.154270+0000) 2019-11-29T03:57:18.684 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:57:18.680+0000 1694c700 -1 osd.0 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:22.469652+0000 front 2019-11-29T03:56:22.521639+0000 (oldest deadline 2019-11-29T03:57:06.501778+0000) 2019-11-29T03:57:18.759 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:57:18.753+0000 1694c700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:20.904245+0000 front 2019-11-29T03:56:20.988912+0000 (oldest deadline 2019-11-29T03:57:06.313109+0000) 2019-11-29T03:57:18.822 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:57:18.819+0000 1694c700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.912114+0000 front 2019-11-29T03:56:24.036329+0000 (oldest deadline 2019-11-29T03:57:09.749701+0000) 2019-11-29T03:57:18.837 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:57:18.832+0000 1694c700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.034577+0000 front 2019-11-29T03:56:23.962213+0000 (oldest deadline 2019-11-29T03:57:06.162261+0000) 2019-11-29T03:57:18.990 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:57:18.988+0000 1694c700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.444176+0000 front 2019-11-29T03:56:24.302480+0000 (oldest deadline 2019-11-29T03:57:08.385877+0000) 2019-11-29T03:57:18.992 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:57:18.986+0000 1694c700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.873737+0000 front 2019-11-29T03:56:23.733075+0000 (oldest deadline 2019-11-29T03:57:07.210784+0000) 2019-11-29T03:57:19.479 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:57:19.474+0000 1694c700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.633702+0000 front 2019-11-29T03:56:24.788265+0000 (oldest deadline 2019-11-29T03:57:09.154270+0000) 2019-11-29T03:57:19.719 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:57:19.715+0000 1694c700 -1 osd.0 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:22.469652+0000 front 2019-11-29T03:56:22.521639+0000 (oldest deadline 2019-11-29T03:57:06.501778+0000) 2019-11-29T03:57:19.755 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:57:19.749+0000 1694c700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:20.904245+0000 front 2019-11-29T03:56:20.988912+0000 (oldest deadline 2019-11-29T03:57:06.313109+0000) 2019-11-29T03:57:19.813 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:57:19.809+0000 1694c700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.912114+0000 front 2019-11-29T03:56:24.036329+0000 (oldest deadline 2019-11-29T03:57:09.749701+0000) 2019-11-29T03:57:19.825 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:57:19.820+0000 1694c700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.034577+0000 front 2019-11-29T03:56:23.962213+0000 (oldest deadline 2019-11-29T03:57:06.162261+0000) 2019-11-29T03:57:19.960 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:57:19.954+0000 1694c700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.873737+0000 front 2019-11-29T03:56:23.733075+0000 (oldest deadline 2019-11-29T03:57:07.210784+0000) 2019-11-29T03:57:19.961 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:57:19.958+0000 1694c700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.444176+0000 front 2019-11-29T03:56:24.302480+0000 (oldest deadline 2019-11-29T03:57:08.385877+0000) 2019-11-29T03:57:20.520 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:57:20.514+0000 1694c700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.633702+0000 front 2019-11-29T03:56:24.788265+0000 (oldest deadline 2019-11-29T03:57:09.154270+0000) 2019-11-29T03:57:20.696 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:57:20.691+0000 1694c700 -1 osd.0 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:22.469652+0000 front 2019-11-29T03:56:22.521639+0000 (oldest deadline 2019-11-29T03:57:06.501778+0000) 2019-11-29T03:57:20.760 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:57:20.754+0000 1694c700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:20.904245+0000 front 2019-11-29T03:56:20.988912+0000 (oldest deadline 2019-11-29T03:57:06.313109+0000) 2019-11-29T03:57:20.785 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:57:20.780+0000 1694c700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.034577+0000 front 2019-11-29T03:56:23.962213+0000 (oldest deadline 2019-11-29T03:57:06.162261+0000) 2019-11-29T03:57:20.858 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:57:20.855+0000 1694c700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.912114+0000 front 2019-11-29T03:56:24.036329+0000 (oldest deadline 2019-11-29T03:57:09.749701+0000) 2019-11-29T03:57:20.924 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:57:20.920+0000 1694c700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.444176+0000 front 2019-11-29T03:56:24.302480+0000 (oldest deadline 2019-11-29T03:57:08.385877+0000) 2019-11-29T03:57:20.961 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:57:20.956+0000 1694c700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.873737+0000 front 2019-11-29T03:56:23.733075+0000 (oldest deadline 2019-11-29T03:57:07.210784+0000) 2019-11-29T03:57:21.515 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:57:21.508+0000 1694c700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.633702+0000 front 2019-11-29T03:56:24.788265+0000 (oldest deadline 2019-11-29T03:57:09.154270+0000) 2019-11-29T03:57:21.654 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:57:21.651+0000 1694c700 -1 osd.0 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:22.469652+0000 front 2019-11-29T03:56:22.521639+0000 (oldest deadline 2019-11-29T03:57:06.501778+0000) 2019-11-29T03:57:21.750 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:57:21.744+0000 1694c700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.034577+0000 front 2019-11-29T03:56:23.962213+0000 (oldest deadline 2019-11-29T03:57:06.162261+0000) 2019-11-29T03:57:21.753 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:57:21.748+0000 1694c700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:20.904245+0000 front 2019-11-29T03:56:20.988912+0000 (oldest deadline 2019-11-29T03:57:06.313109+0000) 2019-11-29T03:57:21.842 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:57:21.838+0000 1694c700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.912114+0000 front 2019-11-29T03:56:24.036329+0000 (oldest deadline 2019-11-29T03:57:09.749701+0000) 2019-11-29T03:57:21.942 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:57:21.936+0000 1694c700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.873737+0000 front 2019-11-29T03:56:23.733075+0000 (oldest deadline 2019-11-29T03:57:07.210784+0000) 2019-11-29T03:57:21.975 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:57:21.972+0000 1694c700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.444176+0000 front 2019-11-29T03:56:24.302480+0000 (oldest deadline 2019-11-29T03:57:08.385877+0000) 2019-11-29T03:57:22.565 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:57:22.560+0000 1694c700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.633702+0000 front 2019-11-29T03:56:24.788265+0000 (oldest deadline 2019-11-29T03:57:09.154270+0000) 2019-11-29T03:57:22.649 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:57:22.645+0000 1694c700 -1 osd.0 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:22.469652+0000 front 2019-11-29T03:56:22.521639+0000 (oldest deadline 2019-11-29T03:57:06.501778+0000) 2019-11-29T03:57:22.736 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:57:22.730+0000 1694c700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:20.904245+0000 front 2019-11-29T03:56:20.988912+0000 (oldest deadline 2019-11-29T03:57:06.313109+0000) 2019-11-29T03:57:22.744 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:57:22.738+0000 1694c700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.034577+0000 front 2019-11-29T03:56:23.962213+0000 (oldest deadline 2019-11-29T03:57:06.162261+0000) 2019-11-29T03:57:22.806 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:57:22.801+0000 1694c700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.912114+0000 front 2019-11-29T03:56:24.036329+0000 (oldest deadline 2019-11-29T03:57:09.749701+0000) 2019-11-29T03:57:22.938 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:57:22.933+0000 1694c700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.873737+0000 front 2019-11-29T03:56:23.733075+0000 (oldest deadline 2019-11-29T03:57:07.210784+0000) 2019-11-29T03:57:22.952 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:57:22.947+0000 1694c700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.444176+0000 front 2019-11-29T03:56:24.302480+0000 (oldest deadline 2019-11-29T03:57:08.385877+0000) 2019-11-29T03:57:23.578 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:57:23.572+0000 1694c700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.633702+0000 front 2019-11-29T03:56:24.788265+0000 (oldest deadline 2019-11-29T03:57:09.154270+0000) 2019-11-29T03:57:23.648 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:57:23.645+0000 1694c700 -1 osd.0 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:22.469652+0000 front 2019-11-29T03:56:22.521639+0000 (oldest deadline 2019-11-29T03:57:06.501778+0000) 2019-11-29T03:57:23.766 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:57:23.761+0000 1694c700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:20.904245+0000 front 2019-11-29T03:56:20.988912+0000 (oldest deadline 2019-11-29T03:57:06.313109+0000) 2019-11-29T03:57:23.778 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:57:23.771+0000 1694c700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.034577+0000 front 2019-11-29T03:56:23.962213+0000 (oldest deadline 2019-11-29T03:57:06.162261+0000) 2019-11-29T03:57:23.781 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:57:23.777+0000 1694c700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.912114+0000 front 2019-11-29T03:56:24.036329+0000 (oldest deadline 2019-11-29T03:57:09.749701+0000) 2019-11-29T03:57:23.920 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:57:23.917+0000 1694c700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.444176+0000 front 2019-11-29T03:56:24.302480+0000 (oldest deadline 2019-11-29T03:57:08.385877+0000) 2019-11-29T03:57:23.929 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:57:23.923+0000 1694c700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.873737+0000 front 2019-11-29T03:56:23.733075+0000 (oldest deadline 2019-11-29T03:57:07.210784+0000) 2019-11-29T03:57:24.595 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:57:24.590+0000 1694c700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.633702+0000 front 2019-11-29T03:56:24.788265+0000 (oldest deadline 2019-11-29T03:57:09.154270+0000) 2019-11-29T03:57:24.641 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:57:24.637+0000 1694c700 -1 osd.0 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:22.469652+0000 front 2019-11-29T03:56:22.521639+0000 (oldest deadline 2019-11-29T03:57:06.501778+0000) 2019-11-29T03:57:24.766 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:57:24.760+0000 1694c700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:20.904245+0000 front 2019-11-29T03:56:20.988912+0000 (oldest deadline 2019-11-29T03:57:06.313109+0000) 2019-11-29T03:57:24.800 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:57:24.794+0000 1694c700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.034577+0000 front 2019-11-29T03:56:23.962213+0000 (oldest deadline 2019-11-29T03:57:06.162261+0000) 2019-11-29T03:57:24.827 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:57:24.824+0000 1694c700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.912114+0000 front 2019-11-29T03:56:24.036329+0000 (oldest deadline 2019-11-29T03:57:09.749701+0000) 2019-11-29T03:57:24.888 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:57:24.885+0000 1694c700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.444176+0000 front 2019-11-29T03:56:24.302480+0000 (oldest deadline 2019-11-29T03:57:08.385877+0000) 2019-11-29T03:57:24.922 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:57:24.917+0000 1694c700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.873737+0000 front 2019-11-29T03:56:23.733075+0000 (oldest deadline 2019-11-29T03:57:07.210784+0000) 2019-11-29T03:57:25.558 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:57:25.552+0000 1694c700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.633702+0000 front 2019-11-29T03:56:24.788265+0000 (oldest deadline 2019-11-29T03:57:09.154270+0000) 2019-11-29T03:57:25.684 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:57:25.679+0000 1694c700 -1 osd.0 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:22.469652+0000 front 2019-11-29T03:56:22.521639+0000 (oldest deadline 2019-11-29T03:57:06.501778+0000) 2019-11-29T03:57:25.725 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:57:25.720+0000 1694c700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:20.904245+0000 front 2019-11-29T03:56:20.988912+0000 (oldest deadline 2019-11-29T03:57:06.313109+0000) 2019-11-29T03:57:25.812 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:57:25.807+0000 1694c700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.912114+0000 front 2019-11-29T03:56:24.036329+0000 (oldest deadline 2019-11-29T03:57:09.749701+0000) 2019-11-29T03:57:25.836 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:57:25.830+0000 1694c700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.034577+0000 front 2019-11-29T03:56:23.962213+0000 (oldest deadline 2019-11-29T03:57:06.162261+0000) 2019-11-29T03:57:25.879 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:57:25.874+0000 1694c700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.444176+0000 front 2019-11-29T03:56:24.302480+0000 (oldest deadline 2019-11-29T03:57:08.385877+0000) 2019-11-29T03:57:25.921 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:57:25.914+0000 1694c700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.873737+0000 front 2019-11-29T03:56:23.733075+0000 (oldest deadline 2019-11-29T03:57:07.210784+0000) 2019-11-29T03:57:26.564 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:57:26.559+0000 1694c700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.633702+0000 front 2019-11-29T03:56:24.788265+0000 (oldest deadline 2019-11-29T03:57:09.154270+0000) 2019-11-29T03:57:26.673 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:57:26.670+0000 1694c700 -1 osd.0 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:22.469652+0000 front 2019-11-29T03:56:22.521639+0000 (oldest deadline 2019-11-29T03:57:06.501778+0000) 2019-11-29T03:57:26.686 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:57:26.680+0000 1694c700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:20.904245+0000 front 2019-11-29T03:56:20.988912+0000 (oldest deadline 2019-11-29T03:57:06.313109+0000) 2019-11-29T03:57:26.822 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:57:26.817+0000 1694c700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.034577+0000 front 2019-11-29T03:56:23.962213+0000 (oldest deadline 2019-11-29T03:57:06.162261+0000) 2019-11-29T03:57:26.835 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:57:26.832+0000 1694c700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.912114+0000 front 2019-11-29T03:56:24.036329+0000 (oldest deadline 2019-11-29T03:57:09.749701+0000) 2019-11-29T03:57:26.862 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:57:26.858+0000 1694c700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.444176+0000 front 2019-11-29T03:56:24.302480+0000 (oldest deadline 2019-11-29T03:57:08.385877+0000) 2019-11-29T03:57:26.963 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:57:26.957+0000 1694c700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.873737+0000 front 2019-11-29T03:56:23.733075+0000 (oldest deadline 2019-11-29T03:57:07.210784+0000) 2019-11-29T03:57:27.613 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:57:27.608+0000 1694c700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.633702+0000 front 2019-11-29T03:56:24.788265+0000 (oldest deadline 2019-11-29T03:57:09.154270+0000) 2019-11-29T03:57:27.662 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:57:27.656+0000 1694c700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:20.904245+0000 front 2019-11-29T03:56:20.988912+0000 (oldest deadline 2019-11-29T03:57:06.313109+0000) 2019-11-29T03:57:27.706 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:57:27.703+0000 1694c700 -1 osd.0 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:22.469652+0000 front 2019-11-29T03:56:22.521639+0000 (oldest deadline 2019-11-29T03:57:06.501778+0000) 2019-11-29T03:57:27.853 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:57:27.849+0000 1694c700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.912114+0000 front 2019-11-29T03:56:24.036329+0000 (oldest deadline 2019-11-29T03:57:09.749701+0000) 2019-11-29T03:57:27.863 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:57:27.858+0000 1694c700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.034577+0000 front 2019-11-29T03:56:23.962213+0000 (oldest deadline 2019-11-29T03:57:06.162261+0000) 2019-11-29T03:57:27.884 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:57:27.881+0000 1694c700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.444176+0000 front 2019-11-29T03:56:24.302480+0000 (oldest deadline 2019-11-29T03:57:08.385877+0000) 2019-11-29T03:57:27.945 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:57:27.939+0000 1694c700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.873737+0000 front 2019-11-29T03:56:23.733075+0000 (oldest deadline 2019-11-29T03:57:07.210784+0000) 2019-11-29T03:57:28.584 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:57:28.578+0000 1694c700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.633702+0000 front 2019-11-29T03:56:24.788265+0000 (oldest deadline 2019-11-29T03:57:09.154270+0000) 2019-11-29T03:57:28.620 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:57:28.614+0000 1694c700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:20.904245+0000 front 2019-11-29T03:56:20.988912+0000 (oldest deadline 2019-11-29T03:57:06.313109+0000) 2019-11-29T03:57:28.699 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:57:28.696+0000 1694c700 -1 osd.0 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:22.469652+0000 front 2019-11-29T03:56:22.521639+0000 (oldest deadline 2019-11-29T03:57:06.501778+0000) 2019-11-29T03:57:28.836 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:57:28.832+0000 1694c700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.912114+0000 front 2019-11-29T03:56:24.036329+0000 (oldest deadline 2019-11-29T03:57:09.749701+0000) 2019-11-29T03:57:28.849 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:57:28.844+0000 1694c700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.034577+0000 front 2019-11-29T03:56:23.962213+0000 (oldest deadline 2019-11-29T03:57:06.162261+0000) 2019-11-29T03:57:28.876 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:57:28.872+0000 1694c700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.444176+0000 front 2019-11-29T03:56:24.302480+0000 (oldest deadline 2019-11-29T03:57:08.385877+0000) 2019-11-29T03:57:28.945 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:57:28.940+0000 1694c700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.873737+0000 front 2019-11-29T03:56:23.733075+0000 (oldest deadline 2019-11-29T03:57:07.210784+0000) 2019-11-29T03:57:29.617 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:57:29.611+0000 1694c700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.633702+0000 front 2019-11-29T03:56:24.788265+0000 (oldest deadline 2019-11-29T03:57:09.154270+0000) 2019-11-29T03:57:29.630 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:57:29.625+0000 1694c700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:20.904245+0000 front 2019-11-29T03:56:20.988912+0000 (oldest deadline 2019-11-29T03:57:06.313109+0000) 2019-11-29T03:57:29.709 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:57:29.706+0000 1694c700 -1 osd.0 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:22.469652+0000 front 2019-11-29T03:56:22.521639+0000 (oldest deadline 2019-11-29T03:57:06.501778+0000) 2019-11-29T03:57:29.805 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:57:29.801+0000 1694c700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.912114+0000 front 2019-11-29T03:56:24.036329+0000 (oldest deadline 2019-11-29T03:57:09.749701+0000) 2019-11-29T03:57:29.835 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:57:29.832+0000 1694c700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.444176+0000 front 2019-11-29T03:56:24.302480+0000 (oldest deadline 2019-11-29T03:57:08.385877+0000) 2019-11-29T03:57:29.901 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:57:29.895+0000 1694c700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.034577+0000 front 2019-11-29T03:56:23.962213+0000 (oldest deadline 2019-11-29T03:57:06.162261+0000) 2019-11-29T03:57:29.974 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:57:29.968+0000 1694c700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.873737+0000 front 2019-11-29T03:56:23.733075+0000 (oldest deadline 2019-11-29T03:57:07.210784+0000) 2019-11-29T03:57:30.575 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:57:30.570+0000 1694c700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.633702+0000 front 2019-11-29T03:56:24.788265+0000 (oldest deadline 2019-11-29T03:57:09.154270+0000) 2019-11-29T03:57:30.610 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:57:30.605+0000 1694c700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:20.904245+0000 front 2019-11-29T03:56:20.988912+0000 (oldest deadline 2019-11-29T03:57:06.313109+0000) 2019-11-29T03:57:30.737 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:57:30.733+0000 1694c700 -1 osd.0 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:22.469652+0000 front 2019-11-29T03:56:22.521639+0000 (oldest deadline 2019-11-29T03:57:06.501778+0000) 2019-11-29T03:57:30.818 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:57:30.814+0000 1694c700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.912114+0000 front 2019-11-29T03:56:24.036329+0000 (oldest deadline 2019-11-29T03:57:09.749701+0000) 2019-11-29T03:57:30.835 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:57:30.832+0000 1694c700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.444176+0000 front 2019-11-29T03:56:24.302480+0000 (oldest deadline 2019-11-29T03:57:08.385877+0000) 2019-11-29T03:57:30.891 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:57:30.885+0000 1694c700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.034577+0000 front 2019-11-29T03:56:23.962213+0000 (oldest deadline 2019-11-29T03:57:06.162261+0000) 2019-11-29T03:57:30.968 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:57:30.963+0000 1694c700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.873737+0000 front 2019-11-29T03:56:23.733075+0000 (oldest deadline 2019-11-29T03:57:07.210784+0000) 2019-11-29T03:57:31.601 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:57:31.595+0000 1694c700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.633702+0000 front 2019-11-29T03:56:24.788265+0000 (oldest deadline 2019-11-29T03:57:09.154270+0000) 2019-11-29T03:57:31.612 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:57:31.606+0000 1694c700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:20.904245+0000 front 2019-11-29T03:56:20.988912+0000 (oldest deadline 2019-11-29T03:57:06.313109+0000) 2019-11-29T03:57:31.750 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:57:31.747+0000 1694c700 -1 osd.0 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:22.469652+0000 front 2019-11-29T03:56:22.521639+0000 (oldest deadline 2019-11-29T03:57:06.501778+0000) 2019-11-29T03:57:31.797 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:57:31.794+0000 1694c700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.444176+0000 front 2019-11-29T03:56:24.302480+0000 (oldest deadline 2019-11-29T03:57:08.385877+0000) 2019-11-29T03:57:31.861 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:57:31.852+0000 1694c700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.034577+0000 front 2019-11-29T03:56:23.962213+0000 (oldest deadline 2019-11-29T03:57:06.162261+0000) 2019-11-29T03:57:31.872 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:57:31.868+0000 1694c700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.912114+0000 front 2019-11-29T03:56:24.036329+0000 (oldest deadline 2019-11-29T03:57:09.749701+0000) 2019-11-29T03:57:32.012 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:57:32.007+0000 1694c700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.873737+0000 front 2019-11-29T03:56:23.733075+0000 (oldest deadline 2019-11-29T03:57:07.210784+0000) 2019-11-29T03:57:32.597 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:57:32.592+0000 1694c700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.633702+0000 front 2019-11-29T03:56:24.788265+0000 (oldest deadline 2019-11-29T03:57:09.154270+0000) 2019-11-29T03:57:32.611 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:57:32.603+0000 1694c700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:20.904245+0000 front 2019-11-29T03:56:20.988912+0000 (oldest deadline 2019-11-29T03:57:06.313109+0000) 2019-11-29T03:57:32.730 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:57:32.726+0000 1694c700 -1 osd.0 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:22.469652+0000 front 2019-11-29T03:56:22.521639+0000 (oldest deadline 2019-11-29T03:57:06.501778+0000) 2019-11-29T03:57:32.827 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:57:32.824+0000 1694c700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.444176+0000 front 2019-11-29T03:56:24.302480+0000 (oldest deadline 2019-11-29T03:57:08.385877+0000) 2019-11-29T03:57:32.857 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:57:32.854+0000 1694c700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.912114+0000 front 2019-11-29T03:56:24.036329+0000 (oldest deadline 2019-11-29T03:57:09.749701+0000) 2019-11-29T03:57:32.872 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:57:32.866+0000 1694c700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.034577+0000 front 2019-11-29T03:56:23.962213+0000 (oldest deadline 2019-11-29T03:57:06.162261+0000) 2019-11-29T03:57:33.061 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:57:33.055+0000 1694c700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.873737+0000 front 2019-11-29T03:56:23.733075+0000 (oldest deadline 2019-11-29T03:57:07.210784+0000) 2019-11-29T03:57:33.641 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:57:33.634+0000 1694c700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:20.904245+0000 front 2019-11-29T03:56:20.988912+0000 (oldest deadline 2019-11-29T03:57:06.313109+0000) 2019-11-29T03:57:33.643 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:57:33.638+0000 1694c700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.633702+0000 front 2019-11-29T03:56:24.788265+0000 (oldest deadline 2019-11-29T03:57:09.154270+0000) 2019-11-29T03:57:33.733 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:57:33.728+0000 1694c700 -1 osd.0 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:22.469652+0000 front 2019-11-29T03:56:22.521639+0000 (oldest deadline 2019-11-29T03:57:06.501778+0000) 2019-11-29T03:57:33.796 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:57:33.793+0000 1694c700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.444176+0000 front 2019-11-29T03:56:24.302480+0000 (oldest deadline 2019-11-29T03:57:08.385877+0000) 2019-11-29T03:57:33.816 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:57:33.813+0000 1694c700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.912114+0000 front 2019-11-29T03:56:24.036329+0000 (oldest deadline 2019-11-29T03:57:09.749701+0000) 2019-11-29T03:57:33.852 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:57:33.846+0000 1694c700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.034577+0000 front 2019-11-29T03:56:23.962213+0000 (oldest deadline 2019-11-29T03:57:06.162261+0000) 2019-11-29T03:57:34.029 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:57:34.020+0000 1694c700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.873737+0000 front 2019-11-29T03:56:23.733075+0000 (oldest deadline 2019-11-29T03:57:07.210784+0000) 2019-11-29T03:57:34.632 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:57:34.626+0000 1694c700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.633702+0000 front 2019-11-29T03:56:24.788265+0000 (oldest deadline 2019-11-29T03:57:09.154270+0000) 2019-11-29T03:57:34.643 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:57:34.637+0000 1694c700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:20.904245+0000 front 2019-11-29T03:56:20.988912+0000 (oldest deadline 2019-11-29T03:57:06.313109+0000) 2019-11-29T03:57:34.692 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:57:34.689+0000 1694c700 -1 osd.0 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:22.469652+0000 front 2019-11-29T03:56:22.521639+0000 (oldest deadline 2019-11-29T03:57:06.501778+0000) 2019-11-29T03:57:34.753 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:57:34.750+0000 1694c700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.444176+0000 front 2019-11-29T03:56:24.302480+0000 (oldest deadline 2019-11-29T03:57:08.385877+0000) 2019-11-29T03:57:34.834 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:57:34.829+0000 1694c700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.034577+0000 front 2019-11-29T03:56:23.962213+0000 (oldest deadline 2019-11-29T03:57:06.162261+0000) 2019-11-29T03:57:34.868 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:57:34.865+0000 1694c700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.912114+0000 front 2019-11-29T03:56:24.036329+0000 (oldest deadline 2019-11-29T03:57:09.749701+0000) 2019-11-29T03:57:34.985 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:57:34.979+0000 1694c700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.873737+0000 front 2019-11-29T03:56:23.733075+0000 (oldest deadline 2019-11-29T03:57:07.210784+0000) 2019-11-29T03:57:35.617 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:57:35.611+0000 1694c700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:20.904245+0000 front 2019-11-29T03:56:20.988912+0000 (oldest deadline 2019-11-29T03:57:06.313109+0000) 2019-11-29T03:57:35.663 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:57:35.658+0000 1694c700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.633702+0000 front 2019-11-29T03:56:24.788265+0000 (oldest deadline 2019-11-29T03:57:09.154270+0000) 2019-11-29T03:57:35.712 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:57:35.709+0000 1694c700 -1 osd.0 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:22.469652+0000 front 2019-11-29T03:56:22.521639+0000 (oldest deadline 2019-11-29T03:57:06.501778+0000) 2019-11-29T03:57:35.733 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:57:35.730+0000 1694c700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.444176+0000 front 2019-11-29T03:56:24.302480+0000 (oldest deadline 2019-11-29T03:57:08.385877+0000) 2019-11-29T03:57:35.802 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:57:35.797+0000 1694c700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.034577+0000 front 2019-11-29T03:56:23.962213+0000 (oldest deadline 2019-11-29T03:57:06.162261+0000) 2019-11-29T03:57:35.902 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:57:35.899+0000 1694c700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.912114+0000 front 2019-11-29T03:56:24.036329+0000 (oldest deadline 2019-11-29T03:57:09.749701+0000) 2019-11-29T03:57:35.985 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:57:35.979+0000 1694c700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.873737+0000 front 2019-11-29T03:56:23.733075+0000 (oldest deadline 2019-11-29T03:57:07.210784+0000) 2019-11-29T03:57:36.597 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:57:36.591+0000 1694c700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:20.904245+0000 front 2019-11-29T03:56:20.988912+0000 (oldest deadline 2019-11-29T03:57:06.313109+0000) 2019-11-29T03:57:36.653 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:57:36.647+0000 1694c700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.633702+0000 front 2019-11-29T03:56:24.788265+0000 (oldest deadline 2019-11-29T03:57:09.154270+0000) 2019-11-29T03:57:36.702 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:57:36.699+0000 1694c700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.444176+0000 front 2019-11-29T03:56:24.302480+0000 (oldest deadline 2019-11-29T03:57:08.385877+0000) 2019-11-29T03:57:36.724 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:57:36.720+0000 1694c700 -1 osd.0 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:22.469652+0000 front 2019-11-29T03:56:22.521639+0000 (oldest deadline 2019-11-29T03:57:06.501778+0000) 2019-11-29T03:57:36.815 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:57:36.810+0000 1694c700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.034577+0000 front 2019-11-29T03:56:23.962213+0000 (oldest deadline 2019-11-29T03:57:06.162261+0000) 2019-11-29T03:57:36.946 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:57:36.943+0000 1694c700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.912114+0000 front 2019-11-29T03:56:24.036329+0000 (oldest deadline 2019-11-29T03:57:09.749701+0000) 2019-11-29T03:57:36.958 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:57:36.953+0000 1694c700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.873737+0000 front 2019-11-29T03:56:23.733075+0000 (oldest deadline 2019-11-29T03:57:07.210784+0000) 2019-11-29T03:57:37.593 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:57:37.588+0000 1694c700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:20.904245+0000 front 2019-11-29T03:56:20.988912+0000 (oldest deadline 2019-11-29T03:57:06.313109+0000) 2019-11-29T03:57:37.628 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:57:37.623+0000 1694c700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.633702+0000 front 2019-11-29T03:56:24.788265+0000 (oldest deadline 2019-11-29T03:57:09.154270+0000) 2019-11-29T03:57:37.681 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:57:37.678+0000 1694c700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.444176+0000 front 2019-11-29T03:56:24.302480+0000 (oldest deadline 2019-11-29T03:57:08.385877+0000) 2019-11-29T03:57:37.743 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:57:37.740+0000 1694c700 -1 osd.0 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:22.469652+0000 front 2019-11-29T03:56:22.521639+0000 (oldest deadline 2019-11-29T03:57:06.501778+0000) 2019-11-29T03:57:37.782 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:57:37.776+0000 1694c700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.034577+0000 front 2019-11-29T03:56:23.962213+0000 (oldest deadline 2019-11-29T03:57:06.162261+0000) 2019-11-29T03:57:37.898 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:57:37.895+0000 1694c700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.912114+0000 front 2019-11-29T03:56:24.036329+0000 (oldest deadline 2019-11-29T03:57:09.749701+0000) 2019-11-29T03:57:37.930 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:57:37.925+0000 1694c700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.873737+0000 front 2019-11-29T03:56:23.733075+0000 (oldest deadline 2019-11-29T03:57:07.210784+0000) 2019-11-29T03:57:38.571 INFO:tasks.ceph.osd.7.smithi141.stderr:2019-11-29T03:57:38.565+0000 1694c700 -1 osd.7 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:20.904245+0000 front 2019-11-29T03:56:20.988912+0000 (oldest deadline 2019-11-29T03:57:06.313109+0000) 2019-11-29T03:57:38.591 INFO:tasks.ceph.osd.6.smithi141.stderr:2019-11-29T03:57:38.586+0000 1694c700 -1 osd.6 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.633702+0000 front 2019-11-29T03:56:24.788265+0000 (oldest deadline 2019-11-29T03:57:09.154270+0000) 2019-11-29T03:57:38.680 INFO:tasks.ceph.osd.1.smithi074.stderr:2019-11-29T03:57:38.676+0000 1694c700 -1 osd.1 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.444176+0000 front 2019-11-29T03:56:24.302480+0000 (oldest deadline 2019-11-29T03:57:08.385877+0000) 2019-11-29T03:57:38.740 INFO:tasks.ceph.osd.5.smithi141.stderr:2019-11-29T03:57:38.734+0000 1694c700 -1 osd.5 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:24.034577+0000 front 2019-11-29T03:56:23.962213+0000 (oldest deadline 2019-11-29T03:57:06.162261+0000) 2019-11-29T03:57:38.758 INFO:tasks.ceph.osd.0.smithi074.stderr:2019-11-29T03:57:38.754+0000 1694c700 -1 osd.0 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:22.469652+0000 front 2019-11-29T03:56:22.521639+0000 (oldest deadline 2019-11-29T03:57:06.501778+0000) 2019-11-29T03:57:38.921 INFO:tasks.ceph.osd.2.smithi074.stderr:2019-11-29T03:57:38.917+0000 1694c700 -1 osd.2 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.912114+0000 front 2019-11-29T03:56:24.036329+0000 (oldest deadline 2019-11-29T03:57:09.749701+0000) 2019-11-29T03:57:38.962 INFO:tasks.ceph.osd.4.smithi141.stderr:2019-11-29T03:57:38.956+0000 1694c700 -1 osd.4 344 heartbeat_check: no reply from 172.21.15.74:6808 osd.3 since back 2019-11-29T03:56:23.873737+0000 front 2019-11-29T03:56:23.733075+0000 (oldest deadline 2019-11-29T03:57:07.210784+0000) 2019-11-29T03:57:39.273 INFO:tasks.ceph.mon.a.smithi074.stderr:2019-11-29T03:57:39.267+0000 1a899700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.74:6802/10096,v1:172.21.15.74:6803/10096] for 44sec e344 v344) 2019-11-29T03:58:15.083 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:58:15.056+0000 11cac700 -1 osd.3 350 build_incremental_map_msg missing incremental map 350 2019-11-29T03:58:15.141 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:58:15.110+0000 3578b700 -1 osd.3 350 build_incremental_map_msg missing incremental map 350 2019-11-29T03:58:15.153 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:58:15.137+0000 31f84700 -1 osd.3 350 build_incremental_map_msg missing incremental map 350 2019-11-29T03:58:15.336 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:58:15.307+0000 31783700 -1 osd.3 350 build_incremental_map_msg missing incremental map 350 2019-11-29T03:58:15.433 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:58:15.353+0000 3678d700 -1 osd.3 350 build_incremental_map_msg missing incremental map 350 2019-11-29T03:58:15.513 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:58:15.451+0000 38f92700 -1 osd.3 350 build_incremental_map_msg missing incremental map 350 2019-11-29T03:58:15.549 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:58:15.476+0000 36f8e700 -1 osd.3 350 build_incremental_map_msg missing incremental map 350 2019-11-29T03:58:15.614 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:58:15.578+0000 33f88700 -1 osd.3 350 build_incremental_map_msg missing incremental map 350 2019-11-29T03:58:16.667 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:58:16.603+0000 37f90700 -1 osd.3 350 build_incremental_map_msg missing incremental map 350 2019-11-29T03:58:17.312 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:58:17.257+0000 37f90700 -1 osd.3 350 build_incremental_map_msg missing incremental map 350 2019-11-29T03:58:17.314 INFO:tasks.ceph.osd.3.smithi074.stderr:2019-11-29T03:58:17.293+0000 38791700 -1 osd.3 350 build_incremental_map_msg missing incremental map 350 2019-11-29T03:58:33.956 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2019-11-29T03:58:33.957 DEBUG:teuthology.task.console_log:Killing console logger for smithi074 2019-11-29T03:58:33.958 DEBUG:teuthology.task.console_log:Killing console logger for smithi141 2019-11-29T03:58:33.958 DEBUG:teuthology.task.console_log:Killing console logger for smithi074 2019-11-29T03:58:33.959 DEBUG:teuthology.task.console_log:Killing console logger for smithi141 2019-11-29T03:58:33.959 DEBUG:teuthology.exit:Finished running handlers